Sep 10 16:32:20 devstack cinder-volume[77150]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 10 16:32:20 devstack cinder-volume[77150]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 10 16:32:20 devstack cinder-volume[77150]: we strongly recommend against using it for new projects. Sep 10 16:32:20 devstack cinder-volume[77150]: If you are already using Eventlet, we recommend migrating to a different Sep 10 16:32:20 devstack cinder-volume[77150]: framework. For more detail see Sep 10 16:32:20 devstack cinder-volume[77150]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 10 16:32:20 devstack cinder-volume[77150]: import eventlet # noqa Sep 10 16:32:23 devstack cinder-volume[77150]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77150) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 10 16:32:23 devstack cinder-volume[77150]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77150) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 10 16:32:23 devstack cinder-volume[77150]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77150) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 10 16:32:24 devstack cinder-volume[77150]: INFO dbcounter [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] Registered counter for database cinder Sep 10 16:32:24 devstack cinder-volume[77150]: DEBUG oslo_db.sqlalchemy.engines [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77150) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 16:32:24 devstack cinder-volume[77150]: DEBUG dbcounter [-] [77150] Writer thread running {{(pid=77150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 10 16:32:24 devstack cinder-volume[77150]: INFO cinder.rpc [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 10 16:32:24 devstack cinder-volume[77150]: INFO cinder.rpc [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 10 16:32:24 devstack cinder-volume[77150]: DEBUG oslo_db.sqlalchemy.engines [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77150) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 16:32:24 devstack cinder-volume[77150]: INFO cinder.volume.manager [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] Determined volume DB was empty at startup. Sep 10 16:32:24 devstack cinder-volume[77150]: DEBUG cinder.volume.manager [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77150) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 10 16:32:24 devstack cinder-volume[77150]: INFO cinder.volume.manager [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 10 16:32:24 devstack cinder-volume[77150]: WARNING stevedore.named [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 10 16:32:24 devstack cinder-volume[77150]: WARNING castellan.key_manager [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 16:32:24 devstack cinder-volume[77150]: WARNING cinder.keymgr.conf_key_mgr [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 16:32:24 devstack cinder-volume[77150]: DEBUG cinder.volume.drivers.lvm [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77150) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 10 16:32:24 devstack cinder-volume[77150]: DEBUG oslo_concurrency.processutils [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_concurrency.processutils [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] CMD "cinder-rtstool verify" returned: 0 in 0.520s {{(pid=77150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_db.sqlalchemy.engines [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77150) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 16:32:25 devstack cinder-volume[77150]: INFO cinder.rpc [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 10 16:32:25 devstack cinder-volume[77150]: INFO cinder.rpc [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 10 16:32:25 devstack cinder-volume[77150]: WARNING stevedore.named [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 10 16:32:25 devstack cinder-volume[77150]: WARNING castellan.key_manager [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 16:32:25 devstack cinder-volume[77150]: INFO cinder.volume.manager [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_db.sqlalchemy.engines [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77150) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 16:32:25 devstack cinder-volume[77150]: INFO oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] Starting 1 workers Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] Started child 77312 {{(pid=77150) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] Full set of CONF: {{(pid=77150) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] ******************************************************************************** {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] Configuration options gathered from: {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] ================================================================================ {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] allow_availability_zone_fallback = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] allow_compression_on_image_upload = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] allowed_direct_url_schemes = [] {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] api_rate_limit = True {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] auth_strategy = keystone {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] az_cache_duration = 3600 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_availability_zone = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77312]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_host = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_name = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_stats_polling_interval = 60 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backup_api_class = cinder.backup.api.API {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backup_name_template = backup-%s {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backup_use_same_host = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backup_use_temp_snapshot = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] chap_password = **** {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] chap_username = {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cinder_internal_tenant_project_id = e944d22dbd9e46b6afd8b7d96200eab7 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cinder_internal_tenant_user_id = bcc83a76aadb49ae911dbe4308339966 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cloned_volume_same_az = True {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cluster = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] compression_format = gzip {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] compute_api_class = cinder.compute.nova.API {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] config_dir = [] {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] config_source = [] {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] control_exchange = openstack {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] debug = True {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] default_availability_zone = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] default_group_type = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] default_volume_type = lvmdriver-1 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] disk_geometry = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] driver_client_cert = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] driver_client_cert_key = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] driver_data_namespace = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] driver_ssl_cert_path = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] driver_ssl_cert_verify = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] driver_use_ssl = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] enable_force_upload = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] enable_new_services = True {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] enable_unsupported_driver = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] enabled_backends = ['lvmdriver-1'] {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] enforce_multipath_for_image_xfer = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] filter_function = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] glance_api_insecure = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] glance_api_servers = ['http://192.168.122.226/image'] {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] glance_api_ssl_compression = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] glance_ca_certificates_file = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] glance_catalog_info = image:glance:publicURL {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] glance_certfile = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] glance_keyfile = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] glance_num_retries = 3 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] glance_request_timeout = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] goodness_function = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] graceful_shutdown_timeout = 5 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] group_api_class = cinder.group.api.API {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] host = devstack {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] image_compress_on_upload = True {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] image_conversion_address_space_limit = 1 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] image_conversion_cpu_limit = 60 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] image_conversion_disable = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] image_upload_use_cinder_backend = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] image_upload_use_internal_tenant = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] image_volume_cache_enabled = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] image_volume_cache_max_count = 0 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] image_volume_cache_max_size_gb = 0 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] init_host_max_objects_retrieval = 0 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] instance_format = [instance: %(uuid)s] {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] iscsi_target_flags = {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] iscsi_write_cache = on {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] iser_helper = tgtadm {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] iser_ip_address = 192.168.122.226 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] iser_port = 3260 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] log_color = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] log_config_append = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] log_dir = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] log_file = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] log_options = True {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] log_rotate_interval = 1 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] log_rotate_interval_type = days {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] log_rotation_type = none {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] max_age = 0 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] max_logfile_count = 30 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] max_logfile_size_mb = 200 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] max_over_subscription_ratio = 20.0 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] message_reap_interval = 86400 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] message_ttl = 2592000 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] migration_create_volume_timeout_secs = 300 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] monkey_patch = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] monkey_patch_modules = [] {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] my_ip = 192.168.122.226 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] no_snapshot_gb_quota = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77312]: INFO cinder.volume.manager [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 10 16:32:25 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] num_iser_scan_tries = 3 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] num_shell_tries = 3 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] num_volume_device_scan_tries = 3 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] nvmeof_conn_info_version = 1 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] nvmet_ns_id = 10 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] nvmet_port_id = 1 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] osapi_max_limit = 1000 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] osapi_volume_ext_list = [] {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] osapi_volume_listen = 0.0.0.0 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] osapi_volume_listen_port = 8776 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] osapi_volume_use_ssl = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] osapi_volume_workers = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] per_volume_size_limit = -1 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] periodic_fuzzy_delay = 60 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] periodic_interval = 60 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] project_id_regex = [0-9a-f\-]+ {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] public_endpoint = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] publish_errors = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] quota_backup_gigabytes = 1000 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] quota_backups = 10 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] quota_gigabytes = 1000 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] quota_groups = 10 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] quota_snapshots = 10 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] quota_volumes = 10 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] rate_limit_burst = 0 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] rate_limit_except_level = CRITICAL {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] rate_limit_interval = 0 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] reinit_driver_count = 3 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] replication_device = **** {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] report_discard_supported = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] report_interval = 120 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] reservation_clean_interval = 86400 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] reservation_expire = 86400 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] reserved_image_namespaces = [] {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] reserved_percentage = 0 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] rpc_response_timeout = 120 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] run_external_periodic_tasks = True {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] scst_target_driver = iscsi {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] scst_target_iqn_name = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] service_down_time = 720 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] shell_completion = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] snapshot_name_template = snapshot-%s {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] snapshot_same_host = True {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] split_loggers = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] state_path = /opt/stack/data/cinder {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] storage_availability_zone = nova {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] storage_protocol = iSCSI {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] syslog_log_facility = LOG_USER {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] target_helper = lioadm {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] target_ip_address = 192.168.122.226 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] target_port = 3260 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] target_protocol = iscsi {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] target_secondary_ip_addresses = [] {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] trace_flags = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] transfer_api_class = cinder.transfer.api.API {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] transport_url = **** {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] until_refresh = 0 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] use_chap_auth = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.048s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] use_default_quota_class = True {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] use_journal = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] use_json = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] use_multipath_for_image_xfer = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] use_stderr = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] use_syslog = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] verify_glance_signatures = enabled {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] volume_api_class = cinder.volume.api.API {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] volume_backend_name = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] volume_clear = zero {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] volume_clear_ionice = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] volume_clear_size = 0 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] volume_copy_bps_limit = 0 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] volume_dd_blocksize = 1M {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] volume_name_template = volume-%s {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] volume_service_inithost_offload = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] volume_usage_audit_period = month {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] zoning_mode = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_concurrency.disable_process_locking = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.auth_section = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.auth_type = password {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.auth_version = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.cache = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.certfile = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.include_service_catalog = True {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.insecure = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.interface = public {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.keyfile = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.memcache_password = **** {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:32:25 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.memcache_username = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.region_name = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.service_token_roles_required = True {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.service_type = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.226/identity {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.backend = dogpile.cache.null {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.backend_argument = **** {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.backend_expiration_time = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.config_prefix = cache.oslo {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.debug_cache_backend = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.enable_retry_client = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.enable_socket_keepalive = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.enabled = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.expiration_time = 600 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.hashclient_retry_attempts = 2 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.memcache_dead_retry = 300 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.memcache_pool_maxsize = 10 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.memcache_sasl_enabled = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.password = **** {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.proxies = [] {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.redis_db = 0 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.redis_server = localhost:6379 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.retry_attempts = 2 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.retry_delay = 0.0 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.socket_keepalive_count = 1 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.socket_keepalive_idle = 1 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.socket_keepalive_interval = 1 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.socket_timeout = 1.0 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.tls_allowed_ciphers = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.tls_cafile = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.tls_certfile = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.tls_enabled = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.tls_keyfile = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cache.username = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] coordination.backend_url = **** {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] database.asyncio_connection = **** {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] database.asyncio_slave_connection = **** {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] database.backend = sqlalchemy {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] database.connection = **** {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] database.connection_debug = 0 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] database.connection_parameters = {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] database.connection_recycle_time = 3600 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] database.connection_trace = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] database.db_inc_retry_interval = True {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] database.db_max_retries = 20 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] database.db_max_retry_interval = 10 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] database.db_retry_interval = 1 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] database.max_overflow = 50 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] database.max_pool_size = 5 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] database.max_retries = 10 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] database.mysql_wsrep_sync_wait = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] database.pool_timeout = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] database.retry_interval = 10 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] database.slave_connection = **** {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] database.sqlite_synchronous = True {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] database.synchronous_reader = True {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] database.use_db_reconnect = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_tracing.insecure = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] profiler.connection_string = messaging:// {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] profiler.enabled = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] profiler.es_doc_type = notification {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] profiler.es_scroll_size = 10000 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] profiler.es_scroll_time = 2m {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] profiler.filter_error_trace = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] profiler.hmac_keys = **** {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] profiler.sentinel_service_name = mymaster {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] profiler.socket_timeout = 0.1 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] profiler.trace_requests = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] profiler.trace_sqlalchemy = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] profiler_jaeger.process_tags = {} {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] profiler_jaeger.service_name_prefix = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] profiler_otlp.service_name_prefix = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_policy.enforce_new_defaults = True {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_policy.policy_default_rule = default {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_policy.policy_file = policy.yaml {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_policy.remote_timeout = 60.0 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] privsep_osbrick.group = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] privsep_osbrick.helper_command = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] privsep_osbrick.user = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cinder_sys_admin.group = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cinder_sys_admin.helper_command = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] cinder_sys_admin.user = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] service_user.auth_section = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] service_user.auth_type = password {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] service_user.cafile = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] service_user.certfile = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] service_user.collect_timing = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack sudo[77376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] service_user.insecure = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] service_user.keyfile = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] service_user.send_service_user_token = True {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] service_user.split_loggers = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] service_user.timeout = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] service_user.tls_ciphers = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] service_user.tls_min_version = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack sudo[77376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] glance.auth_section = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] glance.auth_type = password {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] glance.certfile = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] glance.collect_timing = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] glance.insecure = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] glance.keyfile = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] glance.region_name = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] glance.split_loggers = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] glance.timeout = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] glance.tls_ciphers = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] glance.tls_min_version = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.backend_availability_zone = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.chap_password = **** {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.chap_username = {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.disk_geometry = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.driver_client_cert = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.driver_client_cert_key = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.driver_data_namespace = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.driver_use_ssl = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.extra_capabilities = {} {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.filter_function = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.goodness_function = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.iscsi_target_flags = {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.iscsi_write_cache = on {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.iser_helper = tgtadm {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.iser_ip_address = 192.168.122.226 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.iser_port = 3260 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.lvm_mirrors = 0 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.lvm_share_target = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.lvm_type = auto {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.num_shell_tries = 3 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.replication_device = **** {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.report_discard_supported = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.reserved_percentage = 0 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.target_helper = tgtadm {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.target_ip_address = 192.168.122.226 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:25 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.target_port = 3260 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.target_protocol = iscsi {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.trace_flags = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.unique_fqdn_network = True {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.use_chap_auth = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.volume_backend_name = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.volume_clear = zero {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.volume_clear_ionice = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.volume_clear_size = 0 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.volume_group = cinder-volumes {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_reports.file_event_handler = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_reports.log_dir = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.backend_availability_zone = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.backend_host = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.chap_password = **** {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.chap_username = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.chiscsi_conf = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.disk_geometry = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.driver_client_cert = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.driver_data_namespace = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.driver_use_ssl = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.extra_capabilities = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.filter_function = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.goodness_function = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.iser_helper = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.iser_ip_address = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.iser_port = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.iser_target_prefix = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.lvm_conf_file = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.lvm_mirrors = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.lvm_share_target = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.lvm_type = auto {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.num_shell_tries = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.nvmet_port_id = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.replication_device = **** {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.report_discard_supported = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.reserved_percentage = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.scst_target_driver = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.storage_protocol = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.target_helper = lioadm {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.target_ip_address = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.target_port = 3260 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.target_protocol = iscsi {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.trace_flags = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.use_chap_auth = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.volume_clear = zero {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.volume_clear_size = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] lvmdriver-1.volumes_dir = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.ssl = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_notifications.driver = [] {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_notifications.retry = -1 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] key_manager.fixed_key = **** {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] barbican.barbican_api_version = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] barbican.barbican_endpoint = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] barbican.barbican_endpoint_type = public {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] barbican.barbican_region_name = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] barbican.cafile = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] barbican.certfile = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] barbican.collect_timing = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] barbican.insecure = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] barbican.keyfile = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] barbican.number_of_retries = 60 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] barbican.retry_delay = 1 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] barbican.send_service_user_token = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] barbican.split_loggers = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] barbican.timeout = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] barbican.tls_ciphers = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] barbican.tls_min_version = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] barbican.verify_ssl = True {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] barbican.verify_ssl_path = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] barbican_service_user.auth_section = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] barbican_service_user.auth_type = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] barbican_service_user.cafile = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] barbican_service_user.certfile = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] barbican_service_user.collect_timing = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] barbican_service_user.insecure = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] barbican_service_user.keyfile = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] barbican_service_user.split_loggers = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] barbican_service_user.timeout = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] barbican_service_user.tls_ciphers = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] barbican_service_user.tls_min_version = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] vault.approle_role_id = **** {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] vault.approle_secret_id = **** {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] vault.auth_method = approle {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] vault.auth_path = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] vault.kv_mountpoint = secret {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] vault.kv_path = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] vault.kv_version = 2 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] vault.namespace = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] vault.root_token_id = **** {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] vault.ssl_ca_crt_file = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] vault.timeout = 60.0 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] vault.token_file = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] vault.token_role = None {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] vault.use_ssl = False {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:32:26 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] ******************************************************************************** {{(pid=77150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 10 16:32:26 devstack sudo[77376]: pam_unix(sudo:session): session closed for user root Sep 10 16:32:26 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.411s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:32:26 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:32:26 devstack sudo[77502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 16:32:26 devstack sudo[77502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:32:26 devstack sudo[77502]: pam_unix(sudo:session): session closed for user root Sep 10 16:32:26 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.339s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:32:26 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 16:32:26 devstack cinder-volume[77312]: INFO cinder.brick.local_dev.lvm [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 10 16:32:26 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:32:26 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:32:26 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:32:26 devstack sudo[77583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 16:32:26 devstack sudo[77583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:32:26 devstack sudo[77583]: pam_unix(sudo:session): session closed for user root Sep 10 16:32:26 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:32:26 devstack cinder-volume[77312]: DEBUG cinder.brick.local_dev.lvm [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77312) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 10 16:32:26 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:32:26 devstack sudo[77660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 16:32:26 devstack sudo[77660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:32:27 devstack sudo[77660]: pam_unix(sudo:session): session closed for user root Sep 10 16:32:27 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.535s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:32:27 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:32:27 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:32:27 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:32:27 devstack sudo[77840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 16:32:27 devstack sudo[77840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:32:27 devstack sudo[77840]: pam_unix(sudo:session): session closed for user root Sep 10 16:32:27 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.382s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:32:27 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:32:27 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:32:27 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:32:27 devstack sudo[77927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 10 16:32:27 devstack sudo[77927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:32:28 devstack sudo[77927]: pam_unix(sudo:session): session closed for user root Sep 10 16:32:28 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.293s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:32:28 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:32:28 devstack sudo[77936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 16:32:28 devstack sudo[77936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:32:28 devstack sudo[77936]: pam_unix(sudo:session): session closed for user root Sep 10 16:32:28 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.361s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:32:28 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:32:28 devstack sudo[78014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 16:32:28 devstack sudo[78014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:32:28 devstack sudo[78014]: pam_unix(sudo:session): session closed for user root Sep 10 16:32:28 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:32:28 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:32:28 devstack sudo[78023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 16:32:28 devstack sudo[78023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:32:29 devstack sudo[78023]: pam_unix(sudo:session): session closed for user root Sep 10 16:32:29 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.355s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:32:29 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:32:29 devstack sudo[78093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 16:32:29 devstack sudo[78093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:32:29 devstack sudo[78093]: pam_unix(sudo:session): session closed for user root Sep 10 16:32:29 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.346s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:32:29 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:32:29 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:32:29 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:32:29 devstack sudo[78111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 16:32:29 devstack sudo[78111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:32:29 devstack sudo[78111]: pam_unix(sudo:session): session closed for user root Sep 10 16:32:29 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.316s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:32:29 devstack cinder-volume[77312]: INFO cinder.volume.drivers.lvm [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 10 16:32:29 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:32:29 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:32:29 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:32:29 devstack sudo[78115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 16:32:30 devstack sudo[78115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:32:30 devstack sudo[78115]: pam_unix(sudo:session): session closed for user root Sep 10 16:32:30 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.304s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:32:30 devstack cinder-volume[77312]: DEBUG cinder.volume.drivers.lvm [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Updating volume stats {{(pid=77312) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 10 16:32:30 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:32:30 devstack sudo[78118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 16:32:30 devstack sudo[78118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:32:30 devstack sudo[78118]: pam_unix(sudo:session): session closed for user root Sep 10 16:32:30 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:32:30 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:32:30 devstack sudo[78127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 16:32:30 devstack sudo[78127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:32:30 devstack sudo[78127]: pam_unix(sudo:session): session closed for user root Sep 10 16:32:30 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:32:30 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:32:30 devstack sudo[78130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 16:32:30 devstack sudo[78130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:32:31 devstack sudo[78130]: pam_unix(sudo:session): session closed for user root Sep 10 16:32:31 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:32:31 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:32:31 devstack sudo[78133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 16:32:31 devstack sudo[78133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:32:31 devstack sudo[78133]: pam_unix(sudo:session): session closed for user root Sep 10 16:32:31 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:32:31 devstack cinder-volume[77312]: INFO cinder.volume.driver [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Driver hasn't implemented _init_vendor_properties() Sep 10 16:32:31 devstack cinder-volume[77312]: DEBUG cinder.volume.driver [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77312) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 10 16:32:31 devstack cinder-volume[77312]: DEBUG oslo_db.sqlalchemy.engines [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77312) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 16:32:31 devstack cinder-volume[77312]: DEBUG dbcounter [-] [77312] Writer thread running {{(pid=77312) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 10 16:32:31 devstack cinder-volume[77312]: DEBUG cinder.db.api [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Building query based on filter {{(pid=77312) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 10 16:32:31 devstack cinder-volume[77312]: DEBUG cinder.image.image_utils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77312) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 10 16:32:31 devstack cinder-volume[77312]: INFO cinder.keymgr.migration [None req-21c135cc-6222-47b2-a3eb-0e9909bcd3b1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 10 16:32:31 devstack cinder-volume[77312]: DEBUG cinder.volume.drivers.lvm [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Updating volume stats {{(pid=77312) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 10 16:32:31 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:32:31 devstack sudo[78137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 16:32:31 devstack sudo[78137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:32:31 devstack sudo[78137]: pam_unix(sudo:session): session closed for user root Sep 10 16:32:31 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.320s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:32:31 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:32:31 devstack sudo[78142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 16:32:31 devstack sudo[78142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:32:32 devstack sudo[78142]: pam_unix(sudo:session): session closed for user root Sep 10 16:32:32 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.326s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:32:32 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:32:32 devstack sudo[78145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 16:32:32 devstack sudo[78145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:32:32 devstack sudo[78145]: pam_unix(sudo:session): session closed for user root Sep 10 16:32:32 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.299s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:32:32 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:32:32 devstack sudo[78148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 16:32:32 devstack sudo[78148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:32:32 devstack sudo[78148]: pam_unix(sudo:session): session closed for user root Sep 10 16:32:32 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.361s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:32:32 devstack cinder-volume[77312]: DEBUG cinder.manager [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Notifying Schedulers of capabilities ... {{(pid=77312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:32:32 devstack cinder-volume[77312]: INFO cinder.volume.manager [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Driver initialization completed successfully. Sep 10 16:32:32 devstack cinder-volume[77312]: INFO cinder.manager [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Initiating service 2 cleanup Sep 10 16:32:32 devstack cinder-volume[77312]: INFO cinder.manager [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Service 2 cleanup completed. Sep 10 16:32:32 devstack cinder-volume[77312]: DEBUG cinder.service [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Creating RPC server for service cinder-volume {{(pid=77312) start /opt/stack/cinder/cinder/service.py:231}} Sep 10 16:32:33 devstack cinder-volume[77312]: DEBUG cinder.service [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77312) start /opt/stack/cinder/cinder/service.py:237}} Sep 10 16:32:33 devstack cinder-volume[77312]: INFO cinder.volume.manager [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 10 16:32:33 devstack cinder-volume[77312]: DEBUG cinder.volume.drivers.lvm [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Updating volume stats {{(pid=77312) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 10 16:32:33 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:32:33 devstack sudo[78154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 16:32:33 devstack sudo[78154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:32:33 devstack sudo[78154]: pam_unix(sudo:session): session closed for user root Sep 10 16:32:33 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.320s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:32:33 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:32:33 devstack sudo[78157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 16:32:33 devstack sudo[78157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:32:33 devstack sudo[78157]: pam_unix(sudo:session): session closed for user root Sep 10 16:32:33 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:32:33 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:32:33 devstack sudo[78160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 16:32:33 devstack sudo[78160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:32:34 devstack sudo[78160]: pam_unix(sudo:session): session closed for user root Sep 10 16:32:34 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.311s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:32:34 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:32:34 devstack sudo[78166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 16:32:34 devstack sudo[78166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:32:34 devstack sudo[78166]: pam_unix(sudo:session): session closed for user root Sep 10 16:32:34 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:32:34 devstack cinder-volume[77312]: INFO cinder.volume.manager [None req-d475a7e6-c6a2-4004-b28e-6759051b1787 None None] Driver post RPC initialization completed successfully. Sep 10 16:32:35 devstack cinder-volume[77150]: DEBUG dbcounter [-] [77150] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:32:44 devstack cinder-volume[77312]: DEBUG dbcounter [-] [77312] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77312) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:32:44 devstack cinder-volume[77312]: DEBUG dbcounter [-] [77312] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=77312) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:32:52 devstack cinder-volume[77312]: DEBUG oslo_service.periodic_task [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] Running periodic task VolumeManager._thread_info {{(pid=77312) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:32:52 devstack cinder-volume[77312]: DEBUG cinder.volume.manager [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] thread count: 6 {{(pid=77312) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 16:32:52 devstack cinder-volume[77312]: DEBUG cinder.volume.manager [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] thread info: [<_MainThread(MainThread, started 126425928847488)>, , , , , ] {{(pid=77312) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 16:33:52 devstack cinder-volume[77312]: DEBUG oslo_service.periodic_task [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77312) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:33:52 devstack cinder-volume[77312]: DEBUG cinder.volume.drivers.lvm [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] Updating volume stats {{(pid=77312) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 10 16:33:52 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:33:52 devstack sudo[80403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 16:33:52 devstack sudo[80403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:33:52 devstack sudo[80403]: pam_unix(sudo:session): session closed for user root Sep 10 16:33:52 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.318s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:33:52 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:33:52 devstack sudo[80460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 16:33:52 devstack sudo[80460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:33:53 devstack sudo[80460]: pam_unix(sudo:session): session closed for user root Sep 10 16:33:53 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.304s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:33:53 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:33:53 devstack sudo[80519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 16:33:53 devstack sudo[80519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:33:53 devstack sudo[80519]: pam_unix(sudo:session): session closed for user root Sep 10 16:33:53 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.294s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:33:53 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:33:53 devstack sudo[80523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 16:33:53 devstack sudo[80523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:33:53 devstack sudo[80523]: pam_unix(sudo:session): session closed for user root Sep 10 16:33:53 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:33:53 devstack cinder-volume[77312]: DEBUG cinder.manager [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] Notifying Schedulers of capabilities ... {{(pid=77312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:33:53 devstack cinder-volume[77312]: DEBUG oslo_service.periodic_task [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] Running periodic task VolumeManager._thread_info {{(pid=77312) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:33:53 devstack cinder-volume[77312]: DEBUG cinder.volume.manager [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] thread count: 6 {{(pid=77312) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 16:33:53 devstack cinder-volume[77312]: DEBUG cinder.volume.manager [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] thread info: [<_MainThread(MainThread, started 126425928847488)>, , , , , ] {{(pid=77312) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 16:34:44 devstack cinder-volume[77312]: DEBUG dbcounter [-] [77312] Writing DB stats cinder:SELECT=1 {{(pid=77312) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:34:44 devstack cinder-volume[77312]: DEBUG dbcounter [-] [77312] Writing DB stats cinder:UPDATE=1 {{(pid=77312) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:34:52 devstack cinder-volume[77312]: DEBUG oslo_service.periodic_task [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77312) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:34:52 devstack cinder-volume[77312]: DEBUG cinder.volume.drivers.lvm [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] Updating volume stats {{(pid=77312) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 10 16:34:52 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:34:52 devstack sudo[83598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 16:34:52 devstack sudo[83598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:34:52 devstack sudo[83598]: pam_unix(sudo:session): session closed for user root Sep 10 16:34:52 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:34:52 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:34:52 devstack sudo[83602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 16:34:52 devstack sudo[83602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:34:52 devstack sudo[83602]: pam_unix(sudo:session): session closed for user root Sep 10 16:34:52 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:34:52 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:34:52 devstack sudo[83611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 16:34:52 devstack sudo[83611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:34:53 devstack sudo[83611]: pam_unix(sudo:session): session closed for user root Sep 10 16:34:53 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:34:53 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:34:53 devstack sudo[83614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 16:34:53 devstack sudo[83614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:34:53 devstack sudo[83614]: pam_unix(sudo:session): session closed for user root Sep 10 16:34:53 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:34:53 devstack cinder-volume[77312]: DEBUG cinder.manager [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] Notifying Schedulers of capabilities ... {{(pid=77312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:34:53 devstack cinder-volume[77312]: DEBUG oslo_service.periodic_task [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] Running periodic task VolumeManager._thread_info {{(pid=77312) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:34:53 devstack cinder-volume[77312]: DEBUG cinder.volume.manager [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] thread count: 6 {{(pid=77312) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 16:34:53 devstack cinder-volume[77312]: DEBUG cinder.volume.manager [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] thread info: [<_MainThread(MainThread, started 126425928847488)>, , , , , ] {{(pid=77312) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 16:35:52 devstack cinder-volume[77312]: DEBUG oslo_service.periodic_task [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77312) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:35:52 devstack cinder-volume[77312]: DEBUG cinder.volume.drivers.lvm [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] Updating volume stats {{(pid=77312) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 10 16:35:52 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:35:52 devstack sudo[85599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 16:35:52 devstack sudo[85599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:35:52 devstack sudo[85599]: pam_unix(sudo:session): session closed for user root Sep 10 16:35:52 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:35:52 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:35:52 devstack sudo[85602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 16:35:52 devstack sudo[85602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:35:52 devstack sudo[85602]: pam_unix(sudo:session): session closed for user root Sep 10 16:35:52 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:35:52 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:35:53 devstack sudo[85605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 16:35:53 devstack sudo[85605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:35:53 devstack sudo[85605]: pam_unix(sudo:session): session closed for user root Sep 10 16:35:53 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.304s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:35:53 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:35:53 devstack sudo[85611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 16:35:53 devstack sudo[85611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:35:53 devstack sudo[85611]: pam_unix(sudo:session): session closed for user root Sep 10 16:35:53 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:35:53 devstack cinder-volume[77312]: DEBUG cinder.manager [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] Notifying Schedulers of capabilities ... {{(pid=77312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:36:44 devstack cinder-volume[77312]: DEBUG dbcounter [-] [77312] Writing DB stats cinder:SELECT=1 {{(pid=77312) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:36:44 devstack cinder-volume[77312]: DEBUG dbcounter [-] [77312] Writing DB stats cinder:UPDATE=1 {{(pid=77312) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:36:52 devstack cinder-volume[77312]: DEBUG oslo_service.periodic_task [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77312) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:36:52 devstack cinder-volume[77312]: DEBUG cinder.volume.drivers.lvm [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] Updating volume stats {{(pid=77312) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 10 16:36:52 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:36:52 devstack sudo[86722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 16:36:52 devstack sudo[86722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:36:52 devstack sudo[86722]: pam_unix(sudo:session): session closed for user root Sep 10 16:36:52 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:36:52 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:36:52 devstack sudo[86753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 16:36:52 devstack sudo[86753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:36:52 devstack sudo[86753]: pam_unix(sudo:session): session closed for user root Sep 10 16:36:53 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:36:53 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:36:53 devstack sudo[86770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 16:36:53 devstack sudo[86770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:36:53 devstack sudo[86770]: pam_unix(sudo:session): session closed for user root Sep 10 16:36:53 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.303s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:36:53 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:36:53 devstack sudo[86790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 16:36:53 devstack sudo[86790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:36:53 devstack sudo[86790]: pam_unix(sudo:session): session closed for user root Sep 10 16:36:53 devstack cinder-volume[77312]: DEBUG oslo_concurrency.processutils [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=77312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:36:53 devstack cinder-volume[77312]: DEBUG cinder.manager [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] Notifying Schedulers of capabilities ... {{(pid=77312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:36:53 devstack cinder-volume[77312]: DEBUG oslo_service.periodic_task [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] Running periodic task VolumeManager._thread_info {{(pid=77312) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:36:53 devstack cinder-volume[77312]: DEBUG cinder.volume.manager [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] thread count: 6 {{(pid=77312) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 16:36:53 devstack cinder-volume[77312]: DEBUG cinder.volume.manager [None req-50bc4a4e-c58e-41c1-ba2c-2b0c7cbbfeda None None] thread info: [<_MainThread(MainThread, started 126425928847488)>, , , , , ] {{(pid=77312) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 16:37:14 devstack cinder-volume[77150]: INFO oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] Caught SIGTERM, stopping children Sep 10 16:37:14 devstack cinder-volume[77150]: DEBUG oslo_concurrency.lockutils [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] Acquiring lock "singleton_lock" {{(pid=77150) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 10 16:37:14 devstack cinder-volume[77150]: DEBUG oslo_concurrency.lockutils [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] Acquired lock "singleton_lock" {{(pid=77150) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 10 16:37:14 devstack cinder-volume[77150]: DEBUG oslo_concurrency.lockutils [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] Releasing lock "singleton_lock" {{(pid=77150) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 10 16:37:14 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] Stop services. {{(pid=77150) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 10 16:37:14 devstack cinder-volume[77150]: DEBUG oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] Killing children. {{(pid=77150) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 10 16:37:14 devstack cinder-volume[77150]: INFO oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] Waiting on 1 children to exit Sep 10 16:37:18 devstack cinder-volume[77312]: DEBUG oslo_concurrency.lockutils [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] Acquiring lock "singleton_lock" {{(pid=77312) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 10 16:37:18 devstack cinder-volume[77312]: DEBUG oslo_concurrency.lockutils [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] Acquired lock "singleton_lock" {{(pid=77312) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 10 16:37:18 devstack cinder-volume[77312]: DEBUG oslo_concurrency.lockutils [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] Releasing lock "singleton_lock" {{(pid=77312) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 10 16:37:18 devstack cinder-volume[77312]: WARNING amqp [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 10 16:37:18 devstack cinder-volume[77312]: WARNING amqp [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 10 16:37:18 devstack cinder-volume[77150]: INFO oslo_service.backend._eventlet.service [None req-eadeb9a2-73f6-42a1-9c8f-ffdd644987a6 None None] Child 77312 exited with status 0 Sep 10 16:37:18 devstack cinder-volume[87365]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 10 16:37:18 devstack cinder-volume[87365]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 10 16:37:18 devstack cinder-volume[87365]: we strongly recommend against using it for new projects. Sep 10 16:37:18 devstack cinder-volume[87365]: If you are already using Eventlet, we recommend migrating to a different Sep 10 16:37:18 devstack cinder-volume[87365]: framework. For more detail see Sep 10 16:37:18 devstack cinder-volume[87365]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 10 16:37:18 devstack cinder-volume[87365]: import eventlet # noqa Sep 10 16:37:20 devstack cinder-volume[87365]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 10 16:37:20 devstack cinder-volume[87365]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 10 16:37:20 devstack cinder-volume[87365]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 10 16:37:21 devstack cinder-volume[87365]: INFO dbcounter [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] Registered counter for database cinder Sep 10 16:37:21 devstack cinder-volume[87365]: DEBUG oslo_db.sqlalchemy.engines [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87365) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 16:37:21 devstack cinder-volume[87365]: DEBUG dbcounter [-] [87365] Writer thread running {{(pid=87365) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 10 16:37:21 devstack cinder-volume[87365]: INFO cinder.rpc [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 10 16:37:21 devstack cinder-volume[87365]: INFO cinder.rpc [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 10 16:37:21 devstack cinder-volume[87365]: DEBUG oslo_db.sqlalchemy.engines [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87365) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 16:37:21 devstack cinder-volume[87365]: INFO cinder.volume.manager [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] Determined volume DB was empty at startup. Sep 10 16:37:21 devstack cinder-volume[87365]: DEBUG cinder.volume.manager [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87365) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 10 16:37:21 devstack cinder-volume[87365]: INFO cinder.volume.manager [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 10 16:37:21 devstack cinder-volume[87365]: WARNING stevedore.named [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 10 16:37:21 devstack cinder-volume[87365]: WARNING castellan.key_manager [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 16:37:21 devstack cinder-volume[87365]: WARNING cinder.keymgr.conf_key_mgr [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 16:37:22 devstack cinder-volume[87365]: INFO cinder.volume.manager [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_db.sqlalchemy.engines [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87365) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 16:37:22 devstack cinder-volume[87365]: INFO oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] Starting 1 workers Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] Started child 87582 {{(pid=87365) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] Full set of CONF: {{(pid=87365) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] ******************************************************************************** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] Configuration options gathered from: {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] ================================================================================ {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] allow_availability_zone_fallback = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] allow_compression_on_image_upload = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] allowed_direct_url_schemes = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] api_rate_limit = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] auth_strategy = keystone {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_availability_zone = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_host = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_name = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_stats_polling_interval = 60 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backup_api_class = cinder.backup.api.API {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87582]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backup_name_template = backup-%s {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backup_use_same_host = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backup_use_temp_snapshot = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] chap_password = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] chap_username = {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cinder_internal_tenant_project_id = e944d22dbd9e46b6afd8b7d96200eab7 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cinder_internal_tenant_user_id = bcc83a76aadb49ae911dbe4308339966 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cluster = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] compression_format = gzip {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] compute_api_class = cinder.compute.nova.API {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] config_dir = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] config_source = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] control_exchange = openstack {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] debug = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] default_availability_zone = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] default_group_type = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] default_volume_type = QuobyteHD {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] disk_geometry = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] driver_client_cert = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] driver_client_cert_key = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] driver_data_namespace = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] driver_ssl_cert_path = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] driver_ssl_cert_verify = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] driver_use_ssl = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] enable_new_services = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] enable_unsupported_driver = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] enabled_backends = ['QuobyteHD'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] enforce_multipath_for_image_xfer = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] filter_function = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] glance_api_insecure = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] glance_api_servers = ['http://192.168.122.226/image'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] glance_api_ssl_compression = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] glance_ca_certificates_file = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] glance_catalog_info = image:glance:publicURL {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] glance_certfile = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] glance_keyfile = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] glance_num_retries = 3 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] glance_request_timeout = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] goodness_function = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] graceful_shutdown_timeout = 5 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] group_api_class = cinder.group.api.API {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] host = devstack {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] image_compress_on_upload = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] image_conversion_address_space_limit = 1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] image_conversion_cpu_limit = 60 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] image_conversion_disable = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] image_upload_use_cinder_backend = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] image_upload_use_internal_tenant = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] image_volume_cache_enabled = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] image_volume_cache_max_count = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] image_volume_cache_max_size_gb = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] init_host_max_objects_retrieval = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] instance_format = [instance: %(uuid)s] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] iscsi_target_flags = {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] iscsi_write_cache = on {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] iser_helper = tgtadm {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] iser_ip_address = 192.168.122.226 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] iser_port = 3260 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] log_color = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] log_config_append = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] log_dir = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] log_file = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] log_options = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] log_rotate_interval = 1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] log_rotate_interval_type = days {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] log_rotation_type = none {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] max_age = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] max_logfile_count = 30 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] max_logfile_size_mb = 200 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] max_over_subscription_ratio = 20.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] message_reap_interval = 86400 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] message_ttl = 2592000 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] migration_create_volume_timeout_secs = 300 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] monkey_patch = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] monkey_patch_modules = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] my_ip = 192.168.122.226 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] no_snapshot_gb_quota = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] num_iser_scan_tries = 3 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] num_shell_tries = 3 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] num_volume_device_scan_tries = 3 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] nvmeof_conn_info_version = 1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] nvmet_ns_id = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] nvmet_port_id = 1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] osapi_max_limit = 1000 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] osapi_volume_ext_list = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] osapi_volume_listen = 0.0.0.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] osapi_volume_listen_port = 8776 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] osapi_volume_use_ssl = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] osapi_volume_workers = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] per_volume_size_limit = -1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] periodic_fuzzy_delay = 60 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] periodic_interval = 60 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] project_id_regex = [0-9a-f\-]+ {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] public_endpoint = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] publish_errors = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] quota_backup_gigabytes = 1000 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] quota_backups = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] quota_gigabytes = 1000 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] quota_groups = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] quota_snapshots = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] quota_volumes = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] rate_limit_burst = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] rate_limit_except_level = CRITICAL {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] rate_limit_interval = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] reinit_driver_count = 3 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] replication_device = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] report_discard_supported = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] report_interval = 120 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] reservation_clean_interval = 86400 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] reservation_expire = 86400 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] reserved_image_namespaces = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] reserved_percentage = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] rpc_response_timeout = 120 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] run_external_periodic_tasks = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] scst_target_driver = iscsi {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] scst_target_iqn_name = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] service_down_time = 720 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] shell_completion = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] snapshot_name_template = snapshot-%s {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] split_loggers = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] state_path = /opt/stack/data/cinder {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] storage_availability_zone = nova {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] storage_protocol = iSCSI {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] syslog_log_facility = LOG_USER {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] target_helper = lioadm {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] target_ip_address = 192.168.122.226 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] target_port = 3260 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] target_protocol = iscsi {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] target_secondary_ip_addresses = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] trace_flags = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] transfer_api_class = cinder.transfer.api.API {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] transport_url = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] until_refresh = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] use_chap_auth = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] use_default_quota_class = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] use_journal = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] use_json = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] use_multipath_for_image_xfer = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87582) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] use_stderr = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] use_syslog = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] verify_glance_signatures = enabled {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] volume_api_class = cinder.volume.api.API {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] volume_backend_name = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] volume_clear = zero {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] volume_clear_ionice = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] volume_clear_size = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] volume_copy_bps_limit = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] volume_dd_blocksize = 1M {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] volume_name_template = volume-%s {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] volume_service_inithost_offload = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] volume_usage_audit_period = month {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] zoning_mode = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_concurrency.disable_process_locking = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.auth_section = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.auth_type = password {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.auth_version = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.cache = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.certfile = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.delay_auth_decision = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.http_connect_timeout = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.include_service_catalog = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.insecure = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.interface = public {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.keyfile = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.memcache_password = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.memcache_username = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.region_name = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.service_token_roles_required = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.service_type = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.token_cache_time = 300 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.226/identity {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.backend = dogpile.cache.null {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.backend_argument = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.backend_expiration_time = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.config_prefix = cache.oslo {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.debug_cache_backend = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.enable_retry_client = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.enable_socket_keepalive = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.enabled = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.expiration_time = 600 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.hashclient_retry_attempts = 2 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.memcache_dead_retry = 300 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.memcache_pool_maxsize = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.memcache_sasl_enabled = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.password = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.proxies = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.redis_db = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.redis_sentinel_service_name = mymaster {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.redis_server = localhost:6379 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.retry_attempts = 2 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.retry_delay = 0.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.socket_keepalive_count = 1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.socket_keepalive_idle = 1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.socket_keepalive_interval = 1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.socket_timeout = 1.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.tls_allowed_ciphers = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.tls_cafile = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.tls_certfile = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.tls_enabled = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.tls_keyfile = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cache.username = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] coordination.backend_url = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] database.asyncio_connection = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] database.asyncio_slave_connection = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] database.backend = sqlalchemy {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] database.connection = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] database.connection_debug = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] database.connection_parameters = {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] database.connection_recycle_time = 3600 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] database.connection_trace = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] database.db_inc_retry_interval = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] database.db_max_retries = 20 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] database.db_max_retry_interval = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] database.db_retry_interval = 1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] database.max_overflow = 50 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] database.max_pool_size = 5 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] database.max_retries = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] database.mysql_wsrep_sync_wait = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] database.pool_timeout = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] database.retry_interval = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] database.slave_connection = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] database.sqlite_synchronous = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] database.synchronous_reader = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] database.use_db_reconnect = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_tracing.insecure = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] profiler.connection_string = messaging:// {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] profiler.enabled = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] profiler.es_doc_type = notification {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] profiler.es_scroll_size = 10000 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] profiler.es_scroll_time = 2m {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] profiler.filter_error_trace = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] profiler.hmac_keys = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] profiler.sentinel_service_name = mymaster {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] profiler.socket_timeout = 0.1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] profiler.trace_requests = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] profiler.trace_sqlalchemy = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] profiler_jaeger.process_tags = {} {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] profiler_jaeger.service_name_prefix = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] profiler_otlp.service_name_prefix = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_policy.enforce_new_defaults = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_policy.policy_default_rule = default {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_policy.policy_file = policy.yaml {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_policy.remote_timeout = 60.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] privsep_osbrick.group = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] privsep_osbrick.helper_command = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] privsep_osbrick.user = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cinder_sys_admin.group = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cinder_sys_admin.helper_command = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] cinder_sys_admin.user = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] service_user.auth_section = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] service_user.auth_type = password {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] service_user.cafile = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] service_user.certfile = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] service_user.collect_timing = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] service_user.insecure = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] service_user.keyfile = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] service_user.send_service_user_token = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] service_user.split_loggers = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] service_user.timeout = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] service_user.tls_ciphers = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] service_user.tls_min_version = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] glance.auth_section = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] glance.auth_type = password {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] glance.certfile = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] glance.collect_timing = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] glance.insecure = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] glance.keyfile = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] glance.region_name = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] glance.split_loggers = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] glance.timeout = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] glance.tls_ciphers = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] glance.tls_min_version = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.backend_availability_zone = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.chap_password = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.chap_username = {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.disk_geometry = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.driver_client_cert = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.driver_client_cert_key = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.driver_data_namespace = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.driver_use_ssl = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.enable_unsupported_driver = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.extra_capabilities = {} {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.filter_function = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.goodness_function = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.iscsi_target_flags = {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.iscsi_write_cache = on {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.iser_helper = tgtadm {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.iser_ip_address = 192.168.122.226 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.iser_port = 3260 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.nas_host = {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.nas_login = admin {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.nas_mount_options = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.nas_password = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.nas_private_key = {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.nas_share_path = {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.nas_ssh_port = 22 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.num_shell_tries = 3 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.nvmet_port_id = 1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.quobyte_client_cfg = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.quobyte_volume_url = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.replication_device = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.report_discard_supported = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.reserved_percentage = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.scst_target_driver = iscsi {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.scst_target_iqn_name = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.storage_protocol = iSCSI {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.target_helper = tgtadm {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.target_ip_address = 192.168.122.226 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.target_port = 3260 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.target_protocol = iscsi {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.trace_flags = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.unique_fqdn_network = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.use_chap_auth = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.volume_backend_name = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.volume_clear = zero {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.volume_clear_ionice = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.volume_clear_size = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_reports.file_event_handler = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_reports.log_dir = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.backend_availability_zone = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.backend_host = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.chap_password = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.chap_username = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.chiscsi_conf = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.disk_geometry = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.driver_client_cert = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.driver_client_cert_key = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.driver_data_namespace = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.driver_use_ssl = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.extra_capabilities = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.filter_function = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.goodness_function = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.iscsi_target_flags = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.iscsi_write_cache = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.iser_helper = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.iser_ip_address = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.iser_port = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.iser_target_prefix = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.nas_host = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.nas_login = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.nas_mount_options = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.nas_password = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.nas_private_key = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.nas_share_path = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.nas_ssh_port = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.num_shell_tries = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.nvmet_ns_id = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.nvmet_port_id = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87582) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.replication_device = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.report_discard_supported = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.reserved_percentage = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.scst_target_driver = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.storage_protocol = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.target_helper = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.target_ip_address = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.target_port = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.target_prefix = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.target_protocol = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.trace_flags = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.unique_fqdn_network = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.use_chap_auth = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.quobyte [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.quobyte [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.volume_clear = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.volume_clear_ionice = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.volume_clear_size = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] QuobyteHD.volumes_dir = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] Running cmd (subprocess): mount.quobyte {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.ssl = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.ssl_version = {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_notifications.driver = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_notifications.retry = -1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] oslo_messaging_notifications.transport_url = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] key_manager.fixed_key = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] barbican.barbican_api_version = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] barbican.barbican_endpoint = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] barbican.barbican_endpoint_type = public {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] barbican.barbican_region_name = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] barbican.cafile = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] barbican.certfile = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] barbican.collect_timing = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] barbican.insecure = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] barbican.keyfile = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] barbican.number_of_retries = 60 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] barbican.retry_delay = 1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] barbican.send_service_user_token = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] barbican.split_loggers = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] barbican.timeout = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] barbican.tls_ciphers = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] barbican.tls_min_version = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] barbican.verify_ssl = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] barbican.verify_ssl_path = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] barbican_service_user.auth_section = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] barbican_service_user.auth_type = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] barbican_service_user.cafile = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] barbican_service_user.certfile = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] barbican_service_user.collect_timing = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] barbican_service_user.insecure = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] barbican_service_user.keyfile = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] barbican_service_user.split_loggers = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] barbican_service_user.timeout = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] barbican_service_user.tls_ciphers = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] barbican_service_user.tls_min_version = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] vault.approle_role_id = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] vault.approle_secret_id = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] vault.auth_method = approle {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] vault.auth_path = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] vault.kv_mountpoint = secret {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] vault.kv_path = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] vault.kv_version = 2 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] vault.namespace = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] vault.root_token_id = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] vault.ssl_ca_crt_file = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] vault.timeout = 60.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] vault.token_file = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] vault.token_role = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] vault.use_ssl = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:22 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] ******************************************************************************** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 10 16:37:22 devstack quobyte-client[87587]: Reading configuration file: /etc/quobyte/client.cfg Sep 10 16:37:22 devstack quobyte-client[87587]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 10 16:37:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] CMD "mount.quobyte" returned: 1 in 0.100s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:37:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:37:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:37:22 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:37:22 devstack cinder-volume[87582]: INFO cinder.volume.drivers.quobyte [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 ... Sep 10 16:37:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 -c /etc/quobyte/client-cinder.cfg {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:37:22 devstack sudo[87594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 -c /etc/quobyte/client-cinder.cfg Sep 10 16:37:22 devstack sudo[87594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:37:22 devstack sudo[87594]: pam_unix(sudo:session): session closed for user root Sep 10 16:37:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.400s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:37:22 devstack cinder-volume[87582]: INFO cinder.volume.drivers.quobyte [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 succeeded Sep 10 16:37:22 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:37:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.412s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:37:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:37:22 devstack sudo[87663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:37:22 devstack sudo[87663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:37:23 devstack sudo[87663]: pam_unix(sudo:session): session closed for user root Sep 10 16:37:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.261s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:37:23 devstack cinder-volume[87582]: INFO cinder.volume.driver [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] Driver hasn't implemented _init_vendor_properties() Sep 10 16:37:23 devstack cinder-volume[87582]: DEBUG cinder.volume.driver [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1032371520996, 'free_capacity_gb': 1773.1032371520996, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87582) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 10 16:37:23 devstack cinder-volume[87582]: DEBUG oslo_db.sqlalchemy.engines [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87582) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 16:37:23 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writer thread running {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 10 16:37:23 devstack cinder-volume[87582]: DEBUG cinder.db.api [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] Building query based on filter {{(pid=87582) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 10 16:37:23 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87582) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 10 16:37:23 devstack cinder-volume[87582]: INFO cinder.keymgr.migration [None req-85812cb9-2230-4e1a-bc57-334ebd2c510a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 10 16:37:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:37:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:37:23 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:37:23 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:37:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:37:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:37:23 devstack sudo[87666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:37:23 devstack sudo[87666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:37:23 devstack sudo[87666]: pam_unix(sudo:session): session closed for user root Sep 10 16:37:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.249s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:37:23 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:37:23 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] Driver initialization completed successfully. Sep 10 16:37:23 devstack cinder-volume[87582]: INFO cinder.manager [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] Initiating service 3 cleanup Sep 10 16:37:23 devstack cinder-volume[87582]: INFO cinder.manager [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] Service 3 cleanup completed. Sep 10 16:37:23 devstack cinder-volume[87582]: DEBUG cinder.service [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] Creating RPC server for service cinder-volume {{(pid=87582) start /opt/stack/cinder/cinder/service.py:231}} Sep 10 16:37:23 devstack cinder-volume[87582]: DEBUG cinder.service [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87582) start /opt/stack/cinder/cinder/service.py:237}} Sep 10 16:37:23 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 10 16:37:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:37:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:37:23 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:37:23 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:37:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:37:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:37:23 devstack sudo[87669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:37:23 devstack sudo[87669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:37:24 devstack sudo[87669]: pam_unix(sudo:session): session closed for user root Sep 10 16:37:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.273s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:37:24 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-37daacd8-cdbb-4fbb-b4ee-6e3838bcc204 None None] Driver post RPC initialization completed successfully. Sep 10 16:37:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-05ee50d6-b2e6-4e9e-b9b4-1d407e8e8d73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:37:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-05ee50d6-b2e6-4e9e-b9b4-1d407e8e8d73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:37:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-05ee50d6-b2e6-4e9e-b9b4-1d407e8e8d73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:37:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-05ee50d6-b2e6-4e9e-b9b4-1d407e8e8d73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:37:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-05ee50d6-b2e6-4e9e-b9b4-1d407e8e8d73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:37:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-05ee50d6-b2e6-4e9e-b9b4-1d407e8e8d73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:37:29 devstack sudo[87789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:37:29 devstack sudo[87789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:37:29 devstack sudo[87789]: pam_unix(sudo:session): session closed for user root Sep 10 16:37:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-05ee50d6-b2e6-4e9e-b9b4-1d407e8e8d73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.248s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:37:29 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-05ee50d6-b2e6-4e9e-b9b4-1d407e8e8d73 None None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:37:32 devstack cinder-volume[87365]: DEBUG dbcounter [-] [87365] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=87365) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:37:32 devstack cinder-volume[87365]: INFO oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] Caught SIGTERM, stopping children Sep 10 16:37:32 devstack cinder-volume[87365]: DEBUG oslo_concurrency.lockutils [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] Acquiring lock "singleton_lock" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 10 16:37:32 devstack cinder-volume[87365]: DEBUG oslo_concurrency.lockutils [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] Acquired lock "singleton_lock" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 10 16:37:32 devstack cinder-volume[87365]: DEBUG oslo_concurrency.lockutils [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] Releasing lock "singleton_lock" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 10 16:37:32 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] Stop services. {{(pid=87365) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 10 16:37:32 devstack cinder-volume[87365]: DEBUG oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] Killing children. {{(pid=87365) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 10 16:37:32 devstack cinder-volume[87365]: INFO oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] Waiting on 1 children to exit Sep 10 16:37:33 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=2 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:37:34 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:37:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] Acquiring lock "singleton_lock" {{(pid=87582) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 10 16:37:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] Acquired lock "singleton_lock" {{(pid=87582) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 10 16:37:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] Releasing lock "singleton_lock" {{(pid=87582) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 10 16:37:37 devstack cinder-volume[87582]: WARNING amqp [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 10 16:37:37 devstack cinder-volume[87582]: WARNING amqp [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 10 16:37:37 devstack cinder-volume[87365]: INFO oslo_service.backend._eventlet.service [None req-13f0b015-ba5e-49e7-a6dd-0cb416157a6d None None] Child 87582 exited with status 0 Sep 10 16:37:37 devstack cinder-volume[87874]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 10 16:37:37 devstack cinder-volume[87874]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 10 16:37:37 devstack cinder-volume[87874]: we strongly recommend against using it for new projects. Sep 10 16:37:37 devstack cinder-volume[87874]: If you are already using Eventlet, we recommend migrating to a different Sep 10 16:37:37 devstack cinder-volume[87874]: framework. For more detail see Sep 10 16:37:37 devstack cinder-volume[87874]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 10 16:37:37 devstack cinder-volume[87874]: import eventlet # noqa Sep 10 16:37:40 devstack cinder-volume[87874]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87874) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 10 16:37:40 devstack cinder-volume[87874]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87874) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 10 16:37:40 devstack cinder-volume[87874]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87874) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 10 16:37:41 devstack cinder-volume[87874]: INFO dbcounter [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] Registered counter for database cinder Sep 10 16:37:41 devstack cinder-volume[87874]: DEBUG oslo_db.sqlalchemy.engines [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87874) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 16:37:41 devstack cinder-volume[87874]: DEBUG dbcounter [-] [87874] Writer thread running {{(pid=87874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 10 16:37:41 devstack cinder-volume[87874]: INFO cinder.rpc [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 10 16:37:41 devstack cinder-volume[87874]: INFO cinder.rpc [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 10 16:37:41 devstack cinder-volume[87874]: DEBUG oslo_db.sqlalchemy.engines [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87874) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 16:37:42 devstack cinder-volume[87874]: INFO cinder.volume.manager [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] Determined volume DB was empty at startup. Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG cinder.volume.manager [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87874) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 10 16:37:42 devstack cinder-volume[87874]: WARNING stevedore.named [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 10 16:37:42 devstack cinder-volume[87874]: WARNING castellan.key_manager [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 16:37:42 devstack cinder-volume[87874]: WARNING cinder.keymgr.conf_key_mgr [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 16:37:42 devstack cinder-volume[87874]: INFO cinder.volume.manager [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_db.sqlalchemy.engines [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87874) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 16:37:42 devstack cinder-volume[87874]: INFO oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] Starting 1 workers Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] Started child 88189 {{(pid=87874) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] Full set of CONF: {{(pid=87874) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] ******************************************************************************** {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] Configuration options gathered from: {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] ================================================================================ {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 10 16:37:42 devstack cinder-volume[88189]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] allow_availability_zone_fallback = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] allow_compression_on_image_upload = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] allowed_direct_url_schemes = [] {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] api_rate_limit = True {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] auth_strategy = keystone {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_availability_zone = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_host = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_name = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_stats_polling_interval = 60 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backup_api_class = cinder.backup.api.API {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backup_name_template = backup-%s {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backup_use_same_host = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backup_use_temp_snapshot = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] chap_password = **** {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] chap_username = {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cinder_internal_tenant_project_id = e944d22dbd9e46b6afd8b7d96200eab7 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cinder_internal_tenant_user_id = bcc83a76aadb49ae911dbe4308339966 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cluster = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] compression_format = gzip {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] compute_api_class = cinder.compute.nova.API {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] config_dir = [] {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] config_source = [] {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] control_exchange = openstack {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] debug = True {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] default_availability_zone = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] default_group_type = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] default_volume_type = QuobyteHD {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] disk_geometry = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] driver_client_cert = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] driver_client_cert_key = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] driver_data_namespace = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] driver_ssl_cert_path = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] driver_ssl_cert_verify = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] driver_use_ssl = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] enable_new_services = True {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] enable_unsupported_driver = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] enabled_backends = ['QuobyteHD'] {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] enforce_multipath_for_image_xfer = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] filter_function = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] glance_api_insecure = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] glance_api_servers = ['http://192.168.122.226/image'] {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] glance_api_ssl_compression = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] glance_ca_certificates_file = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] glance_catalog_info = image:glance:publicURL {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] glance_certfile = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] glance_keyfile = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] glance_num_retries = 3 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] glance_request_timeout = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] goodness_function = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] graceful_shutdown_timeout = 5 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] group_api_class = cinder.group.api.API {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] host = devstack {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] image_compress_on_upload = True {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] image_conversion_address_space_limit = 1 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] image_conversion_cpu_limit = 60 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] image_conversion_disable = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] image_upload_use_cinder_backend = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] image_upload_use_internal_tenant = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] image_volume_cache_enabled = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] image_volume_cache_max_count = 0 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] image_volume_cache_max_size_gb = 0 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] init_host_max_objects_retrieval = 0 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] instance_format = [instance: %(uuid)s] {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] iscsi_target_flags = {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] iscsi_write_cache = on {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] iser_helper = tgtadm {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] iser_ip_address = 192.168.122.226 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] iser_port = 3260 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] log_color = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] log_config_append = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] log_dir = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] log_file = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] log_options = True {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88189) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] log_rotate_interval = 1 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] log_rotate_interval_type = days {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] log_rotation_type = none {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] max_age = 0 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] max_logfile_count = 30 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] max_logfile_size_mb = 200 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] max_over_subscription_ratio = 20.0 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] message_reap_interval = 86400 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] message_ttl = 2592000 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] migration_create_volume_timeout_secs = 300 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] monkey_patch = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] monkey_patch_modules = [] {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] my_ip = 192.168.122.226 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] no_snapshot_gb_quota = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] num_iser_scan_tries = 3 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] num_shell_tries = 3 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] num_volume_device_scan_tries = 3 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] nvmeof_conn_info_version = 1 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] nvmet_ns_id = 10 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] nvmet_port_id = 1 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] osapi_max_limit = 1000 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] osapi_volume_ext_list = [] {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] osapi_volume_listen = 0.0.0.0 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] osapi_volume_listen_port = 8776 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] osapi_volume_use_ssl = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] osapi_volume_workers = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] per_volume_size_limit = -1 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] periodic_fuzzy_delay = 60 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] periodic_interval = 60 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] project_id_regex = [0-9a-f\-]+ {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] public_endpoint = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] publish_errors = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] quota_backup_gigabytes = 1000 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] quota_backups = 10 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] quota_gigabytes = 1000 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] quota_groups = 10 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] quota_snapshots = 10 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] quota_volumes = 10 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] rate_limit_burst = 0 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] rate_limit_except_level = CRITICAL {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] rate_limit_interval = 0 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] reinit_driver_count = 3 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] replication_device = **** {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] report_discard_supported = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] report_interval = 120 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] reservation_clean_interval = 86400 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] reservation_expire = 86400 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] reserved_image_namespaces = [] {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] reserved_percentage = 0 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] rpc_response_timeout = 120 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] run_external_periodic_tasks = True {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] scst_target_driver = iscsi {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] scst_target_iqn_name = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] service_down_time = 720 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] shell_completion = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] snapshot_name_template = snapshot-%s {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] split_loggers = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] state_path = /opt/stack/data/cinder {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] storage_availability_zone = nova {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] storage_protocol = iSCSI {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] syslog_log_facility = LOG_USER {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] target_helper = lioadm {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] target_ip_address = 192.168.122.226 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] target_port = 3260 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] target_protocol = iscsi {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] target_secondary_ip_addresses = [] {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] trace_flags = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] transfer_api_class = cinder.transfer.api.API {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] transport_url = **** {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] until_refresh = 0 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] use_chap_auth = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] use_default_quota_class = True {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] use_journal = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] use_json = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] use_multipath_for_image_xfer = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] use_stderr = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] use_syslog = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] verify_glance_signatures = enabled {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] volume_api_class = cinder.volume.api.API {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] volume_backend_name = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] volume_clear = zero {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] volume_clear_ionice = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] volume_clear_size = 0 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] volume_copy_bps_limit = 0 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] volume_dd_blocksize = 1M {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] volume_name_template = volume-%s {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] volume_service_inithost_offload = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] volume_usage_audit_period = month {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] zoning_mode = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_concurrency.disable_process_locking = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.auth_section = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.auth_type = password {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.auth_version = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.cache = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.certfile = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.delay_auth_decision = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.http_connect_timeout = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.include_service_catalog = True {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.insecure = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.interface = public {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.keyfile = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.memcache_password = **** {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.memcache_username = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.region_name = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.service_token_roles_required = True {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.service_type = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.token_cache_time = 300 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.226/identity {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.backend = dogpile.cache.null {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.backend_argument = **** {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.backend_expiration_time = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.config_prefix = cache.oslo {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.debug_cache_backend = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.enable_retry_client = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.enable_socket_keepalive = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.enabled = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.expiration_time = 600 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88189) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.hashclient_retry_attempts = 2 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.quobyte [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 10 16:37:42 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.quobyte [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.memcache_dead_retry = 300 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.memcache_pool_maxsize = 10 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.memcache_sasl_enabled = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.password = **** {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.proxies = [] {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.redis_db = 0 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.redis_sentinel_service_name = mymaster {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.redis_server = localhost:6379 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.retry_attempts = 2 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.retry_delay = 0.0 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.socket_keepalive_count = 1 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.socket_keepalive_idle = 1 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] Running cmd (subprocess): mount.quobyte {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.socket_keepalive_interval = 1 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.socket_timeout = 1.0 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.tls_allowed_ciphers = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.tls_cafile = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.tls_certfile = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.tls_enabled = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.tls_keyfile = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cache.username = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] coordination.backend_url = **** {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] database.asyncio_connection = **** {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] database.asyncio_slave_connection = **** {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] database.backend = sqlalchemy {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] database.connection = **** {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] database.connection_debug = 0 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] database.connection_parameters = {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] database.connection_recycle_time = 3600 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] database.connection_trace = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] database.db_inc_retry_interval = True {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] database.db_max_retries = 20 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] database.db_max_retry_interval = 10 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] database.db_retry_interval = 1 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] database.max_overflow = 50 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] database.max_pool_size = 5 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] database.max_retries = 10 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] database.mysql_wsrep_sync_wait = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] database.pool_timeout = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] database.retry_interval = 10 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] database.slave_connection = **** {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] database.sqlite_synchronous = True {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] database.synchronous_reader = True {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] database.use_db_reconnect = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_tracing.insecure = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] profiler.connection_string = messaging:// {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] profiler.enabled = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] profiler.es_doc_type = notification {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] profiler.es_scroll_size = 10000 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] profiler.es_scroll_time = 2m {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] profiler.filter_error_trace = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] profiler.hmac_keys = **** {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] profiler.sentinel_service_name = mymaster {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] profiler.socket_timeout = 0.1 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] profiler.trace_requests = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] profiler.trace_sqlalchemy = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] profiler_jaeger.process_tags = {} {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] profiler_jaeger.service_name_prefix = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] profiler_otlp.service_name_prefix = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_policy.enforce_new_defaults = True {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_policy.policy_default_rule = default {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_policy.policy_file = policy.yaml {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_policy.remote_timeout = 60.0 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] privsep_osbrick.group = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] privsep_osbrick.helper_command = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] privsep_osbrick.user = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cinder_sys_admin.group = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cinder_sys_admin.helper_command = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] cinder_sys_admin.user = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] service_user.auth_section = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] service_user.auth_type = password {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] service_user.cafile = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] service_user.certfile = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] service_user.collect_timing = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] service_user.insecure = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] service_user.keyfile = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] service_user.send_service_user_token = True {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] service_user.split_loggers = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] service_user.timeout = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] service_user.tls_ciphers = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] service_user.tls_min_version = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] glance.auth_section = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] glance.auth_type = password {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] glance.certfile = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] glance.collect_timing = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] glance.insecure = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] glance.keyfile = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] glance.region_name = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] glance.split_loggers = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] glance.timeout = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack quobyte-client[88190]: Reading configuration file: /etc/quobyte/client.cfg Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] glance.tls_ciphers = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] glance.tls_min_version = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.backend_availability_zone = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.chap_password = **** {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.chap_username = {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack quobyte-client[88190]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.disk_geometry = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.driver_client_cert = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.driver_client_cert_key = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.driver_data_namespace = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.driver_use_ssl = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.enable_unsupported_driver = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.extra_capabilities = {} {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.filter_function = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.goodness_function = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.iscsi_target_flags = {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.iscsi_write_cache = on {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.iser_helper = tgtadm {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.iser_ip_address = 192.168.122.226 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.iser_port = 3260 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.nas_host = {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.nas_login = admin {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.nas_mount_options = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.nas_password = **** {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.nas_private_key = {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.nas_share_path = {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.nas_ssh_port = 22 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.num_shell_tries = 3 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.nvmet_port_id = 1 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.quobyte_client_cfg = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.quobyte_volume_url = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.replication_device = **** {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.report_discard_supported = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.reserved_percentage = 0 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.scst_target_driver = iscsi {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.scst_target_iqn_name = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.storage_protocol = iSCSI {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.target_helper = tgtadm {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.target_ip_address = 192.168.122.226 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.target_port = 3260 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.target_protocol = iscsi {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.trace_flags = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.unique_fqdn_network = True {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.use_chap_auth = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.volume_backend_name = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.volume_clear = zero {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.volume_clear_ionice = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.volume_clear_size = 0 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] CMD "mount.quobyte" returned: 1 in 0.084s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_reports.file_event_handler = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_reports.log_dir = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:37:42 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.backend_availability_zone = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.backend_host = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.chap_password = **** {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.chap_username = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.chiscsi_conf = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.disk_geometry = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.driver_client_cert = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.driver_client_cert_key = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.driver_data_namespace = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.driver_use_ssl = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.extra_capabilities = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.filter_function = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.goodness_function = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:37:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:37:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.iscsi_target_flags = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.iscsi_write_cache = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.iser_helper = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.iser_ip_address = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.iser_port = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.iser_target_prefix = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.nas_host = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.nas_login = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.nas_mount_options = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.nas_password = **** {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.nas_private_key = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.nas_share_path = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.nas_ssh_port = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.num_shell_tries = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.nvmet_ns_id = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.nvmet_port_id = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.replication_device = **** {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.report_discard_supported = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.reserved_percentage = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.scst_target_driver = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.storage_protocol = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.target_helper = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.target_ip_address = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.target_port = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.target_prefix = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.target_protocol = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.trace_flags = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.unique_fqdn_network = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.use_chap_auth = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.volume_clear = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.volume_clear_ionice = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.volume_clear_size = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] QuobyteHD.volumes_dir = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack sudo[88191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack sudo[88191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.ssl = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.ssl_version = {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_notifications.driver = [] {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_notifications.retry = -1 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] oslo_messaging_notifications.transport_url = **** {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] key_manager.fixed_key = **** {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] barbican.barbican_api_version = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] barbican.barbican_endpoint = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] barbican.barbican_endpoint_type = public {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] barbican.barbican_region_name = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] barbican.cafile = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] barbican.certfile = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] barbican.collect_timing = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] barbican.insecure = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] barbican.keyfile = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] barbican.number_of_retries = 60 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] barbican.retry_delay = 1 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] barbican.send_service_user_token = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] barbican.split_loggers = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] barbican.timeout = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] barbican.tls_ciphers = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] barbican.tls_min_version = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] barbican.verify_ssl = True {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] barbican.verify_ssl_path = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] barbican_service_user.auth_section = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] barbican_service_user.auth_type = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] barbican_service_user.cafile = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] barbican_service_user.certfile = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] barbican_service_user.collect_timing = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] barbican_service_user.insecure = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] barbican_service_user.keyfile = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] barbican_service_user.split_loggers = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] barbican_service_user.timeout = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] barbican_service_user.tls_ciphers = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] barbican_service_user.tls_min_version = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] vault.approle_role_id = **** {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] vault.approle_secret_id = **** {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] vault.auth_method = approle {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] vault.auth_path = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] vault.kv_mountpoint = secret {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] vault.kv_path = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] vault.kv_version = 2 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] vault.namespace = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] vault.root_token_id = **** {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] vault.ssl_ca_crt_file = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] vault.timeout = 60.0 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] vault.token_file = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] vault.token_role = None {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] vault.use_ssl = False {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 16:37:42 devstack cinder-volume[87874]: DEBUG oslo_service.backend._eventlet.service [None req-58a1aa4a-10c8-4ec1-9740-501e75477b6d None None] ******************************************************************************** {{(pid=87874) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 10 16:37:42 devstack sudo[88191]: pam_unix(sudo:session): session closed for user root Sep 10 16:37:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.242s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:37:42 devstack cinder-volume[88189]: INFO cinder.volume.driver [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] Driver hasn't implemented _init_vendor_properties() Sep 10 16:37:42 devstack cinder-volume[88189]: DEBUG cinder.volume.driver [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1032371520996, 'free_capacity_gb': 1773.1032371520996, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88189) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 10 16:37:42 devstack cinder-volume[88189]: DEBUG oslo_db.sqlalchemy.engines [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88189) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 16:37:42 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writer thread running {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 10 16:37:42 devstack cinder-volume[88189]: DEBUG cinder.db.api [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] Building query based on filter {{(pid=88189) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 10 16:37:42 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88189) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 10 16:37:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:37:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:37:42 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:37:42 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:37:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:37:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:37:42 devstack cinder-volume[88189]: INFO cinder.keymgr.migration [None req-8e1734f0-b87e-47a5-b5c5-2f6f4a76bc1b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 10 16:37:42 devstack sudo[88203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:37:42 devstack sudo[88203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:37:43 devstack sudo[88203]: pam_unix(sudo:session): session closed for user root Sep 10 16:37:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.262s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:37:43 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:37:43 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] Driver initialization completed successfully. Sep 10 16:37:43 devstack cinder-volume[88189]: INFO cinder.manager [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] Initiating service 3 cleanup Sep 10 16:37:43 devstack cinder-volume[88189]: INFO cinder.manager [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] Service 3 cleanup completed. Sep 10 16:37:43 devstack cinder-volume[88189]: DEBUG cinder.service [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] Creating RPC server for service cinder-volume {{(pid=88189) start /opt/stack/cinder/cinder/service.py:231}} Sep 10 16:37:43 devstack cinder-volume[88189]: DEBUG cinder.service [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88189) start /opt/stack/cinder/cinder/service.py:237}} Sep 10 16:37:43 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 10 16:37:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:37:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:37:43 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:37:43 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:37:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:37:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:37:43 devstack sudo[88242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:37:43 devstack sudo[88242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:37:43 devstack sudo[88242]: pam_unix(sudo:session): session closed for user root Sep 10 16:37:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.273s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:37:43 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-3e42938b-0570-4e4e-8c2c-708ff7b9ccf5 None None] Driver post RPC initialization completed successfully. Sep 10 16:37:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager._thread_info {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:37:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread count: 6 {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 16:37:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread info: [<_MainThread(MainThread, started 125792070905984)>, , , , , ] {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 16:37:52 devstack cinder-volume[87874]: DEBUG dbcounter [-] [87874] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:37:53 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:37:53 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=3 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:38:43 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-51a752ec-f474-4529-b0af-4460cd62c070 tempest-TaggedAttachmentsTest-200350805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:38:43 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-51a752ec-f474-4529-b0af-4460cd62c070 tempest-TaggedAttachmentsTest-200350805 None] Flow 'volume_create_manager' (87be1297-0501-4a9e-a302-79e725c5e264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:38:43 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-51a752ec-f474-4529-b0af-4460cd62c070 tempest-TaggedAttachmentsTest-200350805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43a55b2b-5a17-4da6-a376-d37176c17be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:38:43 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-51a752ec-f474-4529-b0af-4460cd62c070 tempest-TaggedAttachmentsTest-200350805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43a55b2b-5a17-4da6-a376-d37176c17be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1678892410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2789cd33-70ce-4002-afdf-05d0bc616765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aa510a3a9cc44d6949f6e5a66bf5c2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:38:44Z,use_quota=True,user_id='6d79d0c3c8384dae990c3a3f429c6c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:38:43 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-51a752ec-f474-4529-b0af-4460cd62c070 tempest-TaggedAttachmentsTest-200350805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4940f2fe-160e-4cdd-b5b2-ae56fa91ad91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:38:43 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-51a752ec-f474-4529-b0af-4460cd62c070 tempest-TaggedAttachmentsTest-200350805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4940f2fe-160e-4cdd-b5b2-ae56fa91ad91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:38:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-51a752ec-f474-4529-b0af-4460cd62c070 tempest-TaggedAttachmentsTest-200350805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b14a254-ee26-49c5-8fc3-706a30c96ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:38:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-51a752ec-f474-4529-b0af-4460cd62c070 tempest-TaggedAttachmentsTest-200350805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b14a254-ee26-49c5-8fc3-706a30c96ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2789cd33-70ce-4002-afdf-05d0bc616765', 'volume_name': 'volume-2789cd33-70ce-4002-afdf-05d0bc616765', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:38:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-51a752ec-f474-4529-b0af-4460cd62c070 tempest-TaggedAttachmentsTest-200350805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6275d852-eb1a-4e17-98a7-18e8a161578c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:38:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-51a752ec-f474-4529-b0af-4460cd62c070 tempest-TaggedAttachmentsTest-200350805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6275d852-eb1a-4e17-98a7-18e8a161578c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:38:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-51a752ec-f474-4529-b0af-4460cd62c070 tempest-TaggedAttachmentsTest-200350805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfedaec4-d611-4be6-bd83-bab5b90ad688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:38:44 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-51a752ec-f474-4529-b0af-4460cd62c070 tempest-TaggedAttachmentsTest-200350805 None] Volume 2789cd33-70ce-4002-afdf-05d0bc616765: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2789cd33-70ce-4002-afdf-05d0bc616765', 'volume_size': 1} Sep 10 16:38:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-51a752ec-f474-4529-b0af-4460cd62c070 tempest-TaggedAttachmentsTest-200350805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:38:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-51a752ec-f474-4529-b0af-4460cd62c070 tempest-TaggedAttachmentsTest-200350805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:38:44 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-51a752ec-f474-4529-b0af-4460cd62c070 tempest-TaggedAttachmentsTest-200350805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1678892410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2789cd33-70ce-4002-afdf-05d0bc616765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aa510a3a9cc44d6949f6e5a66bf5c2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:38:44Z,use_quota=True,user_id='6d79d0c3c8384dae990c3a3f429c6c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:38:44 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-51a752ec-f474-4529-b0af-4460cd62c070 tempest-TaggedAttachmentsTest-200350805 None] Creating volume 2789cd33-70ce-4002-afdf-05d0bc616765 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:38:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-51a752ec-f474-4529-b0af-4460cd62c070 tempest-TaggedAttachmentsTest-200350805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:38:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-51a752ec-f474-4529-b0af-4460cd62c070 tempest-TaggedAttachmentsTest-200350805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:38:44 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-51a752ec-f474-4529-b0af-4460cd62c070 tempest-TaggedAttachmentsTest-200350805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:38:44 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-51a752ec-f474-4529-b0af-4460cd62c070 tempest-TaggedAttachmentsTest-200350805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:38:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-51a752ec-f474-4529-b0af-4460cd62c070 tempest-TaggedAttachmentsTest-200350805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:38:44 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-51a752ec-f474-4529-b0af-4460cd62c070 tempest-TaggedAttachmentsTest-200350805 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:38:44 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-51a752ec-f474-4529-b0af-4460cd62c070 tempest-TaggedAttachmentsTest-200350805 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:38:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-51a752ec-f474-4529-b0af-4460cd62c070 tempest-TaggedAttachmentsTest-200350805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2789cd33-70ce-4002-afdf-05d0bc616765 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:38:44 devstack sudo[88606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2789cd33-70ce-4002-afdf-05d0bc616765 1073741824 Sep 10 16:38:44 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:38:44 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root Sep 10 16:38:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-51a752ec-f474-4529-b0af-4460cd62c070 tempest-TaggedAttachmentsTest-200350805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2789cd33-70ce-4002-afdf-05d0bc616765 1073741824" returned: 0 in 0.733s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:38:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-51a752ec-f474-4529-b0af-4460cd62c070 tempest-TaggedAttachmentsTest-200350805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2789cd33-70ce-4002-afdf-05d0bc616765 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:38:44 devstack sudo[88935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2789cd33-70ce-4002-afdf-05d0bc616765 Sep 10 16:38:44 devstack sudo[88935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:38:45 devstack sudo[88935]: pam_unix(sudo:session): session closed for user root Sep 10 16:38:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-51a752ec-f474-4529-b0af-4460cd62c070 tempest-TaggedAttachmentsTest-200350805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2789cd33-70ce-4002-afdf-05d0bc616765" returned: 0 in 0.340s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:38:45 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-51a752ec-f474-4529-b0af-4460cd62c070 tempest-TaggedAttachmentsTest-200350805 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:38:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-51a752ec-f474-4529-b0af-4460cd62c070 tempest-TaggedAttachmentsTest-200350805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:38:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-51a752ec-f474-4529-b0af-4460cd62c070 tempest-TaggedAttachmentsTest-200350805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfedaec4-d611-4be6-bd83-bab5b90ad688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2789cd33-70ce-4002-afdf-05d0bc616765', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:38:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-51a752ec-f474-4529-b0af-4460cd62c070 tempest-TaggedAttachmentsTest-200350805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed4c744-2c2f-47d4-90f3-b7e06c0cbab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:38:45 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-51a752ec-f474-4529-b0af-4460cd62c070 tempest-TaggedAttachmentsTest-200350805 None] Volume volume-2789cd33-70ce-4002-afdf-05d0bc616765 (2789cd33-70ce-4002-afdf-05d0bc616765): created successfully Sep 10 16:38:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-51a752ec-f474-4529-b0af-4460cd62c070 tempest-TaggedAttachmentsTest-200350805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed4c744-2c2f-47d4-90f3-b7e06c0cbab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:38:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-51a752ec-f474-4529-b0af-4460cd62c070 tempest-TaggedAttachmentsTest-200350805 None] Flow 'volume_create_manager' (87be1297-0501-4a9e-a302-79e725c5e264) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:38:45 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-51a752ec-f474-4529-b0af-4460cd62c070 tempest-TaggedAttachmentsTest-200350805 None] Created volume successfully. Sep 10 16:38:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:38:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:38:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:38:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:38:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:38:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:38:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:38:49 devstack sudo[88963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:38:49 devstack sudo[88963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:38:49 devstack sudo[88963]: pam_unix(sudo:session): session closed for user root Sep 10 16:38:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.407s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:38:49 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:38:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager._thread_info {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:38:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread count: 6 {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 16:38:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread info: [<_MainThread(MainThread, started 125792070905984)>, , , , , ] {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 16:38:55 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:38:55 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:39:03 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4ac9b0e-9a08-4839-b508-643c6a3a9454 tempest-DeleteServersTestJSON-1859266749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:39:03 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c4ac9b0e-9a08-4839-b508-643c6a3a9454 tempest-DeleteServersTestJSON-1859266749 None] Flow 'volume_create_manager' (578781be-178e-463f-a981-617de521b8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:39:03 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c4ac9b0e-9a08-4839-b508-643c6a3a9454 tempest-DeleteServersTestJSON-1859266749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aacddeac-705e-4a32-9f08-5f24ec69239e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:39:03 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c4ac9b0e-9a08-4839-b508-643c6a3a9454 tempest-DeleteServersTestJSON-1859266749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aacddeac-705e-4a32-9f08-5f24ec69239e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1932822469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c31bda-5708-478f-a8e6-7a6b61a8268a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdcd39b62f814439aa2d28dd56326605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:39:03Z,use_quota=True,user_id='67f0ef580666442ea7fdafb5ad5e00cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:39:03 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c4ac9b0e-9a08-4839-b508-643c6a3a9454 tempest-DeleteServersTestJSON-1859266749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a33e508-f615-4efa-b969-02ed6a3a2507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:39:03 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c4ac9b0e-9a08-4839-b508-643c6a3a9454 tempest-DeleteServersTestJSON-1859266749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a33e508-f615-4efa-b969-02ed6a3a2507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:39:03 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c4ac9b0e-9a08-4839-b508-643c6a3a9454 tempest-DeleteServersTestJSON-1859266749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d5cbd0-6116-4a29-ba60-acdf8a1e53fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:39:03 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c4ac9b0e-9a08-4839-b508-643c6a3a9454 tempest-DeleteServersTestJSON-1859266749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d5cbd0-6116-4a29-ba60-acdf8a1e53fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24c31bda-5708-478f-a8e6-7a6b61a8268a', 'volume_name': 'volume-24c31bda-5708-478f-a8e6-7a6b61a8268a', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:39:03 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c4ac9b0e-9a08-4839-b508-643c6a3a9454 tempest-DeleteServersTestJSON-1859266749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22945711-fbc2-4db0-8753-f25ee7b8b1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:39:03 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c4ac9b0e-9a08-4839-b508-643c6a3a9454 tempest-DeleteServersTestJSON-1859266749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22945711-fbc2-4db0-8753-f25ee7b8b1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:39:03 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c4ac9b0e-9a08-4839-b508-643c6a3a9454 tempest-DeleteServersTestJSON-1859266749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35fa9f6f-de9e-4632-a8e8-68a371e10bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:39:03 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-c4ac9b0e-9a08-4839-b508-643c6a3a9454 tempest-DeleteServersTestJSON-1859266749 None] Volume 24c31bda-5708-478f-a8e6-7a6b61a8268a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24c31bda-5708-478f-a8e6-7a6b61a8268a', 'volume_size': 1} Sep 10 16:39:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c4ac9b0e-9a08-4839-b508-643c6a3a9454 tempest-DeleteServersTestJSON-1859266749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:39:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c4ac9b0e-9a08-4839-b508-643c6a3a9454 tempest-DeleteServersTestJSON-1859266749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:39:03 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c4ac9b0e-9a08-4839-b508-643c6a3a9454 tempest-DeleteServersTestJSON-1859266749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1932822469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c31bda-5708-478f-a8e6-7a6b61a8268a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdcd39b62f814439aa2d28dd56326605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:39:03Z,use_quota=True,user_id='67f0ef580666442ea7fdafb5ad5e00cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:39:03 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-c4ac9b0e-9a08-4839-b508-643c6a3a9454 tempest-DeleteServersTestJSON-1859266749 None] Creating volume 24c31bda-5708-478f-a8e6-7a6b61a8268a {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:39:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c4ac9b0e-9a08-4839-b508-643c6a3a9454 tempest-DeleteServersTestJSON-1859266749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:39:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c4ac9b0e-9a08-4839-b508-643c6a3a9454 tempest-DeleteServersTestJSON-1859266749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:39:03 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c4ac9b0e-9a08-4839-b508-643c6a3a9454 tempest-DeleteServersTestJSON-1859266749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:39:03 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c4ac9b0e-9a08-4839-b508-643c6a3a9454 tempest-DeleteServersTestJSON-1859266749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:39:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c4ac9b0e-9a08-4839-b508-643c6a3a9454 tempest-DeleteServersTestJSON-1859266749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:39:03 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c4ac9b0e-9a08-4839-b508-643c6a3a9454 tempest-DeleteServersTestJSON-1859266749 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:39:03 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-c4ac9b0e-9a08-4839-b508-643c6a3a9454 tempest-DeleteServersTestJSON-1859266749 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:39:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c4ac9b0e-9a08-4839-b508-643c6a3a9454 tempest-DeleteServersTestJSON-1859266749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-24c31bda-5708-478f-a8e6-7a6b61a8268a 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:39:03 devstack sudo[89197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-24c31bda-5708-478f-a8e6-7a6b61a8268a 1073741824 Sep 10 16:39:03 devstack sudo[89197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:39:04 devstack sudo[89197]: pam_unix(sudo:session): session closed for user root Sep 10 16:39:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c4ac9b0e-9a08-4839-b508-643c6a3a9454 tempest-DeleteServersTestJSON-1859266749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-24c31bda-5708-478f-a8e6-7a6b61a8268a 1073741824" returned: 0 in 1.185s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:39:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c4ac9b0e-9a08-4839-b508-643c6a3a9454 tempest-DeleteServersTestJSON-1859266749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-24c31bda-5708-478f-a8e6-7a6b61a8268a {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:39:04 devstack sudo[89230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-24c31bda-5708-478f-a8e6-7a6b61a8268a Sep 10 16:39:04 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:39:05 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root Sep 10 16:39:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c4ac9b0e-9a08-4839-b508-643c6a3a9454 tempest-DeleteServersTestJSON-1859266749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-24c31bda-5708-478f-a8e6-7a6b61a8268a" returned: 0 in 0.625s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:39:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c4ac9b0e-9a08-4839-b508-643c6a3a9454 tempest-DeleteServersTestJSON-1859266749 None] <== create_volume: return (1961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:39:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c4ac9b0e-9a08-4839-b508-643c6a3a9454 tempest-DeleteServersTestJSON-1859266749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.965s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:39:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c4ac9b0e-9a08-4839-b508-643c6a3a9454 tempest-DeleteServersTestJSON-1859266749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35fa9f6f-de9e-4632-a8e8-68a371e10bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24c31bda-5708-478f-a8e6-7a6b61a8268a', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:39:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c4ac9b0e-9a08-4839-b508-643c6a3a9454 tempest-DeleteServersTestJSON-1859266749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fe9dbdd-e973-426f-a67d-9542ff07ce10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:39:05 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-c4ac9b0e-9a08-4839-b508-643c6a3a9454 tempest-DeleteServersTestJSON-1859266749 None] Volume volume-24c31bda-5708-478f-a8e6-7a6b61a8268a (24c31bda-5708-478f-a8e6-7a6b61a8268a): created successfully Sep 10 16:39:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c4ac9b0e-9a08-4839-b508-643c6a3a9454 tempest-DeleteServersTestJSON-1859266749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fe9dbdd-e973-426f-a67d-9542ff07ce10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:39:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c4ac9b0e-9a08-4839-b508-643c6a3a9454 tempest-DeleteServersTestJSON-1859266749 None] Flow 'volume_create_manager' (578781be-178e-463f-a981-617de521b8e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:39:05 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-c4ac9b0e-9a08-4839-b508-643c6a3a9454 tempest-DeleteServersTestJSON-1859266749 None] Created volume successfully. Sep 10 16:39:13 devstack cinder-volume[88189]: WARNING py.warnings [req-9d56b4b0-263c-4f0d-ab9f-08813eaa437e req-3fd51d85-b890-45d4-9665-bb17b9646488 tempest-DeleteServersTestJSON-1859266749 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 10 16:39:13 devstack cinder-volume[88189]: .first() Sep 10 16:39:13 devstack cinder-volume[88189]: Sep 10 16:39:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-9d56b4b0-263c-4f0d-ab9f-08813eaa437e req-3fd51d85-b890-45d4-9665-bb17b9646488 tempest-DeleteServersTestJSON-1859266749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:39:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-9d56b4b0-263c-4f0d-ab9f-08813eaa437e req-3fd51d85-b890-45d4-9665-bb17b9646488 tempest-DeleteServersTestJSON-1859266749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:39:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-9d56b4b0-263c-4f0d-ab9f-08813eaa437e req-3fd51d85-b890-45d4-9665-bb17b9646488 tempest-DeleteServersTestJSON-1859266749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:39:13 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-9d56b4b0-263c-4f0d-ab9f-08813eaa437e req-3fd51d85-b890-45d4-9665-bb17b9646488 tempest-DeleteServersTestJSON-1859266749 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8', 'name': 'volume-24c31bda-5708-478f-a8e6-7a6b61a8268a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eeb2c680-fd1d-42b9-83ab-f379c07f4362', 'enforce_multipath': True} {{(pid=88189) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 16:39:14 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-9d56b4b0-263c-4f0d-ab9f-08813eaa437e req-3fd51d85-b890-45d4-9665-bb17b9646488 tempest-DeleteServersTestJSON-1859266749 None] attachment_update completed successfully. Sep 10 16:39:18 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-4b3fa9ad-2ffb-4462-835b-bb2834da281f req-50fe5e5e-32e7-4c54-bb04-0dccb4a3b17c tempest-DeleteServersTestJSON-1859266749 None] Terminate volume connection completed successfully. Sep 10 16:39:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-4b3fa9ad-2ffb-4462-835b-bb2834da281f req-50fe5e5e-32e7-4c54-bb04-0dccb4a3b17c tempest-DeleteServersTestJSON-1859266749 None] Deleting attachment eeb2c680-fd1d-42b9-83ab-f379c07f4362. {{(pid=88189) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 16:39:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-df977bbc-b4a3-42ff-b88f-b813f3eea949 tempest-DeleteServersTestJSON-1859266749 None] Acquiring lock "cinder-24c31bda-5708-478f-a8e6-7a6b61a8268a-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:39:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-df977bbc-b4a3-42ff-b88f-b813f3eea949 tempest-DeleteServersTestJSON-1859266749 None] Lock "cinder-24c31bda-5708-478f-a8e6-7a6b61a8268a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:39:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-df977bbc-b4a3-42ff-b88f-b813f3eea949 tempest-DeleteServersTestJSON-1859266749 None] Acquiring lock "cinder-quobyte-24c31bda-5708-478f-a8e6-7a6b61a8268a" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:39:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-df977bbc-b4a3-42ff-b88f-b813f3eea949 tempest-DeleteServersTestJSON-1859266749 None] Lock "cinder-quobyte-24c31bda-5708-478f-a8e6-7a6b61a8268a" acquired by "delete_volume" :: waited 0.028s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:39:21 devstack cinder-volume[88189]: INFO oslo.privsep.daemon [None req-df977bbc-b4a3-42ff-b88f-b813f3eea949 tempest-DeleteServersTestJSON-1859266749 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp3qj_l3_h/privsep.sock'] Sep 10 16:39:21 devstack sudo[89846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp3qj_l3_h/privsep.sock Sep 10 16:39:21 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:39:23 devstack cinder-volume[88189]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 10 16:39:23 devstack cinder-volume[88189]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 10 16:39:23 devstack cinder-volume[88189]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 10 16:39:23 devstack cinder-volume[88189]: WARNING oslo.privsep.daemon [-] privsep log: Sep 10 16:39:23 devstack cinder-volume[88189]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 10 16:39:23 devstack cinder-volume[88189]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 10 16:39:23 devstack cinder-volume[88189]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 10 16:39:23 devstack cinder-volume[88189]: WARNING oslo.privsep.daemon [-] privsep log: Sep 10 16:39:23 devstack cinder-volume[88189]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 10 16:39:23 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root Sep 10 16:39:23 devstack cinder-volume[88189]: INFO oslo.privsep.daemon [None req-df977bbc-b4a3-42ff-b88f-b813f3eea949 tempest-DeleteServersTestJSON-1859266749 None] Spawned new privsep daemon via rootwrap Sep 10 16:39:23 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [None req-df977bbc-b4a3-42ff-b88f-b813f3eea949 tempest-DeleteServersTestJSON-1859266749 None] Accepted privsep connection to /tmp/tmp3qj_l3_h/privsep.sock {{(pid=88189) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 10 16:39:23 devstack cinder-volume[88189]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 10 16:39:23 devstack cinder-volume[88189]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 10 16:39:23 devstack cinder-volume[88189]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 10 16:39:23 devstack cinder-volume[88189]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89855 Sep 10 16:39:23 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afe81be-d196-4959-9e4a-05641c13826a]: (2,) {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:39:23 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52f1ef6-65a2-46b9-ad86-7a72012b63ba]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:39:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-df977bbc-b4a3-42ff-b88f-b813f3eea949 tempest-DeleteServersTestJSON-1859266749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-24c31bda-5708-478f-a8e6-7a6b61a8268a {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:39:23 devstack sudo[89857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-24c31bda-5708-478f-a8e6-7a6b61a8268a Sep 10 16:39:23 devstack sudo[89857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:39:24 devstack sudo[89857]: pam_unix(sudo:session): session closed for user root Sep 10 16:39:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-df977bbc-b4a3-42ff-b88f-b813f3eea949 tempest-DeleteServersTestJSON-1859266749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-24c31bda-5708-478f-a8e6-7a6b61a8268a" returned: 0 in 0.425s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:39:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-df977bbc-b4a3-42ff-b88f-b813f3eea949 tempest-DeleteServersTestJSON-1859266749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-24c31bda-5708-478f-a8e6-7a6b61a8268a {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:39:24 devstack sudo[89862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-24c31bda-5708-478f-a8e6-7a6b61a8268a Sep 10 16:39:24 devstack sudo[89862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:39:24 devstack sudo[89862]: pam_unix(sudo:session): session closed for user root Sep 10 16:39:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-df977bbc-b4a3-42ff-b88f-b813f3eea949 tempest-DeleteServersTestJSON-1859266749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-24c31bda-5708-478f-a8e6-7a6b61a8268a" returned: 0 in 0.315s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:39:24 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-df977bbc-b4a3-42ff-b88f-b813f3eea949 tempest-DeleteServersTestJSON-1859266749 None] Lock "cinder-quobyte-24c31bda-5708-478f-a8e6-7a6b61a8268a" released by "delete_volume" :: held 2.617s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:39:24 devstack cinder-volume[88189]: WARNING cinder.quota [None req-df977bbc-b4a3-42ff-b88f-b813f3eea949 tempest-DeleteServersTestJSON-1859266749 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 10 16:39:24 devstack cinder-volume[88189]: WARNING cinder.quota [None req-df977bbc-b4a3-42ff-b88f-b813f3eea949 tempest-DeleteServersTestJSON-1859266749 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 10 16:39:24 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-df977bbc-b4a3-42ff-b88f-b813f3eea949 tempest-DeleteServersTestJSON-1859266749 None] Created reservations ['14db73ae-7425-4c8e-ab84-126d6edb2f93', '2a34265a-5245-495c-a6cc-140c2c549f79', '781b0de6-f164-4776-af6b-800c26dd365c', '0794c198-e399-4658-9117-9735d74bb136'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:39:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-df977bbc-b4a3-42ff-b88f-b813f3eea949 tempest-DeleteServersTestJSON-1859266749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:39:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-df977bbc-b4a3-42ff-b88f-b813f3eea949 tempest-DeleteServersTestJSON-1859266749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:39:24 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-df977bbc-b4a3-42ff-b88f-b813f3eea949 tempest-DeleteServersTestJSON-1859266749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:39:24 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-df977bbc-b4a3-42ff-b88f-b813f3eea949 tempest-DeleteServersTestJSON-1859266749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:39:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-df977bbc-b4a3-42ff-b88f-b813f3eea949 tempest-DeleteServersTestJSON-1859266749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:39:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-df977bbc-b4a3-42ff-b88f-b813f3eea949 tempest-DeleteServersTestJSON-1859266749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:39:24 devstack sudo[89865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:39:24 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:39:24 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root Sep 10 16:39:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-df977bbc-b4a3-42ff-b88f-b813f3eea949 tempest-DeleteServersTestJSON-1859266749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.336s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:39:24 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-df977bbc-b4a3-42ff-b88f-b813f3eea949 tempest-DeleteServersTestJSON-1859266749 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:39:24 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-df977bbc-b4a3-42ff-b88f-b813f3eea949 tempest-DeleteServersTestJSON-1859266749 None] Deleted volume successfully. Sep 10 16:39:25 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-df977bbc-b4a3-42ff-b88f-b813f3eea949 tempest-DeleteServersTestJSON-1859266749 None] Lock "cinder-24c31bda-5708-478f-a8e6-7a6b61a8268a-delete_volume" released by "delete_volume" :: held 3.369s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:39:31 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-3125fdc5-cb5f-4292-a667-f2884e43d42d tempest-ServerActionsTestOtherA-1184087604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:39:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3125fdc5-cb5f-4292-a667-f2884e43d42d tempest-ServerActionsTestOtherA-1184087604 None] Flow 'volume_create_manager' (e5211b77-3813-466a-8575-b9316bb07dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:39:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3125fdc5-cb5f-4292-a667-f2884e43d42d tempest-ServerActionsTestOtherA-1184087604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef1e4d68-081c-4fef-a5c2-ee27a96aee69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:39:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3125fdc5-cb5f-4292-a667-f2884e43d42d tempest-ServerActionsTestOtherA-1184087604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef1e4d68-081c-4fef-a5c2-ee27a96aee69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-552696802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc2f29eb-061b-4d43-96a4-3a0d3da1164f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f653b56156d64186b4811e6de4b68262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:39:32Z,use_quota=True,user_id='38397e197e9c4d30813d941a013f265f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:39:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3125fdc5-cb5f-4292-a667-f2884e43d42d tempest-ServerActionsTestOtherA-1184087604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9867e6ee-a140-46b0-925c-56a0f589d5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:39:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3125fdc5-cb5f-4292-a667-f2884e43d42d tempest-ServerActionsTestOtherA-1184087604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9867e6ee-a140-46b0-925c-56a0f589d5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:39:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3125fdc5-cb5f-4292-a667-f2884e43d42d tempest-ServerActionsTestOtherA-1184087604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0492b097-520b-495e-ab51-9d79c8dff07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:39:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3125fdc5-cb5f-4292-a667-f2884e43d42d tempest-ServerActionsTestOtherA-1184087604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0492b097-520b-495e-ab51-9d79c8dff07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc2f29eb-061b-4d43-96a4-3a0d3da1164f', 'volume_name': 'volume-dc2f29eb-061b-4d43-96a4-3a0d3da1164f', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:39:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3125fdc5-cb5f-4292-a667-f2884e43d42d tempest-ServerActionsTestOtherA-1184087604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b702fd-42de-478c-b7f4-6fea5cce60e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:39:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3125fdc5-cb5f-4292-a667-f2884e43d42d tempest-ServerActionsTestOtherA-1184087604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b702fd-42de-478c-b7f4-6fea5cce60e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:39:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3125fdc5-cb5f-4292-a667-f2884e43d42d tempest-ServerActionsTestOtherA-1184087604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b323825-31ec-478a-94fd-752c4fb707d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:39:31 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-3125fdc5-cb5f-4292-a667-f2884e43d42d tempest-ServerActionsTestOtherA-1184087604 None] Volume dc2f29eb-061b-4d43-96a4-3a0d3da1164f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc2f29eb-061b-4d43-96a4-3a0d3da1164f', 'volume_size': 1} Sep 10 16:39:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3125fdc5-cb5f-4292-a667-f2884e43d42d tempest-ServerActionsTestOtherA-1184087604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:39:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3125fdc5-cb5f-4292-a667-f2884e43d42d tempest-ServerActionsTestOtherA-1184087604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:39:31 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3125fdc5-cb5f-4292-a667-f2884e43d42d tempest-ServerActionsTestOtherA-1184087604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-552696802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc2f29eb-061b-4d43-96a4-3a0d3da1164f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f653b56156d64186b4811e6de4b68262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:39:32Z,use_quota=True,user_id='38397e197e9c4d30813d941a013f265f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:39:31 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-3125fdc5-cb5f-4292-a667-f2884e43d42d tempest-ServerActionsTestOtherA-1184087604 None] Creating volume dc2f29eb-061b-4d43-96a4-3a0d3da1164f {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:39:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3125fdc5-cb5f-4292-a667-f2884e43d42d tempest-ServerActionsTestOtherA-1184087604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:39:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3125fdc5-cb5f-4292-a667-f2884e43d42d tempest-ServerActionsTestOtherA-1184087604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:39:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3125fdc5-cb5f-4292-a667-f2884e43d42d tempest-ServerActionsTestOtherA-1184087604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:39:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3125fdc5-cb5f-4292-a667-f2884e43d42d tempest-ServerActionsTestOtherA-1184087604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:39:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3125fdc5-cb5f-4292-a667-f2884e43d42d tempest-ServerActionsTestOtherA-1184087604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:39:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3125fdc5-cb5f-4292-a667-f2884e43d42d tempest-ServerActionsTestOtherA-1184087604 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:39:32 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-3125fdc5-cb5f-4292-a667-f2884e43d42d tempest-ServerActionsTestOtherA-1184087604 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:39:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3125fdc5-cb5f-4292-a667-f2884e43d42d tempest-ServerActionsTestOtherA-1184087604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dc2f29eb-061b-4d43-96a4-3a0d3da1164f 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:39:32 devstack sudo[89897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dc2f29eb-061b-4d43-96a4-3a0d3da1164f 1073741824 Sep 10 16:39:32 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:39:32 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root Sep 10 16:39:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3125fdc5-cb5f-4292-a667-f2884e43d42d tempest-ServerActionsTestOtherA-1184087604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dc2f29eb-061b-4d43-96a4-3a0d3da1164f 1073741824" returned: 0 in 0.692s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:39:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3125fdc5-cb5f-4292-a667-f2884e43d42d tempest-ServerActionsTestOtherA-1184087604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dc2f29eb-061b-4d43-96a4-3a0d3da1164f {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:39:32 devstack sudo[89903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dc2f29eb-061b-4d43-96a4-3a0d3da1164f Sep 10 16:39:32 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:39:33 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root Sep 10 16:39:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3125fdc5-cb5f-4292-a667-f2884e43d42d tempest-ServerActionsTestOtherA-1184087604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dc2f29eb-061b-4d43-96a4-3a0d3da1164f" returned: 0 in 0.329s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:39:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3125fdc5-cb5f-4292-a667-f2884e43d42d tempest-ServerActionsTestOtherA-1184087604 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:39:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3125fdc5-cb5f-4292-a667-f2884e43d42d tempest-ServerActionsTestOtherA-1184087604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:39:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3125fdc5-cb5f-4292-a667-f2884e43d42d tempest-ServerActionsTestOtherA-1184087604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b323825-31ec-478a-94fd-752c4fb707d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc2f29eb-061b-4d43-96a4-3a0d3da1164f', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:39:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3125fdc5-cb5f-4292-a667-f2884e43d42d tempest-ServerActionsTestOtherA-1184087604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d64a73e6-fe64-4c21-8426-3d36bfe9d101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:39:33 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-3125fdc5-cb5f-4292-a667-f2884e43d42d tempest-ServerActionsTestOtherA-1184087604 None] Volume volume-dc2f29eb-061b-4d43-96a4-3a0d3da1164f (dc2f29eb-061b-4d43-96a4-3a0d3da1164f): created successfully Sep 10 16:39:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3125fdc5-cb5f-4292-a667-f2884e43d42d tempest-ServerActionsTestOtherA-1184087604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d64a73e6-fe64-4c21-8426-3d36bfe9d101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:39:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3125fdc5-cb5f-4292-a667-f2884e43d42d tempest-ServerActionsTestOtherA-1184087604 None] Flow 'volume_create_manager' (e5211b77-3813-466a-8575-b9316bb07dc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:39:33 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-3125fdc5-cb5f-4292-a667-f2884e43d42d tempest-ServerActionsTestOtherA-1184087604 None] Created volume successfully. Sep 10 16:39:43 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:UPDATE=14,cinder:SELECT=17,cinder:INSERT=2 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:39:43 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=16,cinder:UPDATE=17,cinder:INSERT=4,cinder:DELETE=3 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:39:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:39:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:39:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:39:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:39:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:39:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:39:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:39:49 devstack sudo[89954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:39:49 devstack sudo[89954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:39:49 devstack sudo[89954]: pam_unix(sudo:session): session closed for user root Sep 10 16:39:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.300s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:39:49 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:39:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager._thread_info {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:39:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread count: 8 {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 16:39:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread info: [<_MainThread(MainThread, started 125792070905984)>, , , , , , , ] {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 16:39:53 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=1 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:39:53 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:UPDATE=1 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:40:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-982d11c7-953f-476c-92b6-3733bd384f03 req-25348294-6218-4d0e-ba90-8c7e1e0b4780 tempest-TaggedAttachmentsTest-200350805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:40:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-982d11c7-953f-476c-92b6-3733bd384f03 req-25348294-6218-4d0e-ba90-8c7e1e0b4780 tempest-TaggedAttachmentsTest-200350805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:40:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-982d11c7-953f-476c-92b6-3733bd384f03 req-25348294-6218-4d0e-ba90-8c7e1e0b4780 tempest-TaggedAttachmentsTest-200350805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:40:11 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-982d11c7-953f-476c-92b6-3733bd384f03 req-25348294-6218-4d0e-ba90-8c7e1e0b4780 tempest-TaggedAttachmentsTest-200350805 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8', 'name': 'volume-2789cd33-70ce-4002-afdf-05d0bc616765', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3af7e4ed-82a5-4ad7-8c34-2ea928345a80', 'enforce_multipath': True} {{(pid=88189) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 16:40:11 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-982d11c7-953f-476c-92b6-3733bd384f03 req-25348294-6218-4d0e-ba90-8c7e1e0b4780 tempest-TaggedAttachmentsTest-200350805 None] attachment_update completed successfully. Sep 10 16:40:15 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-3429fa34-cf5c-4a58-8315-5821ac32e0f4 req-42c2155b-80f3-483a-b9ce-6b4508c85b8a tempest-TaggedAttachmentsTest-200350805 None] Terminate volume connection completed successfully. Sep 10 16:40:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-3429fa34-cf5c-4a58-8315-5821ac32e0f4 req-42c2155b-80f3-483a-b9ce-6b4508c85b8a tempest-TaggedAttachmentsTest-200350805 None] Deleting attachment 3af7e4ed-82a5-4ad7-8c34-2ea928345a80. {{(pid=88189) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 16:40:21 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:40:25 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:40:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-8d506bb7-4548-4092-8289-8393bccbebc1 req-0231bd53-42f7-4614-8558-79285f4318dd tempest-ServerActionsTestOtherA-1184087604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:40:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-8d506bb7-4548-4092-8289-8393bccbebc1 req-0231bd53-42f7-4614-8558-79285f4318dd tempest-ServerActionsTestOtherA-1184087604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:40:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-8d506bb7-4548-4092-8289-8393bccbebc1 req-0231bd53-42f7-4614-8558-79285f4318dd tempest-ServerActionsTestOtherA-1184087604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:40:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-8d506bb7-4548-4092-8289-8393bccbebc1 req-0231bd53-42f7-4614-8558-79285f4318dd tempest-ServerActionsTestOtherA-1184087604 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8', 'name': 'volume-dc2f29eb-061b-4d43-96a4-3a0d3da1164f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a8ff07a9-543f-4e32-a77c-4729f58b34dd', 'enforce_multipath': True} {{(pid=88189) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 16:40:27 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-903d56d4-8e57-466e-92ea-f22325b20a27 tempest-VolumesAdminNegativeTest-59965196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:40:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-903d56d4-8e57-466e-92ea-f22325b20a27 tempest-VolumesAdminNegativeTest-59965196 None] Flow 'volume_create_manager' (cb58be82-4b2f-4a8e-99f9-7389bc72d301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:40:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-903d56d4-8e57-466e-92ea-f22325b20a27 tempest-VolumesAdminNegativeTest-59965196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b5be23-9273-4805-982d-f583df641ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:40:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-903d56d4-8e57-466e-92ea-f22325b20a27 tempest-VolumesAdminNegativeTest-59965196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b5be23-9273-4805-982d-f583df641ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-711586598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d4cb7d7-72a0-4381-8385-99f834cce9f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e351748b0b4341dda9bc666338c2a74e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:40:27Z,use_quota=True,user_id='8a697d1f409143009358c807a09180ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:40:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-903d56d4-8e57-466e-92ea-f22325b20a27 tempest-VolumesAdminNegativeTest-59965196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db046221-a0d4-4e68-ac01-e385158bcc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:40:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-903d56d4-8e57-466e-92ea-f22325b20a27 tempest-VolumesAdminNegativeTest-59965196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db046221-a0d4-4e68-ac01-e385158bcc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:40:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-903d56d4-8e57-466e-92ea-f22325b20a27 tempest-VolumesAdminNegativeTest-59965196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dda9758b-8959-4dbb-b2ba-bc8a04870c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:40:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-903d56d4-8e57-466e-92ea-f22325b20a27 tempest-VolumesAdminNegativeTest-59965196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dda9758b-8959-4dbb-b2ba-bc8a04870c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d4cb7d7-72a0-4381-8385-99f834cce9f8', 'volume_name': 'volume-2d4cb7d7-72a0-4381-8385-99f834cce9f8', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:40:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-903d56d4-8e57-466e-92ea-f22325b20a27 tempest-VolumesAdminNegativeTest-59965196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6206d89-bf1f-4d73-9037-1a6917169479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:40:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-903d56d4-8e57-466e-92ea-f22325b20a27 tempest-VolumesAdminNegativeTest-59965196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6206d89-bf1f-4d73-9037-1a6917169479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:40:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-903d56d4-8e57-466e-92ea-f22325b20a27 tempest-VolumesAdminNegativeTest-59965196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e1f25a9-b28b-4555-a5fd-0f6808d91124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:40:27 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-903d56d4-8e57-466e-92ea-f22325b20a27 tempest-VolumesAdminNegativeTest-59965196 None] Volume 2d4cb7d7-72a0-4381-8385-99f834cce9f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d4cb7d7-72a0-4381-8385-99f834cce9f8', 'volume_size': 1} Sep 10 16:40:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-903d56d4-8e57-466e-92ea-f22325b20a27 tempest-VolumesAdminNegativeTest-59965196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:40:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-903d56d4-8e57-466e-92ea-f22325b20a27 tempest-VolumesAdminNegativeTest-59965196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:40:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-903d56d4-8e57-466e-92ea-f22325b20a27 tempest-VolumesAdminNegativeTest-59965196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-711586598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d4cb7d7-72a0-4381-8385-99f834cce9f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e351748b0b4341dda9bc666338c2a74e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:40:27Z,use_quota=True,user_id='8a697d1f409143009358c807a09180ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:40:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-903d56d4-8e57-466e-92ea-f22325b20a27 tempest-VolumesAdminNegativeTest-59965196 None] Creating volume 2d4cb7d7-72a0-4381-8385-99f834cce9f8 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:40:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-903d56d4-8e57-466e-92ea-f22325b20a27 tempest-VolumesAdminNegativeTest-59965196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:40:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-903d56d4-8e57-466e-92ea-f22325b20a27 tempest-VolumesAdminNegativeTest-59965196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:40:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-903d56d4-8e57-466e-92ea-f22325b20a27 tempest-VolumesAdminNegativeTest-59965196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:40:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-903d56d4-8e57-466e-92ea-f22325b20a27 tempest-VolumesAdminNegativeTest-59965196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:40:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-903d56d4-8e57-466e-92ea-f22325b20a27 tempest-VolumesAdminNegativeTest-59965196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:40:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-903d56d4-8e57-466e-92ea-f22325b20a27 tempest-VolumesAdminNegativeTest-59965196 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:40:27 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-903d56d4-8e57-466e-92ea-f22325b20a27 tempest-VolumesAdminNegativeTest-59965196 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:40:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-903d56d4-8e57-466e-92ea-f22325b20a27 tempest-VolumesAdminNegativeTest-59965196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2d4cb7d7-72a0-4381-8385-99f834cce9f8 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:40:27 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-8d506bb7-4548-4092-8289-8393bccbebc1 req-0231bd53-42f7-4614-8558-79285f4318dd tempest-ServerActionsTestOtherA-1184087604 None] attachment_update completed successfully. Sep 10 16:40:27 devstack sudo[90808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2d4cb7d7-72a0-4381-8385-99f834cce9f8 1073741824 Sep 10 16:40:27 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:40:29 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root Sep 10 16:40:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-903d56d4-8e57-466e-92ea-f22325b20a27 tempest-VolumesAdminNegativeTest-59965196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2d4cb7d7-72a0-4381-8385-99f834cce9f8 1073741824" returned: 0 in 1.526s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:40:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-903d56d4-8e57-466e-92ea-f22325b20a27 tempest-VolumesAdminNegativeTest-59965196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2d4cb7d7-72a0-4381-8385-99f834cce9f8 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:40:29 devstack sudo[91200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2d4cb7d7-72a0-4381-8385-99f834cce9f8 Sep 10 16:40:29 devstack sudo[91200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:40:29 devstack sudo[91200]: pam_unix(sudo:session): session closed for user root Sep 10 16:40:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-903d56d4-8e57-466e-92ea-f22325b20a27 tempest-VolumesAdminNegativeTest-59965196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2d4cb7d7-72a0-4381-8385-99f834cce9f8" returned: 0 in 0.408s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:40:29 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-903d56d4-8e57-466e-92ea-f22325b20a27 tempest-VolumesAdminNegativeTest-59965196 None] <== create_volume: return (2041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:40:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-903d56d4-8e57-466e-92ea-f22325b20a27 tempest-VolumesAdminNegativeTest-59965196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.047s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:40:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-903d56d4-8e57-466e-92ea-f22325b20a27 tempest-VolumesAdminNegativeTest-59965196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e1f25a9-b28b-4555-a5fd-0f6808d91124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d4cb7d7-72a0-4381-8385-99f834cce9f8', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:40:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-903d56d4-8e57-466e-92ea-f22325b20a27 tempest-VolumesAdminNegativeTest-59965196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40aed2ec-0d2b-49d7-ab06-03043a6e4071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:40:29 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-903d56d4-8e57-466e-92ea-f22325b20a27 tempest-VolumesAdminNegativeTest-59965196 None] Volume volume-2d4cb7d7-72a0-4381-8385-99f834cce9f8 (2d4cb7d7-72a0-4381-8385-99f834cce9f8): created successfully Sep 10 16:40:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-903d56d4-8e57-466e-92ea-f22325b20a27 tempest-VolumesAdminNegativeTest-59965196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40aed2ec-0d2b-49d7-ab06-03043a6e4071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:40:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-903d56d4-8e57-466e-92ea-f22325b20a27 tempest-VolumesAdminNegativeTest-59965196 None] Flow 'volume_create_manager' (cb58be82-4b2f-4a8e-99f9-7389bc72d301) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:40:29 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-903d56d4-8e57-466e-92ea-f22325b20a27 tempest-VolumesAdminNegativeTest-59965196 None] Created volume successfully. Sep 10 16:40:31 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c7fa3b09-8fbe-4894-89b5-5371eefae680 tempest-VolumesAdminNegativeTest-59965196 None] Acquiring lock "cinder-2d4cb7d7-72a0-4381-8385-99f834cce9f8-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:40:31 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c7fa3b09-8fbe-4894-89b5-5371eefae680 tempest-VolumesAdminNegativeTest-59965196 None] Lock "cinder-2d4cb7d7-72a0-4381-8385-99f834cce9f8-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:40:31 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c7fa3b09-8fbe-4894-89b5-5371eefae680 tempest-VolumesAdminNegativeTest-59965196 None] Acquiring lock "cinder-quobyte-2d4cb7d7-72a0-4381-8385-99f834cce9f8" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:40:31 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c7fa3b09-8fbe-4894-89b5-5371eefae680 tempest-VolumesAdminNegativeTest-59965196 None] Lock "cinder-quobyte-2d4cb7d7-72a0-4381-8385-99f834cce9f8" acquired by "delete_volume" :: waited 0.035s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:40:31 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c4efa1-5603-4982-8e87-e61320e35558]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:40:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c7fa3b09-8fbe-4894-89b5-5371eefae680 tempest-VolumesAdminNegativeTest-59965196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2d4cb7d7-72a0-4381-8385-99f834cce9f8 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:40:31 devstack sudo[91233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2d4cb7d7-72a0-4381-8385-99f834cce9f8 Sep 10 16:40:31 devstack sudo[91233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:40:32 devstack sudo[91233]: pam_unix(sudo:session): session closed for user root Sep 10 16:40:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c7fa3b09-8fbe-4894-89b5-5371eefae680 tempest-VolumesAdminNegativeTest-59965196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2d4cb7d7-72a0-4381-8385-99f834cce9f8" returned: 0 in 0.681s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:40:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c7fa3b09-8fbe-4894-89b5-5371eefae680 tempest-VolumesAdminNegativeTest-59965196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2d4cb7d7-72a0-4381-8385-99f834cce9f8 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:40:32 devstack sudo[91241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2d4cb7d7-72a0-4381-8385-99f834cce9f8 Sep 10 16:40:32 devstack sudo[91241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:40:32 devstack sudo[91241]: pam_unix(sudo:session): session closed for user root Sep 10 16:40:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c7fa3b09-8fbe-4894-89b5-5371eefae680 tempest-VolumesAdminNegativeTest-59965196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2d4cb7d7-72a0-4381-8385-99f834cce9f8" returned: 0 in 0.643s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:40:33 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c7fa3b09-8fbe-4894-89b5-5371eefae680 tempest-VolumesAdminNegativeTest-59965196 None] Lock "cinder-quobyte-2d4cb7d7-72a0-4381-8385-99f834cce9f8" released by "delete_volume" :: held 1.424s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:40:33 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-c7fa3b09-8fbe-4894-89b5-5371eefae680 tempest-VolumesAdminNegativeTest-59965196 None] Created reservations ['89ce97e3-b99e-43ef-b8ab-ae45ea40ca04', '24620b92-06ab-466d-918e-4db655438802', 'd486746f-e920-47c5-864d-3a00988a986b', 'dc70815d-095d-4a50-90e0-426cb20b5826'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:40:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c7fa3b09-8fbe-4894-89b5-5371eefae680 tempest-VolumesAdminNegativeTest-59965196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:40:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c7fa3b09-8fbe-4894-89b5-5371eefae680 tempest-VolumesAdminNegativeTest-59965196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:40:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c7fa3b09-8fbe-4894-89b5-5371eefae680 tempest-VolumesAdminNegativeTest-59965196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:40:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c7fa3b09-8fbe-4894-89b5-5371eefae680 tempest-VolumesAdminNegativeTest-59965196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:40:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c7fa3b09-8fbe-4894-89b5-5371eefae680 tempest-VolumesAdminNegativeTest-59965196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:40:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c7fa3b09-8fbe-4894-89b5-5371eefae680 tempest-VolumesAdminNegativeTest-59965196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:40:33 devstack sudo[91250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:40:33 devstack sudo[91250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:40:33 devstack sudo[91250]: pam_unix(sudo:session): session closed for user root Sep 10 16:40:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c7fa3b09-8fbe-4894-89b5-5371eefae680 tempest-VolumesAdminNegativeTest-59965196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.304s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:40:33 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-c7fa3b09-8fbe-4894-89b5-5371eefae680 tempest-VolumesAdminNegativeTest-59965196 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:40:33 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-c7fa3b09-8fbe-4894-89b5-5371eefae680 tempest-VolumesAdminNegativeTest-59965196 None] Deleted volume successfully. Sep 10 16:40:33 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c7fa3b09-8fbe-4894-89b5-5371eefae680 tempest-VolumesAdminNegativeTest-59965196 None] Lock "cinder-2d4cb7d7-72a0-4381-8385-99f834cce9f8-delete_volume" released by "delete_volume" :: held 2.168s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:40:33 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-a90c181b-bec1-42de-b0f2-ef4458073fbf req-a6a5515f-6c16-4c5c-8362-ea44cfb1ad5c tempest-ServerActionsTestOtherA-1184087604 None] Terminate volume connection completed successfully. Sep 10 16:40:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-a90c181b-bec1-42de-b0f2-ef4458073fbf req-a6a5515f-6c16-4c5c-8362-ea44cfb1ad5c tempest-ServerActionsTestOtherA-1184087604 None] Deleting attachment a8ff07a9-543f-4e32-a77c-4729f58b34dd. {{(pid=88189) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 16:40:34 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-04409830-ded9-41c3-86a5-93f4892afeff tempest-TaggedAttachmentsTest-200350805 None] Acquiring lock "cinder-2789cd33-70ce-4002-afdf-05d0bc616765-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:40:34 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-04409830-ded9-41c3-86a5-93f4892afeff tempest-TaggedAttachmentsTest-200350805 None] Lock "cinder-2789cd33-70ce-4002-afdf-05d0bc616765-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:40:34 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-04409830-ded9-41c3-86a5-93f4892afeff tempest-TaggedAttachmentsTest-200350805 None] Acquiring lock "cinder-quobyte-2789cd33-70ce-4002-afdf-05d0bc616765" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:40:34 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-04409830-ded9-41c3-86a5-93f4892afeff tempest-TaggedAttachmentsTest-200350805 None] Lock "cinder-quobyte-2789cd33-70ce-4002-afdf-05d0bc616765" acquired by "delete_volume" :: waited 0.025s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:40:35 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe3868b-34c1-48b9-8e7d-4d7d2a1228af]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:40:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-04409830-ded9-41c3-86a5-93f4892afeff tempest-TaggedAttachmentsTest-200350805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2789cd33-70ce-4002-afdf-05d0bc616765 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:40:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-a90c181b-bec1-42de-b0f2-ef4458073fbf req-b0d297d7-9daf-4ff6-b3ec-e2ddb84f3830 tempest-ServerActionsTestOtherA-1184087604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:40:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-a90c181b-bec1-42de-b0f2-ef4458073fbf req-b0d297d7-9daf-4ff6-b3ec-e2ddb84f3830 tempest-ServerActionsTestOtherA-1184087604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:40:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-a90c181b-bec1-42de-b0f2-ef4458073fbf req-b0d297d7-9daf-4ff6-b3ec-e2ddb84f3830 tempest-ServerActionsTestOtherA-1184087604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.051s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:40:35 devstack sudo[91313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2789cd33-70ce-4002-afdf-05d0bc616765 Sep 10 16:40:35 devstack sudo[91313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:40:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-a90c181b-bec1-42de-b0f2-ef4458073fbf req-b0d297d7-9daf-4ff6-b3ec-e2ddb84f3830 tempest-ServerActionsTestOtherA-1184087604 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8', 'name': 'volume-dc2f29eb-061b-4d43-96a4-3a0d3da1164f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'db9b4a58-850d-49ea-bafd-9f9fb2808276', 'enforce_multipath': True} {{(pid=88189) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 16:40:35 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-a90c181b-bec1-42de-b0f2-ef4458073fbf req-b0d297d7-9daf-4ff6-b3ec-e2ddb84f3830 tempest-ServerActionsTestOtherA-1184087604 None] attachment_update completed successfully. Sep 10 16:40:35 devstack sudo[91313]: pam_unix(sudo:session): session closed for user root Sep 10 16:40:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-04409830-ded9-41c3-86a5-93f4892afeff tempest-TaggedAttachmentsTest-200350805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2789cd33-70ce-4002-afdf-05d0bc616765" returned: 0 in 0.870s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:40:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-04409830-ded9-41c3-86a5-93f4892afeff tempest-TaggedAttachmentsTest-200350805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2789cd33-70ce-4002-afdf-05d0bc616765 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:40:35 devstack sudo[91333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2789cd33-70ce-4002-afdf-05d0bc616765 Sep 10 16:40:35 devstack sudo[91333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:40:36 devstack sudo[91333]: pam_unix(sudo:session): session closed for user root Sep 10 16:40:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-04409830-ded9-41c3-86a5-93f4892afeff tempest-TaggedAttachmentsTest-200350805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2789cd33-70ce-4002-afdf-05d0bc616765" returned: 0 in 0.491s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:40:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-04409830-ded9-41c3-86a5-93f4892afeff tempest-TaggedAttachmentsTest-200350805 None] Lock "cinder-quobyte-2789cd33-70ce-4002-afdf-05d0bc616765" released by "delete_volume" :: held 1.449s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:40:36 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-04409830-ded9-41c3-86a5-93f4892afeff tempest-TaggedAttachmentsTest-200350805 None] Created reservations ['a7468af2-78dd-4ab7-b8d4-ae97f1bc6d00', 'ff44da8d-3831-492d-b777-e91017b2d7c8', '0c9ebfac-cc8c-437b-9a17-ae4a529ab074', '98ab1e96-3669-4dcc-b094-775c94ae93a5'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:40:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-04409830-ded9-41c3-86a5-93f4892afeff tempest-TaggedAttachmentsTest-200350805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:40:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-04409830-ded9-41c3-86a5-93f4892afeff tempest-TaggedAttachmentsTest-200350805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:40:36 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-04409830-ded9-41c3-86a5-93f4892afeff tempest-TaggedAttachmentsTest-200350805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:40:36 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-04409830-ded9-41c3-86a5-93f4892afeff tempest-TaggedAttachmentsTest-200350805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:40:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-04409830-ded9-41c3-86a5-93f4892afeff tempest-TaggedAttachmentsTest-200350805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:40:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-04409830-ded9-41c3-86a5-93f4892afeff tempest-TaggedAttachmentsTest-200350805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:40:36 devstack sudo[91341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:40:36 devstack sudo[91341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:40:36 devstack sudo[91341]: pam_unix(sudo:session): session closed for user root Sep 10 16:40:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-04409830-ded9-41c3-86a5-93f4892afeff tempest-TaggedAttachmentsTest-200350805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.398s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:40:36 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-04409830-ded9-41c3-86a5-93f4892afeff tempest-TaggedAttachmentsTest-200350805 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:40:37 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-04409830-ded9-41c3-86a5-93f4892afeff tempest-TaggedAttachmentsTest-200350805 None] Deleted volume successfully. Sep 10 16:40:37 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-04409830-ded9-41c3-86a5-93f4892afeff tempest-TaggedAttachmentsTest-200350805 None] Lock "cinder-2789cd33-70ce-4002-afdf-05d0bc616765-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:40:46 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-c26744d1-677f-4775-a845-ad3594fa147b tempest-AttachVolumeShelveTestJSON-1242629616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:40:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c26744d1-677f-4775-a845-ad3594fa147b tempest-AttachVolumeShelveTestJSON-1242629616 None] Flow 'volume_create_manager' (33d2ca5a-ce3a-445b-8999-22b25229ed21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:40:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c26744d1-677f-4775-a845-ad3594fa147b tempest-AttachVolumeShelveTestJSON-1242629616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66bb074f-31e2-4c42-8f99-01b8676e73cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:40:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c26744d1-677f-4775-a845-ad3594fa147b tempest-AttachVolumeShelveTestJSON-1242629616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66bb074f-31e2-4c42-8f99-01b8676e73cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-73676405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6103518b-bea9-4321-84a5-10b0ad2f04fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcfc2ee3faf64f32a1907fe92de4e4e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:40:46Z,use_quota=True,user_id='c6f842faca154acc9cb5530000f444de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:40:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c26744d1-677f-4775-a845-ad3594fa147b tempest-AttachVolumeShelveTestJSON-1242629616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4f36803-03f5-452f-8cb4-9a0a74e41b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:40:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c26744d1-677f-4775-a845-ad3594fa147b tempest-AttachVolumeShelveTestJSON-1242629616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4f36803-03f5-452f-8cb4-9a0a74e41b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:40:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c26744d1-677f-4775-a845-ad3594fa147b tempest-AttachVolumeShelveTestJSON-1242629616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99aa3c59-35b6-4091-aff7-7706c8edca60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:40:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c26744d1-677f-4775-a845-ad3594fa147b tempest-AttachVolumeShelveTestJSON-1242629616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99aa3c59-35b6-4091-aff7-7706c8edca60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6103518b-bea9-4321-84a5-10b0ad2f04fc', 'volume_name': 'volume-6103518b-bea9-4321-84a5-10b0ad2f04fc', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:40:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c26744d1-677f-4775-a845-ad3594fa147b tempest-AttachVolumeShelveTestJSON-1242629616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adff4842-d37d-4b5c-8fb7-bcd873b874df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:40:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c26744d1-677f-4775-a845-ad3594fa147b tempest-AttachVolumeShelveTestJSON-1242629616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adff4842-d37d-4b5c-8fb7-bcd873b874df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:40:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c26744d1-677f-4775-a845-ad3594fa147b tempest-AttachVolumeShelveTestJSON-1242629616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0cd0fe0-6fb1-45c0-9cff-7c5d60d1ebf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:40:46 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-c26744d1-677f-4775-a845-ad3594fa147b tempest-AttachVolumeShelveTestJSON-1242629616 None] Volume 6103518b-bea9-4321-84a5-10b0ad2f04fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6103518b-bea9-4321-84a5-10b0ad2f04fc', 'volume_size': 1} Sep 10 16:40:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c26744d1-677f-4775-a845-ad3594fa147b tempest-AttachVolumeShelveTestJSON-1242629616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:40:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c26744d1-677f-4775-a845-ad3594fa147b tempest-AttachVolumeShelveTestJSON-1242629616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:40:46 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c26744d1-677f-4775-a845-ad3594fa147b tempest-AttachVolumeShelveTestJSON-1242629616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-73676405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6103518b-bea9-4321-84a5-10b0ad2f04fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcfc2ee3faf64f32a1907fe92de4e4e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:40:46Z,use_quota=True,user_id='c6f842faca154acc9cb5530000f444de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:40:46 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-c26744d1-677f-4775-a845-ad3594fa147b tempest-AttachVolumeShelveTestJSON-1242629616 None] Creating volume 6103518b-bea9-4321-84a5-10b0ad2f04fc {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:40:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c26744d1-677f-4775-a845-ad3594fa147b tempest-AttachVolumeShelveTestJSON-1242629616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:40:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c26744d1-677f-4775-a845-ad3594fa147b tempest-AttachVolumeShelveTestJSON-1242629616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:40:46 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c26744d1-677f-4775-a845-ad3594fa147b tempest-AttachVolumeShelveTestJSON-1242629616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:40:46 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c26744d1-677f-4775-a845-ad3594fa147b tempest-AttachVolumeShelveTestJSON-1242629616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:40:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c26744d1-677f-4775-a845-ad3594fa147b tempest-AttachVolumeShelveTestJSON-1242629616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:40:46 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c26744d1-677f-4775-a845-ad3594fa147b tempest-AttachVolumeShelveTestJSON-1242629616 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:40:46 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-c26744d1-677f-4775-a845-ad3594fa147b tempest-AttachVolumeShelveTestJSON-1242629616 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:40:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c26744d1-677f-4775-a845-ad3594fa147b tempest-AttachVolumeShelveTestJSON-1242629616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6103518b-bea9-4321-84a5-10b0ad2f04fc 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:40:46 devstack sudo[91814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6103518b-bea9-4321-84a5-10b0ad2f04fc 1073741824 Sep 10 16:40:46 devstack sudo[91814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:40:46 devstack sudo[91814]: pam_unix(sudo:session): session closed for user root Sep 10 16:40:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c26744d1-677f-4775-a845-ad3594fa147b tempest-AttachVolumeShelveTestJSON-1242629616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6103518b-bea9-4321-84a5-10b0ad2f04fc 1073741824" returned: 0 in 0.590s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:40:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c26744d1-677f-4775-a845-ad3594fa147b tempest-AttachVolumeShelveTestJSON-1242629616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6103518b-bea9-4321-84a5-10b0ad2f04fc {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:40:46 devstack sudo[91821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6103518b-bea9-4321-84a5-10b0ad2f04fc Sep 10 16:40:46 devstack sudo[91821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:40:47 devstack sudo[91821]: pam_unix(sudo:session): session closed for user root Sep 10 16:40:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c26744d1-677f-4775-a845-ad3594fa147b tempest-AttachVolumeShelveTestJSON-1242629616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6103518b-bea9-4321-84a5-10b0ad2f04fc" returned: 0 in 0.442s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:40:47 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c26744d1-677f-4775-a845-ad3594fa147b tempest-AttachVolumeShelveTestJSON-1242629616 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:40:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c26744d1-677f-4775-a845-ad3594fa147b tempest-AttachVolumeShelveTestJSON-1242629616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:40:47 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c26744d1-677f-4775-a845-ad3594fa147b tempest-AttachVolumeShelveTestJSON-1242629616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0cd0fe0-6fb1-45c0-9cff-7c5d60d1ebf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6103518b-bea9-4321-84a5-10b0ad2f04fc', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:40:47 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c26744d1-677f-4775-a845-ad3594fa147b tempest-AttachVolumeShelveTestJSON-1242629616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f111e1ba-ba82-49fc-8139-ac355fa87814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:40:47 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-c26744d1-677f-4775-a845-ad3594fa147b tempest-AttachVolumeShelveTestJSON-1242629616 None] Volume volume-6103518b-bea9-4321-84a5-10b0ad2f04fc (6103518b-bea9-4321-84a5-10b0ad2f04fc): created successfully Sep 10 16:40:47 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c26744d1-677f-4775-a845-ad3594fa147b tempest-AttachVolumeShelveTestJSON-1242629616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f111e1ba-ba82-49fc-8139-ac355fa87814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:40:47 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c26744d1-677f-4775-a845-ad3594fa147b tempest-AttachVolumeShelveTestJSON-1242629616 None] Flow 'volume_create_manager' (33d2ca5a-ce3a-445b-8999-22b25229ed21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:40:47 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-c26744d1-677f-4775-a845-ad3594fa147b tempest-AttachVolumeShelveTestJSON-1242629616 None] Created volume successfully. Sep 10 16:40:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:40:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:40:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:40:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:40:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:40:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:40:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:40:49 devstack sudo[91831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:40:49 devstack sudo[91831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:40:49 devstack sudo[91831]: pam_unix(sudo:session): session closed for user root Sep 10 16:40:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.446s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:40:49 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:40:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager._thread_info {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:40:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread count: 8 {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 16:40:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread info: [<_MainThread(MainThread, started 125792070905984)>, , , , , , , ] {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 16:40:57 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=25,cinder:UPDATE=26,cinder:DELETE=3,cinder:INSERT=6 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:40:57 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=31,cinder:UPDATE=24,cinder:INSERT=4,cinder:DELETE=1 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:41:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-154bd83f-b420-4d6b-89c0-b25bd9f73a77 req-5d27155b-ff98-40ef-9576-6d584ec26687 tempest-AttachVolumeShelveTestJSON-1242629616 None] No connector for attachment 439706ed-056f-4e0f-a711-ee19834fae50; skipping storage backend terminate_connection call. {{(pid=88189) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 10 16:41:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-154bd83f-b420-4d6b-89c0-b25bd9f73a77 req-5d27155b-ff98-40ef-9576-6d584ec26687 tempest-AttachVolumeShelveTestJSON-1242629616 None] Deleting attachment 439706ed-056f-4e0f-a711-ee19834fae50. {{(pid=88189) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 16:41:11 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=1 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:41:11 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=1 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:41:11 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-5c7a9957-6ff4-46d2-b4fe-6a22491a7238 req-9cbdfd14-f192-4662-bf12-2669f8a55b8f tempest-ServerActionsTestOtherA-1184087604 None] Terminate volume connection completed successfully. Sep 10 16:41:11 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-5c7a9957-6ff4-46d2-b4fe-6a22491a7238 req-9cbdfd14-f192-4662-bf12-2669f8a55b8f tempest-ServerActionsTestOtherA-1184087604 None] Deleting attachment db9b4a58-850d-49ea-bafd-9f9fb2808276. {{(pid=88189) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 16:41:21 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=1 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:41:21 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=1 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:41:33 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:41:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Flow 'volume_create_manager' (3b33c50e-1d26-401c-bb63-b1c8b843360c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:41:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5aa78b8-2372-46b4-ad65-f2dcf4796d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:41:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5aa78b8-2372-46b4-ad65-f2dcf4796d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1092025800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce94a601-0c26-4b81-9061-683e09cb1f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f653b56156d64186b4811e6de4b68262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:41:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:41:34Z,use_quota=True,user_id='38397e197e9c4d30813d941a013f265f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:41:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4335eb68-86f5-4109-b359-662d0a50677f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:41:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4335eb68-86f5-4109-b359-662d0a50677f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:41:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0adfa2d8-bffb-4c8e-9dba-05cf59eeae81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:41:33 devstack cinder-volume[88189]: DEBUG cinder.image.glance [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Creating Keystone auth plugin from conf {{(pid=88189) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 16:41:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0adfa2d8-bffb-4c8e-9dba-05cf59eeae81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ce94a601-0c26-4b81-9061-683e09cb1f75', 'volume_name': 'volume-ce94a601-0c26-4b81-9061-683e09cb1f75', 'volume_size': 1, 'image_id': '5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dbb77788940a4d64b2cf7dbf5431f2a1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'created_at': datetime.datetime(2026, 9, 10, 14, 32, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 14, 32, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:41:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddbbe9fe-a43f-4b60-b112-57d5de5c27e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:41:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddbbe9fe-a43f-4b60-b112-57d5de5c27e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:41:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa8f2c42-b5d0-47c0-bf55-4d133a384e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:41:35 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Volume ce94a601-0c26-4b81-9061-683e09cb1f75: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ce94a601-0c26-4b81-9061-683e09cb1f75', 'volume_size': 1, 'image_id': '5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dbb77788940a4d64b2cf7dbf5431f2a1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'created_at': datetime.datetime(2026, 9, 10, 14, 32, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 14, 32, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 16:41:35 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Trying to clone ce94a601-0c26-4b81-9061-683e09cb1f75 from image 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'metadata': {}}]). {{(pid=88189) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 16:41:36 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_gowur64tdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88189) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 16:41:36 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Image download 20.69 MB at 20.69 MB/s Sep 10 16:41:36 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d46e42-114c-442c-bf37-604f18cbf6fe]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:41:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_gowur64tdevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:41:36 devstack sudo[92340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_gowur64tdevstack@QuobyteHD Sep 10 16:41:36 devstack sudo[92340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:41:37 devstack sudo[92340]: pam_unix(sudo:session): session closed for user root Sep 10 16:41:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_gowur64tdevstack@QuobyteHD" returned: 0 in 0.812s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:41:37 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Temporary image 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 is fetched for user 38397e197e9c4d30813d941a013f265f. {{(pid=88189) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 16:41:37 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d884ee-df2c-4d4a-8cdc-95a758b2acfe]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:41:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_gowur64tdevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:41:37 devstack sudo[92347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_gowur64tdevstack@QuobyteHD Sep 10 16:41:37 devstack sudo[92347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:41:38 devstack sudo[92347]: pam_unix(sudo:session): session closed for user root Sep 10 16:41:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_gowur64tdevstack@QuobyteHD" returned: 0 in 0.811s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:41:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:41:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:41:38 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1092025800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce94a601-0c26-4b81-9061-683e09cb1f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f653b56156d64186b4811e6de4b68262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:41:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:41:34Z,use_quota=True,user_id='38397e197e9c4d30813d941a013f265f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:41:38 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Creating volume ce94a601-0c26-4b81-9061-683e09cb1f75 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:41:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:41:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:41:38 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:41:38 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:41:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:41:38 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:41:38 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:41:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ce94a601-0c26-4b81-9061-683e09cb1f75 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:41:38 devstack sudo[92352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ce94a601-0c26-4b81-9061-683e09cb1f75 1073741824 Sep 10 16:41:38 devstack sudo[92352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:41:39 devstack sudo[92352]: pam_unix(sudo:session): session closed for user root Sep 10 16:41:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ce94a601-0c26-4b81-9061-683e09cb1f75 1073741824" returned: 0 in 1.074s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:41:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ce94a601-0c26-4b81-9061-683e09cb1f75 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:41:39 devstack sudo[92368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ce94a601-0c26-4b81-9061-683e09cb1f75 Sep 10 16:41:39 devstack sudo[92368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:41:40 devstack sudo[92368]: pam_unix(sudo:session): session closed for user root Sep 10 16:41:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ce94a601-0c26-4b81-9061-683e09cb1f75" returned: 0 in 0.638s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:41:40 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] <== create_volume: return (1814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:41:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.817s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:41:40 devstack cinder-volume[88189]: DEBUG cinder.volume.volume_utils [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Attempting download of 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'metadata': {}}])) to volume ce94a601-0c26-4b81-9061-683e09cb1f75. {{(pid=88189) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 16:41:40 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4342acbd-d0fe-47b2-84c8-b34c58723c34]: (4, 'raw') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:41:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_xu1ax5hv {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:41:40 devstack sudo[92381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_xu1ax5hv Sep 10 16:41:40 devstack sudo[92381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:41:40 devstack sudo[92381]: pam_unix(sudo:session): session closed for user root Sep 10 16:41:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_xu1ax5hv" returned: 0 in 0.528s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:41:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_xu1ax5hv {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:41:41 devstack sudo[92393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_xu1ax5hv Sep 10 16:41:41 devstack sudo[92393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:41:41 devstack sudo[92393]: pam_unix(sudo:session): session closed for user root Sep 10 16:41:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_xu1ax5hv" returned: 1 in 0.966s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:41:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_xu1ax5hv' failed. Not Retrying. {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 16:41:41 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8e7fa6-887a-4c74-997a-20145598aa38]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:41:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_gowur64tdevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:41:41 devstack sudo[92462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_gowur64tdevstack@QuobyteHD Sep 10 16:41:41 devstack sudo[92462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:41:42 devstack sudo[92462]: pam_unix(sudo:session): session closed for user root Sep 10 16:41:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_gowur64tdevstack@QuobyteHD" returned: 0 in 0.885s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:41:42 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 was qcow2, converting to qcow2 {{(pid=88189) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 16:41:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_gowur64tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ce94a601-0c26-4b81-9061-683e09cb1f75 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:41:42 devstack sudo[92487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_gowur64tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ce94a601-0c26-4b81-9061-683e09cb1f75 Sep 10 16:41:42 devstack sudo[92487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:41:46 devstack sudo[92487]: pam_unix(sudo:session): session closed for user root Sep 10 16:41:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_gowur64tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ce94a601-0c26-4b81-9061-683e09cb1f75" returned: 0 in 4.104s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:41:46 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_gowur64tdevstack@QuobyteHD, size 112.00 MB, duration 4.11 sec, destination /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ce94a601-0c26-4b81-9061-683e09cb1f75 {{(pid=88189) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 16:41:46 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Converted 112.00 MB image at 27.25 MB/s Sep 10 16:41:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ce94a601-0c26-4b81-9061-683e09cb1f75 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:41:46 devstack sudo[92543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ce94a601-0c26-4b81-9061-683e09cb1f75 1G Sep 10 16:41:46 devstack sudo[92543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:41:47 devstack sudo[92543]: pam_unix(sudo:session): session closed for user root Sep 10 16:41:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ce94a601-0c26-4b81-9061-683e09cb1f75 1G" returned: 0 in 0.953s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:41:47 devstack cinder-volume[88189]: DEBUG cinder.volume.volume_utils [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Downloaded image 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'metadata': {}}])) to volume ce94a601-0c26-4b81-9061-683e09cb1f75 successfully. {{(pid=88189) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 16:41:47 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Temporary image 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 for user 38397e197e9c4d30813d941a013f265f is deleted. {{(pid=88189) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 16:41:47 devstack cinder-volume[88189]: DEBUG cinder.volume.volume_utils [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Marking volume ce94a601-0c26-4b81-9061-683e09cb1f75 as bootable. {{(pid=88189) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 16:41:47 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Copying metadata from image 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 to ce94a601-0c26-4b81-9061-683e09cb1f75. {{(pid=88189) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 16:41:47 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Creating volume glance metadata for volume ce94a601-0c26-4b81-9061-683e09cb1f75 backed by image 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88189) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 16:41:48 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa8f2c42-b5d0-47c0-bf55-4d133a384e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce94a601-0c26-4b81-9061-683e09cb1f75', 'volume_size': 1, 'image_id': '5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dbb77788940a4d64b2cf7dbf5431f2a1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'created_at': datetime.datetime(2026, 9, 10, 14, 32, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 14, 32, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:41:48 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b977476e-f37a-40c2-bad4-f69c65afe6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:41:48 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Volume volume-ce94a601-0c26-4b81-9061-683e09cb1f75 (ce94a601-0c26-4b81-9061-683e09cb1f75): created successfully Sep 10 16:41:48 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b977476e-f37a-40c2-bad4-f69c65afe6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:41:48 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Flow 'volume_create_manager' (3b33c50e-1d26-401c-bb63-b1c8b843360c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:41:48 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-76d66797-e21f-4f42-b687-619cc60deb3a tempest-ServerActionsTestOtherA-1184087604 None] Created volume successfully. Sep 10 16:41:48 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bb6301f-977f-4d81-9eb1-02f7b2fa1991 tempest-ServerRescueNegativeTestJSON-1033903955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:41:48 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6bb6301f-977f-4d81-9eb1-02f7b2fa1991 tempest-ServerRescueNegativeTestJSON-1033903955 None] Flow 'volume_create_manager' (92f20b0d-7545-498a-86e7-fe2e39d337c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:41:48 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6bb6301f-977f-4d81-9eb1-02f7b2fa1991 tempest-ServerRescueNegativeTestJSON-1033903955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8184b0da-a6de-4348-80dd-33c665718e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:41:48 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6bb6301f-977f-4d81-9eb1-02f7b2fa1991 tempest-ServerRescueNegativeTestJSON-1033903955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8184b0da-a6de-4348-80dd-33c665718e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-64897801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef2e6e1a-51d2-470e-9a55-cbc8d967208c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='441cdc2e393e47a1a2f900c77ed7eaf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:41:48Z,use_quota=True,user_id='115971bcc82941a8981534f99b24447c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:41:48 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6bb6301f-977f-4d81-9eb1-02f7b2fa1991 tempest-ServerRescueNegativeTestJSON-1033903955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb3f1dd0-a2cc-40c3-9bc8-1b0d567eeef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:41:48 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6bb6301f-977f-4d81-9eb1-02f7b2fa1991 tempest-ServerRescueNegativeTestJSON-1033903955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb3f1dd0-a2cc-40c3-9bc8-1b0d567eeef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:41:48 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6bb6301f-977f-4d81-9eb1-02f7b2fa1991 tempest-ServerRescueNegativeTestJSON-1033903955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce29787b-a8b6-4959-bfcc-eb718d00863e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:41:48 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6bb6301f-977f-4d81-9eb1-02f7b2fa1991 tempest-ServerRescueNegativeTestJSON-1033903955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce29787b-a8b6-4959-bfcc-eb718d00863e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef2e6e1a-51d2-470e-9a55-cbc8d967208c', 'volume_name': 'volume-ef2e6e1a-51d2-470e-9a55-cbc8d967208c', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:41:48 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6bb6301f-977f-4d81-9eb1-02f7b2fa1991 tempest-ServerRescueNegativeTestJSON-1033903955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24be1409-9c5d-45f2-a280-21a2a334d80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:41:48 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6bb6301f-977f-4d81-9eb1-02f7b2fa1991 tempest-ServerRescueNegativeTestJSON-1033903955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24be1409-9c5d-45f2-a280-21a2a334d80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:41:48 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6bb6301f-977f-4d81-9eb1-02f7b2fa1991 tempest-ServerRescueNegativeTestJSON-1033903955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e508389-5148-4a17-9746-a8e1eeae33be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:41:48 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-6bb6301f-977f-4d81-9eb1-02f7b2fa1991 tempest-ServerRescueNegativeTestJSON-1033903955 None] Volume ef2e6e1a-51d2-470e-9a55-cbc8d967208c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef2e6e1a-51d2-470e-9a55-cbc8d967208c', 'volume_size': 1} Sep 10 16:41:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6bb6301f-977f-4d81-9eb1-02f7b2fa1991 tempest-ServerRescueNegativeTestJSON-1033903955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:41:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6bb6301f-977f-4d81-9eb1-02f7b2fa1991 tempest-ServerRescueNegativeTestJSON-1033903955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:41:48 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6bb6301f-977f-4d81-9eb1-02f7b2fa1991 tempest-ServerRescueNegativeTestJSON-1033903955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-64897801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef2e6e1a-51d2-470e-9a55-cbc8d967208c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='441cdc2e393e47a1a2f900c77ed7eaf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:41:48Z,use_quota=True,user_id='115971bcc82941a8981534f99b24447c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:41:48 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-6bb6301f-977f-4d81-9eb1-02f7b2fa1991 tempest-ServerRescueNegativeTestJSON-1033903955 None] Creating volume ef2e6e1a-51d2-470e-9a55-cbc8d967208c {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:41:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6bb6301f-977f-4d81-9eb1-02f7b2fa1991 tempest-ServerRescueNegativeTestJSON-1033903955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:41:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6bb6301f-977f-4d81-9eb1-02f7b2fa1991 tempest-ServerRescueNegativeTestJSON-1033903955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:41:48 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6bb6301f-977f-4d81-9eb1-02f7b2fa1991 tempest-ServerRescueNegativeTestJSON-1033903955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:41:48 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6bb6301f-977f-4d81-9eb1-02f7b2fa1991 tempest-ServerRescueNegativeTestJSON-1033903955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:41:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6bb6301f-977f-4d81-9eb1-02f7b2fa1991 tempest-ServerRescueNegativeTestJSON-1033903955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:41:48 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6bb6301f-977f-4d81-9eb1-02f7b2fa1991 tempest-ServerRescueNegativeTestJSON-1033903955 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:41:48 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-6bb6301f-977f-4d81-9eb1-02f7b2fa1991 tempest-ServerRescueNegativeTestJSON-1033903955 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:41:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6bb6301f-977f-4d81-9eb1-02f7b2fa1991 tempest-ServerRescueNegativeTestJSON-1033903955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ef2e6e1a-51d2-470e-9a55-cbc8d967208c 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:41:48 devstack sudo[92561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ef2e6e1a-51d2-470e-9a55-cbc8d967208c 1073741824 Sep 10 16:41:48 devstack sudo[92561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:41:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:41:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:41:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:41:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:41:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:41:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:41:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:41:49 devstack sudo[92590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:41:49 devstack sudo[92590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:41:49 devstack sudo[92561]: pam_unix(sudo:session): session closed for user root Sep 10 16:41:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6bb6301f-977f-4d81-9eb1-02f7b2fa1991 tempest-ServerRescueNegativeTestJSON-1033903955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ef2e6e1a-51d2-470e-9a55-cbc8d967208c 1073741824" returned: 0 in 1.144s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:41:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6bb6301f-977f-4d81-9eb1-02f7b2fa1991 tempest-ServerRescueNegativeTestJSON-1033903955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ef2e6e1a-51d2-470e-9a55-cbc8d967208c {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:41:49 devstack sudo[92592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ef2e6e1a-51d2-470e-9a55-cbc8d967208c Sep 10 16:41:49 devstack sudo[92592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:41:50 devstack sudo[92590]: pam_unix(sudo:session): session closed for user root Sep 10 16:41:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 1.081s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:41:50 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:41:50 devstack sudo[92592]: pam_unix(sudo:session): session closed for user root Sep 10 16:41:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6bb6301f-977f-4d81-9eb1-02f7b2fa1991 tempest-ServerRescueNegativeTestJSON-1033903955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ef2e6e1a-51d2-470e-9a55-cbc8d967208c" returned: 0 in 0.918s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:41:50 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6bb6301f-977f-4d81-9eb1-02f7b2fa1991 tempest-ServerRescueNegativeTestJSON-1033903955 None] <== create_volume: return (2216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:41:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6bb6301f-977f-4d81-9eb1-02f7b2fa1991 tempest-ServerRescueNegativeTestJSON-1033903955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.222s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:41:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6bb6301f-977f-4d81-9eb1-02f7b2fa1991 tempest-ServerRescueNegativeTestJSON-1033903955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e508389-5148-4a17-9746-a8e1eeae33be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef2e6e1a-51d2-470e-9a55-cbc8d967208c', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:41:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6bb6301f-977f-4d81-9eb1-02f7b2fa1991 tempest-ServerRescueNegativeTestJSON-1033903955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a3bc9c-3bb0-4f1f-b6e9-b4fc7e7bc2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:41:50 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-6bb6301f-977f-4d81-9eb1-02f7b2fa1991 tempest-ServerRescueNegativeTestJSON-1033903955 None] Volume volume-ef2e6e1a-51d2-470e-9a55-cbc8d967208c (ef2e6e1a-51d2-470e-9a55-cbc8d967208c): created successfully Sep 10 16:41:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6bb6301f-977f-4d81-9eb1-02f7b2fa1991 tempest-ServerRescueNegativeTestJSON-1033903955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a3bc9c-3bb0-4f1f-b6e9-b4fc7e7bc2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:41:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6bb6301f-977f-4d81-9eb1-02f7b2fa1991 tempest-ServerRescueNegativeTestJSON-1033903955 None] Flow 'volume_create_manager' (92f20b0d-7545-498a-86e7-fe2e39d337c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:41:51 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-6bb6301f-977f-4d81-9eb1-02f7b2fa1991 tempest-ServerRescueNegativeTestJSON-1033903955 None] Created volume successfully. Sep 10 16:41:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-db1ebfe3-106f-4bc5-bb14-2ad9857accc9 req-266dffa1-2752-4756-975a-7c85ebb1bf6f tempest-ServerActionsTestOtherA-1184087604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:41:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-db1ebfe3-106f-4bc5-bb14-2ad9857accc9 req-266dffa1-2752-4756-975a-7c85ebb1bf6f tempest-ServerActionsTestOtherA-1184087604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:41:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-db1ebfe3-106f-4bc5-bb14-2ad9857accc9 req-266dffa1-2752-4756-975a-7c85ebb1bf6f tempest-ServerActionsTestOtherA-1184087604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:41:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-db1ebfe3-106f-4bc5-bb14-2ad9857accc9 req-266dffa1-2752-4756-975a-7c85ebb1bf6f tempest-ServerActionsTestOtherA-1184087604 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8', 'name': 'volume-ce94a601-0c26-4b81-9061-683e09cb1f75', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b031549b-1657-46bf-8b80-69318a926d2e', 'enforce_multipath': True} {{(pid=88189) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 16:41:58 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-db1ebfe3-106f-4bc5-bb14-2ad9857accc9 req-266dffa1-2752-4756-975a-7c85ebb1bf6f tempest-ServerActionsTestOtherA-1184087604 None] attachment_update completed successfully. Sep 10 16:42:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bccc5e4d-560c-4569-9431-f02c83db5b83 tempest-AttachVolumeShelveTestJSON-1242629616 None] Acquiring lock "cinder-6103518b-bea9-4321-84a5-10b0ad2f04fc-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:42:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bccc5e4d-560c-4569-9431-f02c83db5b83 tempest-AttachVolumeShelveTestJSON-1242629616 None] Lock "cinder-6103518b-bea9-4321-84a5-10b0ad2f04fc-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:42:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bccc5e4d-560c-4569-9431-f02c83db5b83 tempest-AttachVolumeShelveTestJSON-1242629616 None] Acquiring lock "cinder-quobyte-6103518b-bea9-4321-84a5-10b0ad2f04fc" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:42:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bccc5e4d-560c-4569-9431-f02c83db5b83 tempest-AttachVolumeShelveTestJSON-1242629616 None] Lock "cinder-quobyte-6103518b-bea9-4321-84a5-10b0ad2f04fc" acquired by "delete_volume" :: waited 0.061s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:42:03 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9464cece-f83e-474f-9a19-810a2e7efa1e]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:42:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bccc5e4d-560c-4569-9431-f02c83db5b83 tempest-AttachVolumeShelveTestJSON-1242629616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6103518b-bea9-4321-84a5-10b0ad2f04fc {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:42:03 devstack sudo[92689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6103518b-bea9-4321-84a5-10b0ad2f04fc Sep 10 16:42:03 devstack sudo[92689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:42:03 devstack sudo[92689]: pam_unix(sudo:session): session closed for user root Sep 10 16:42:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bccc5e4d-560c-4569-9431-f02c83db5b83 tempest-AttachVolumeShelveTestJSON-1242629616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6103518b-bea9-4321-84a5-10b0ad2f04fc" returned: 0 in 0.874s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:42:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bccc5e4d-560c-4569-9431-f02c83db5b83 tempest-AttachVolumeShelveTestJSON-1242629616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6103518b-bea9-4321-84a5-10b0ad2f04fc {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:42:04 devstack sudo[92725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6103518b-bea9-4321-84a5-10b0ad2f04fc Sep 10 16:42:04 devstack sudo[92725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:42:05 devstack sudo[92725]: pam_unix(sudo:session): session closed for user root Sep 10 16:42:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bccc5e4d-560c-4569-9431-f02c83db5b83 tempest-AttachVolumeShelveTestJSON-1242629616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6103518b-bea9-4321-84a5-10b0ad2f04fc" returned: 0 in 1.039s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:42:05 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bccc5e4d-560c-4569-9431-f02c83db5b83 tempest-AttachVolumeShelveTestJSON-1242629616 None] Lock "cinder-quobyte-6103518b-bea9-4321-84a5-10b0ad2f04fc" released by "delete_volume" :: held 2.027s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:42:05 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-bccc5e4d-560c-4569-9431-f02c83db5b83 tempest-AttachVolumeShelveTestJSON-1242629616 None] Created reservations ['995f6b25-7ab8-47ff-af22-23f36884c989', '4c44f9d6-ccb5-4022-a3c7-88c95e5e8a86', 'a32b1146-b93f-4df5-bfe7-ffd037a62374', 'b11a8682-375f-49b9-9e2e-886e2187d033'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:42:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-bccc5e4d-560c-4569-9431-f02c83db5b83 tempest-AttachVolumeShelveTestJSON-1242629616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:42:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-bccc5e4d-560c-4569-9431-f02c83db5b83 tempest-AttachVolumeShelveTestJSON-1242629616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:42:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-bccc5e4d-560c-4569-9431-f02c83db5b83 tempest-AttachVolumeShelveTestJSON-1242629616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:42:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-bccc5e4d-560c-4569-9431-f02c83db5b83 tempest-AttachVolumeShelveTestJSON-1242629616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:42:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-bccc5e4d-560c-4569-9431-f02c83db5b83 tempest-AttachVolumeShelveTestJSON-1242629616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:42:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bccc5e4d-560c-4569-9431-f02c83db5b83 tempest-AttachVolumeShelveTestJSON-1242629616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:42:05 devstack sudo[92811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:42:05 devstack sudo[92811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:42:06 devstack sudo[92811]: pam_unix(sudo:session): session closed for user root Sep 10 16:42:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bccc5e4d-560c-4569-9431-f02c83db5b83 tempest-AttachVolumeShelveTestJSON-1242629616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.900s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:42:06 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-bccc5e4d-560c-4569-9431-f02c83db5b83 tempest-AttachVolumeShelveTestJSON-1242629616 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:42:06 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-bccc5e4d-560c-4569-9431-f02c83db5b83 tempest-AttachVolumeShelveTestJSON-1242629616 None] Deleted volume successfully. Sep 10 16:42:06 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bccc5e4d-560c-4569-9431-f02c83db5b83 tempest-AttachVolumeShelveTestJSON-1242629616 None] Lock "cinder-6103518b-bea9-4321-84a5-10b0ad2f04fc-delete_volume" released by "delete_volume" :: held 3.628s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:42:15 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=20,cinder:INSERT=10,cinder:UPDATE=18,cinder:DELETE=2 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:42:16 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:UPDATE=17,cinder:SELECT=27,cinder:INSERT=9,cinder:DELETE=1 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:42:21 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddc8958b-32a0-4b52-9911-47b763cd279d tempest-ServersNegativeTestJSON-903641859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:42:21 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ddc8958b-32a0-4b52-9911-47b763cd279d tempest-ServersNegativeTestJSON-903641859 None] Flow 'volume_create_manager' (525b359f-9cf2-4205-b902-077d7bd6697f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:42:21 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ddc8958b-32a0-4b52-9911-47b763cd279d tempest-ServersNegativeTestJSON-903641859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0e3f170-77a7-4eea-b058-d6bea8ea2c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:42:21 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ddc8958b-32a0-4b52-9911-47b763cd279d tempest-ServersNegativeTestJSON-903641859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0e3f170-77a7-4eea-b058-d6bea8ea2c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-343037062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7c8ce58-2977-4f57-9a18-81d0121f2ab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6a71eaea91b4a5ab88ba34a00c5df46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:42:21Z,use_quota=True,user_id='b84299a7fa0b411d91efd7522d52c65d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:42:21 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ddc8958b-32a0-4b52-9911-47b763cd279d tempest-ServersNegativeTestJSON-903641859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf0ccb2a-d15e-41bf-b1b8-496740a5a94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:42:21 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ddc8958b-32a0-4b52-9911-47b763cd279d tempest-ServersNegativeTestJSON-903641859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf0ccb2a-d15e-41bf-b1b8-496740a5a94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:42:21 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ddc8958b-32a0-4b52-9911-47b763cd279d tempest-ServersNegativeTestJSON-903641859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deb3a133-6a9a-4204-b5a7-8eb39d5348d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:42:21 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ddc8958b-32a0-4b52-9911-47b763cd279d tempest-ServersNegativeTestJSON-903641859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deb3a133-6a9a-4204-b5a7-8eb39d5348d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7c8ce58-2977-4f57-9a18-81d0121f2ab1', 'volume_name': 'volume-e7c8ce58-2977-4f57-9a18-81d0121f2ab1', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:42:21 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ddc8958b-32a0-4b52-9911-47b763cd279d tempest-ServersNegativeTestJSON-903641859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b53dae-af97-4a45-912d-97cb77e6eb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:42:21 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ddc8958b-32a0-4b52-9911-47b763cd279d tempest-ServersNegativeTestJSON-903641859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b53dae-af97-4a45-912d-97cb77e6eb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:42:21 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ddc8958b-32a0-4b52-9911-47b763cd279d tempest-ServersNegativeTestJSON-903641859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (198969ca-3c1a-43ef-8c19-c200ea4460bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:42:21 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-ddc8958b-32a0-4b52-9911-47b763cd279d tempest-ServersNegativeTestJSON-903641859 None] Volume e7c8ce58-2977-4f57-9a18-81d0121f2ab1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7c8ce58-2977-4f57-9a18-81d0121f2ab1', 'volume_size': 1} Sep 10 16:42:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ddc8958b-32a0-4b52-9911-47b763cd279d tempest-ServersNegativeTestJSON-903641859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:42:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ddc8958b-32a0-4b52-9911-47b763cd279d tempest-ServersNegativeTestJSON-903641859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:42:21 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ddc8958b-32a0-4b52-9911-47b763cd279d tempest-ServersNegativeTestJSON-903641859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-343037062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7c8ce58-2977-4f57-9a18-81d0121f2ab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6a71eaea91b4a5ab88ba34a00c5df46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:42:21Z,use_quota=True,user_id='b84299a7fa0b411d91efd7522d52c65d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:42:21 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-ddc8958b-32a0-4b52-9911-47b763cd279d tempest-ServersNegativeTestJSON-903641859 None] Creating volume e7c8ce58-2977-4f57-9a18-81d0121f2ab1 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:42:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ddc8958b-32a0-4b52-9911-47b763cd279d tempest-ServersNegativeTestJSON-903641859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:42:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ddc8958b-32a0-4b52-9911-47b763cd279d tempest-ServersNegativeTestJSON-903641859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:42:21 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ddc8958b-32a0-4b52-9911-47b763cd279d tempest-ServersNegativeTestJSON-903641859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:42:21 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ddc8958b-32a0-4b52-9911-47b763cd279d tempest-ServersNegativeTestJSON-903641859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:42:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ddc8958b-32a0-4b52-9911-47b763cd279d tempest-ServersNegativeTestJSON-903641859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:42:21 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ddc8958b-32a0-4b52-9911-47b763cd279d tempest-ServersNegativeTestJSON-903641859 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:42:21 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-ddc8958b-32a0-4b52-9911-47b763cd279d tempest-ServersNegativeTestJSON-903641859 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:42:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ddc8958b-32a0-4b52-9911-47b763cd279d tempest-ServersNegativeTestJSON-903641859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e7c8ce58-2977-4f57-9a18-81d0121f2ab1 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:42:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-0765ba43-c57f-44cd-9256-add3c88035de tempest-ServerRescueNegativeTestJSON-1033903955 None] Acquiring lock "cinder-ef2e6e1a-51d2-470e-9a55-cbc8d967208c-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:42:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-0765ba43-c57f-44cd-9256-add3c88035de tempest-ServerRescueNegativeTestJSON-1033903955 None] Lock "cinder-ef2e6e1a-51d2-470e-9a55-cbc8d967208c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:42:21 devstack sudo[93330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e7c8ce58-2977-4f57-9a18-81d0121f2ab1 1073741824 Sep 10 16:42:21 devstack sudo[93330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:42:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-0765ba43-c57f-44cd-9256-add3c88035de tempest-ServerRescueNegativeTestJSON-1033903955 None] Acquiring lock "cinder-quobyte-ef2e6e1a-51d2-470e-9a55-cbc8d967208c" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:42:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-0765ba43-c57f-44cd-9256-add3c88035de tempest-ServerRescueNegativeTestJSON-1033903955 None] Lock "cinder-quobyte-ef2e6e1a-51d2-470e-9a55-cbc8d967208c" acquired by "delete_volume" :: waited 0.035s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:42:21 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c0ec76-b5c0-4d8a-82ab-b6192039ad46]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:42:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0765ba43-c57f-44cd-9256-add3c88035de tempest-ServerRescueNegativeTestJSON-1033903955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ef2e6e1a-51d2-470e-9a55-cbc8d967208c {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:42:21 devstack sudo[93332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ef2e6e1a-51d2-470e-9a55-cbc8d967208c Sep 10 16:42:21 devstack sudo[93332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:42:22 devstack sudo[93330]: pam_unix(sudo:session): session closed for user root Sep 10 16:42:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ddc8958b-32a0-4b52-9911-47b763cd279d tempest-ServersNegativeTestJSON-903641859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e7c8ce58-2977-4f57-9a18-81d0121f2ab1 1073741824" returned: 0 in 1.199s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:42:22 devstack sudo[93332]: pam_unix(sudo:session): session closed for user root Sep 10 16:42:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0765ba43-c57f-44cd-9256-add3c88035de tempest-ServerRescueNegativeTestJSON-1033903955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ef2e6e1a-51d2-470e-9a55-cbc8d967208c" returned: 0 in 1.092s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:42:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0765ba43-c57f-44cd-9256-add3c88035de tempest-ServerRescueNegativeTestJSON-1033903955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ef2e6e1a-51d2-470e-9a55-cbc8d967208c {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:42:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ddc8958b-32a0-4b52-9911-47b763cd279d tempest-ServersNegativeTestJSON-903641859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e7c8ce58-2977-4f57-9a18-81d0121f2ab1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:42:22 devstack sudo[93341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ef2e6e1a-51d2-470e-9a55-cbc8d967208c Sep 10 16:42:22 devstack sudo[93341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:42:22 devstack sudo[93342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e7c8ce58-2977-4f57-9a18-81d0121f2ab1 Sep 10 16:42:22 devstack sudo[93342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:42:23 devstack sudo[93342]: pam_unix(sudo:session): session closed for user root Sep 10 16:42:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ddc8958b-32a0-4b52-9911-47b763cd279d tempest-ServersNegativeTestJSON-903641859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e7c8ce58-2977-4f57-9a18-81d0121f2ab1" returned: 0 in 0.692s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:42:23 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ddc8958b-32a0-4b52-9911-47b763cd279d tempest-ServersNegativeTestJSON-903641859 None] <== create_volume: return (2084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:42:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ddc8958b-32a0-4b52-9911-47b763cd279d tempest-ServersNegativeTestJSON-903641859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.087s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:42:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ddc8958b-32a0-4b52-9911-47b763cd279d tempest-ServersNegativeTestJSON-903641859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (198969ca-3c1a-43ef-8c19-c200ea4460bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7c8ce58-2977-4f57-9a18-81d0121f2ab1', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:42:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ddc8958b-32a0-4b52-9911-47b763cd279d tempest-ServersNegativeTestJSON-903641859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dabce74-5af7-43cb-835a-1a9ac7e3ba4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:42:23 devstack sudo[93341]: pam_unix(sudo:session): session closed for user root Sep 10 16:42:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0765ba43-c57f-44cd-9256-add3c88035de tempest-ServerRescueNegativeTestJSON-1033903955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ef2e6e1a-51d2-470e-9a55-cbc8d967208c" returned: 0 in 1.003s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:42:23 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-ddc8958b-32a0-4b52-9911-47b763cd279d tempest-ServersNegativeTestJSON-903641859 None] Volume volume-e7c8ce58-2977-4f57-9a18-81d0121f2ab1 (e7c8ce58-2977-4f57-9a18-81d0121f2ab1): created successfully Sep 10 16:42:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ddc8958b-32a0-4b52-9911-47b763cd279d tempest-ServersNegativeTestJSON-903641859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dabce74-5af7-43cb-835a-1a9ac7e3ba4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:42:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ddc8958b-32a0-4b52-9911-47b763cd279d tempest-ServersNegativeTestJSON-903641859 None] Flow 'volume_create_manager' (525b359f-9cf2-4205-b902-077d7bd6697f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:42:23 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-0765ba43-c57f-44cd-9256-add3c88035de tempest-ServerRescueNegativeTestJSON-1033903955 None] Lock "cinder-quobyte-ef2e6e1a-51d2-470e-9a55-cbc8d967208c" released by "delete_volume" :: held 2.282s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:42:23 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-ddc8958b-32a0-4b52-9911-47b763cd279d tempest-ServersNegativeTestJSON-903641859 None] Created volume successfully. Sep 10 16:42:24 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-0765ba43-c57f-44cd-9256-add3c88035de tempest-ServerRescueNegativeTestJSON-1033903955 None] Created reservations ['2db5eaa5-1b83-472a-8c68-fbf613fb009e', '3fd360c7-8e77-4aec-b5a3-54137c776bb4', 'b35f1ff5-6833-4481-9ff0-400651189f4b', '94822507-bac5-415b-8a62-b92b1a14f19b'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:42:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0765ba43-c57f-44cd-9256-add3c88035de tempest-ServerRescueNegativeTestJSON-1033903955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:42:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0765ba43-c57f-44cd-9256-add3c88035de tempest-ServerRescueNegativeTestJSON-1033903955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:42:24 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0765ba43-c57f-44cd-9256-add3c88035de tempest-ServerRescueNegativeTestJSON-1033903955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:42:24 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0765ba43-c57f-44cd-9256-add3c88035de tempest-ServerRescueNegativeTestJSON-1033903955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:42:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0765ba43-c57f-44cd-9256-add3c88035de tempest-ServerRescueNegativeTestJSON-1033903955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:42:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0765ba43-c57f-44cd-9256-add3c88035de tempest-ServerRescueNegativeTestJSON-1033903955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:42:24 devstack sudo[93355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:42:24 devstack sudo[93355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:42:25 devstack sudo[93355]: pam_unix(sudo:session): session closed for user root Sep 10 16:42:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0765ba43-c57f-44cd-9256-add3c88035de tempest-ServerRescueNegativeTestJSON-1033903955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.644s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:42:25 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-0765ba43-c57f-44cd-9256-add3c88035de tempest-ServerRescueNegativeTestJSON-1033903955 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:42:25 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-0765ba43-c57f-44cd-9256-add3c88035de tempest-ServerRescueNegativeTestJSON-1033903955 None] Deleted volume successfully. Sep 10 16:42:25 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-0765ba43-c57f-44cd-9256-add3c88035de tempest-ServerRescueNegativeTestJSON-1033903955 None] Lock "cinder-ef2e6e1a-51d2-470e-9a55-cbc8d967208c-delete_volume" released by "delete_volume" :: held 3.742s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:42:31 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-523ce428-01b6-4f57-b80a-18ca5d85c152 tempest-ServersNegativeTestJSON-903641859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:42:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-523ce428-01b6-4f57-b80a-18ca5d85c152 tempest-ServersNegativeTestJSON-903641859 None] Flow 'volume_create_manager' (8280ac60-5058-488e-8eeb-53673e543c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:42:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-523ce428-01b6-4f57-b80a-18ca5d85c152 tempest-ServersNegativeTestJSON-903641859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (843d14ae-62df-4b26-bcd5-94a463bb4f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:42:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-523ce428-01b6-4f57-b80a-18ca5d85c152 tempest-ServersNegativeTestJSON-903641859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (843d14ae-62df-4b26-bcd5-94a463bb4f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1726545404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8585359-cbfb-4ed1-af7f-a3d2f7381960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6a71eaea91b4a5ab88ba34a00c5df46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:42:32Z,use_quota=True,user_id='b84299a7fa0b411d91efd7522d52c65d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:42:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-523ce428-01b6-4f57-b80a-18ca5d85c152 tempest-ServersNegativeTestJSON-903641859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2fff758-5539-438f-a177-6cff8d5a44c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:42:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-523ce428-01b6-4f57-b80a-18ca5d85c152 tempest-ServersNegativeTestJSON-903641859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2fff758-5539-438f-a177-6cff8d5a44c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:42:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-523ce428-01b6-4f57-b80a-18ca5d85c152 tempest-ServersNegativeTestJSON-903641859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2240461-8001-4120-a30f-02f3d4ac8dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:42:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-523ce428-01b6-4f57-b80a-18ca5d85c152 tempest-ServersNegativeTestJSON-903641859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2240461-8001-4120-a30f-02f3d4ac8dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8585359-cbfb-4ed1-af7f-a3d2f7381960', 'volume_name': 'volume-e8585359-cbfb-4ed1-af7f-a3d2f7381960', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:42:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-523ce428-01b6-4f57-b80a-18ca5d85c152 tempest-ServersNegativeTestJSON-903641859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a370ce1-e1a7-4a25-9b3b-7479a3732acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:42:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-523ce428-01b6-4f57-b80a-18ca5d85c152 tempest-ServersNegativeTestJSON-903641859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a370ce1-e1a7-4a25-9b3b-7479a3732acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:42:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-523ce428-01b6-4f57-b80a-18ca5d85c152 tempest-ServersNegativeTestJSON-903641859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be567838-2617-4b73-9994-ac8e0d199de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:42:31 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-523ce428-01b6-4f57-b80a-18ca5d85c152 tempest-ServersNegativeTestJSON-903641859 None] Volume e8585359-cbfb-4ed1-af7f-a3d2f7381960: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8585359-cbfb-4ed1-af7f-a3d2f7381960', 'volume_size': 1} Sep 10 16:42:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-523ce428-01b6-4f57-b80a-18ca5d85c152 tempest-ServersNegativeTestJSON-903641859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:42:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-523ce428-01b6-4f57-b80a-18ca5d85c152 tempest-ServersNegativeTestJSON-903641859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:42:31 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-523ce428-01b6-4f57-b80a-18ca5d85c152 tempest-ServersNegativeTestJSON-903641859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1726545404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8585359-cbfb-4ed1-af7f-a3d2f7381960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6a71eaea91b4a5ab88ba34a00c5df46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:42:32Z,use_quota=True,user_id='b84299a7fa0b411d91efd7522d52c65d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:42:31 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-523ce428-01b6-4f57-b80a-18ca5d85c152 tempest-ServersNegativeTestJSON-903641859 None] Creating volume e8585359-cbfb-4ed1-af7f-a3d2f7381960 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:42:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-523ce428-01b6-4f57-b80a-18ca5d85c152 tempest-ServersNegativeTestJSON-903641859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:42:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-523ce428-01b6-4f57-b80a-18ca5d85c152 tempest-ServersNegativeTestJSON-903641859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:42:31 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-523ce428-01b6-4f57-b80a-18ca5d85c152 tempest-ServersNegativeTestJSON-903641859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:42:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-523ce428-01b6-4f57-b80a-18ca5d85c152 tempest-ServersNegativeTestJSON-903641859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:42:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-523ce428-01b6-4f57-b80a-18ca5d85c152 tempest-ServersNegativeTestJSON-903641859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:42:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-523ce428-01b6-4f57-b80a-18ca5d85c152 tempest-ServersNegativeTestJSON-903641859 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:42:32 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-523ce428-01b6-4f57-b80a-18ca5d85c152 tempest-ServersNegativeTestJSON-903641859 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:42:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-523ce428-01b6-4f57-b80a-18ca5d85c152 tempest-ServersNegativeTestJSON-903641859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e8585359-cbfb-4ed1-af7f-a3d2f7381960 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:42:32 devstack sudo[93437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e8585359-cbfb-4ed1-af7f-a3d2f7381960 1073741824 Sep 10 16:42:32 devstack sudo[93437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:42:32 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-a467fa31-ba70-40c1-8ca6-9e7f24aa8f21 req-bae414ba-1783-4160-a8e2-eff9cb3e34ae tempest-ServerActionsTestOtherA-1184087604 None] Terminate volume connection completed successfully. Sep 10 16:42:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-a467fa31-ba70-40c1-8ca6-9e7f24aa8f21 req-bae414ba-1783-4160-a8e2-eff9cb3e34ae tempest-ServerActionsTestOtherA-1184087604 None] Deleting attachment b031549b-1657-46bf-8b80-69318a926d2e. {{(pid=88189) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 16:42:32 devstack sudo[93437]: pam_unix(sudo:session): session closed for user root Sep 10 16:42:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-523ce428-01b6-4f57-b80a-18ca5d85c152 tempest-ServersNegativeTestJSON-903641859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e8585359-cbfb-4ed1-af7f-a3d2f7381960 1073741824" returned: 0 in 0.975s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:42:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-523ce428-01b6-4f57-b80a-18ca5d85c152 tempest-ServersNegativeTestJSON-903641859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e8585359-cbfb-4ed1-af7f-a3d2f7381960 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:42:33 devstack sudo[93465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e8585359-cbfb-4ed1-af7f-a3d2f7381960 Sep 10 16:42:33 devstack sudo[93465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:42:33 devstack sudo[93465]: pam_unix(sudo:session): session closed for user root Sep 10 16:42:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-523ce428-01b6-4f57-b80a-18ca5d85c152 tempest-ServersNegativeTestJSON-903641859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e8585359-cbfb-4ed1-af7f-a3d2f7381960" returned: 0 in 0.297s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:42:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-523ce428-01b6-4f57-b80a-18ca5d85c152 tempest-ServersNegativeTestJSON-903641859 None] <== create_volume: return (1366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:42:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-523ce428-01b6-4f57-b80a-18ca5d85c152 tempest-ServersNegativeTestJSON-903641859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.371s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:42:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-523ce428-01b6-4f57-b80a-18ca5d85c152 tempest-ServersNegativeTestJSON-903641859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be567838-2617-4b73-9994-ac8e0d199de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8585359-cbfb-4ed1-af7f-a3d2f7381960', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:42:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-523ce428-01b6-4f57-b80a-18ca5d85c152 tempest-ServersNegativeTestJSON-903641859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd6cf8d6-d2ef-4823-9e07-2fb5628e9984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:42:33 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-523ce428-01b6-4f57-b80a-18ca5d85c152 tempest-ServersNegativeTestJSON-903641859 None] Volume volume-e8585359-cbfb-4ed1-af7f-a3d2f7381960 (e8585359-cbfb-4ed1-af7f-a3d2f7381960): created successfully Sep 10 16:42:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-523ce428-01b6-4f57-b80a-18ca5d85c152 tempest-ServersNegativeTestJSON-903641859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd6cf8d6-d2ef-4823-9e07-2fb5628e9984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:42:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-523ce428-01b6-4f57-b80a-18ca5d85c152 tempest-ServersNegativeTestJSON-903641859 None] Flow 'volume_create_manager' (8280ac60-5058-488e-8eeb-53673e543c55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:42:33 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-523ce428-01b6-4f57-b80a-18ca5d85c152 tempest-ServersNegativeTestJSON-903641859 None] Created volume successfully. Sep 10 16:42:34 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-ce248254-f30e-4324-967a-b9b6b8065b40 tempest-ServersNegativeTestJSON-903641859 None] Acquiring lock "cinder-e8585359-cbfb-4ed1-af7f-a3d2f7381960-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:42:34 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-ce248254-f30e-4324-967a-b9b6b8065b40 tempest-ServersNegativeTestJSON-903641859 None] Lock "cinder-e8585359-cbfb-4ed1-af7f-a3d2f7381960-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:42:34 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-ce248254-f30e-4324-967a-b9b6b8065b40 tempest-ServersNegativeTestJSON-903641859 None] Acquiring lock "cinder-quobyte-e8585359-cbfb-4ed1-af7f-a3d2f7381960" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:42:34 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-ce248254-f30e-4324-967a-b9b6b8065b40 tempest-ServersNegativeTestJSON-903641859 None] Lock "cinder-quobyte-e8585359-cbfb-4ed1-af7f-a3d2f7381960" acquired by "delete_volume" :: waited 0.029s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:42:34 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf11416-9072-4196-93ed-0056cc83096c]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:42:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ce248254-f30e-4324-967a-b9b6b8065b40 tempest-ServersNegativeTestJSON-903641859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e8585359-cbfb-4ed1-af7f-a3d2f7381960 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:42:34 devstack sudo[93471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e8585359-cbfb-4ed1-af7f-a3d2f7381960 Sep 10 16:42:34 devstack sudo[93471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:42:35 devstack sudo[93471]: pam_unix(sudo:session): session closed for user root Sep 10 16:42:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ce248254-f30e-4324-967a-b9b6b8065b40 tempest-ServersNegativeTestJSON-903641859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e8585359-cbfb-4ed1-af7f-a3d2f7381960" returned: 0 in 0.445s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:42:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ce248254-f30e-4324-967a-b9b6b8065b40 tempest-ServersNegativeTestJSON-903641859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e8585359-cbfb-4ed1-af7f-a3d2f7381960 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:42:35 devstack sudo[93476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e8585359-cbfb-4ed1-af7f-a3d2f7381960 Sep 10 16:42:35 devstack sudo[93476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:42:35 devstack sudo[93476]: pam_unix(sudo:session): session closed for user root Sep 10 16:42:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ce248254-f30e-4324-967a-b9b6b8065b40 tempest-ServersNegativeTestJSON-903641859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e8585359-cbfb-4ed1-af7f-a3d2f7381960" returned: 0 in 0.257s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:42:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-ce248254-f30e-4324-967a-b9b6b8065b40 tempest-ServersNegativeTestJSON-903641859 None] Lock "cinder-quobyte-e8585359-cbfb-4ed1-af7f-a3d2f7381960" released by "delete_volume" :: held 0.752s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:42:35 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-ce248254-f30e-4324-967a-b9b6b8065b40 tempest-ServersNegativeTestJSON-903641859 None] Created reservations ['c7eddc18-fa52-4383-baf7-98d713a8795c', 'dd9d6505-d116-4d13-a34b-2e977a6027e5', '8fddb2c5-7d88-4984-8ae9-c003c69b7e71', '37b4a9b5-8ed1-4836-a273-59be5474aaf2'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:42:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ce248254-f30e-4324-967a-b9b6b8065b40 tempest-ServersNegativeTestJSON-903641859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:42:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ce248254-f30e-4324-967a-b9b6b8065b40 tempest-ServersNegativeTestJSON-903641859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:42:35 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ce248254-f30e-4324-967a-b9b6b8065b40 tempest-ServersNegativeTestJSON-903641859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:42:35 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ce248254-f30e-4324-967a-b9b6b8065b40 tempest-ServersNegativeTestJSON-903641859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:42:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ce248254-f30e-4324-967a-b9b6b8065b40 tempest-ServersNegativeTestJSON-903641859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:42:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ce248254-f30e-4324-967a-b9b6b8065b40 tempest-ServersNegativeTestJSON-903641859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:42:35 devstack sudo[93479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:42:35 devstack sudo[93479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:42:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-480a3f3e-63f6-4295-a1dd-e95fde216c35 tempest-ServersNegativeTestJSON-903641859 None] Acquiring lock "cinder-e7c8ce58-2977-4f57-9a18-81d0121f2ab1-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:42:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-480a3f3e-63f6-4295-a1dd-e95fde216c35 tempest-ServersNegativeTestJSON-903641859 None] Lock "cinder-e7c8ce58-2977-4f57-9a18-81d0121f2ab1-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:42:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-480a3f3e-63f6-4295-a1dd-e95fde216c35 tempest-ServersNegativeTestJSON-903641859 None] Acquiring lock "cinder-quobyte-e7c8ce58-2977-4f57-9a18-81d0121f2ab1" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:42:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-480a3f3e-63f6-4295-a1dd-e95fde216c35 tempest-ServersNegativeTestJSON-903641859 None] Lock "cinder-quobyte-e7c8ce58-2977-4f57-9a18-81d0121f2ab1" acquired by "delete_volume" :: waited 0.024s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:42:36 devstack sudo[93479]: pam_unix(sudo:session): session closed for user root Sep 10 16:42:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ce248254-f30e-4324-967a-b9b6b8065b40 tempest-ServersNegativeTestJSON-903641859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.392s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:42:36 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-ce248254-f30e-4324-967a-b9b6b8065b40 tempest-ServersNegativeTestJSON-903641859 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:42:36 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0d8038-27dd-4d8c-89cf-f2c1ba26cc06]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:42:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-480a3f3e-63f6-4295-a1dd-e95fde216c35 tempest-ServersNegativeTestJSON-903641859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e7c8ce58-2977-4f57-9a18-81d0121f2ab1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:42:36 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-ce248254-f30e-4324-967a-b9b6b8065b40 tempest-ServersNegativeTestJSON-903641859 None] Deleted volume successfully. Sep 10 16:42:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-ce248254-f30e-4324-967a-b9b6b8065b40 tempest-ServersNegativeTestJSON-903641859 None] Lock "cinder-e8585359-cbfb-4ed1-af7f-a3d2f7381960-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:42:36 devstack sudo[93482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e7c8ce58-2977-4f57-9a18-81d0121f2ab1 Sep 10 16:42:36 devstack sudo[93482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:42:36 devstack sudo[93482]: pam_unix(sudo:session): session closed for user root Sep 10 16:42:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-480a3f3e-63f6-4295-a1dd-e95fde216c35 tempest-ServersNegativeTestJSON-903641859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e7c8ce58-2977-4f57-9a18-81d0121f2ab1" returned: 0 in 0.492s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:42:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-480a3f3e-63f6-4295-a1dd-e95fde216c35 tempest-ServersNegativeTestJSON-903641859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e7c8ce58-2977-4f57-9a18-81d0121f2ab1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:42:36 devstack sudo[93487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e7c8ce58-2977-4f57-9a18-81d0121f2ab1 Sep 10 16:42:36 devstack sudo[93487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:42:36 devstack sudo[93487]: pam_unix(sudo:session): session closed for user root Sep 10 16:42:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-480a3f3e-63f6-4295-a1dd-e95fde216c35 tempest-ServersNegativeTestJSON-903641859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e7c8ce58-2977-4f57-9a18-81d0121f2ab1" returned: 0 in 0.307s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:42:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-480a3f3e-63f6-4295-a1dd-e95fde216c35 tempest-ServersNegativeTestJSON-903641859 None] Lock "cinder-quobyte-e7c8ce58-2977-4f57-9a18-81d0121f2ab1" released by "delete_volume" :: held 0.864s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:42:36 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-480a3f3e-63f6-4295-a1dd-e95fde216c35 tempest-ServersNegativeTestJSON-903641859 None] Created reservations ['2efcb238-8519-437f-a623-50b078c226a5', 'c0f6d79c-9650-437a-940b-9617ec36de74', '67e12c32-aeb3-4998-b965-8446d17b6b4e', '66ecd8af-abbe-49d8-9790-497ac74dabb3'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:42:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-480a3f3e-63f6-4295-a1dd-e95fde216c35 tempest-ServersNegativeTestJSON-903641859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:42:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-480a3f3e-63f6-4295-a1dd-e95fde216c35 tempest-ServersNegativeTestJSON-903641859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:42:36 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-480a3f3e-63f6-4295-a1dd-e95fde216c35 tempest-ServersNegativeTestJSON-903641859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:42:36 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-480a3f3e-63f6-4295-a1dd-e95fde216c35 tempest-ServersNegativeTestJSON-903641859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:42:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-480a3f3e-63f6-4295-a1dd-e95fde216c35 tempest-ServersNegativeTestJSON-903641859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:42:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-480a3f3e-63f6-4295-a1dd-e95fde216c35 tempest-ServersNegativeTestJSON-903641859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:42:37 devstack sudo[93490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:42:37 devstack sudo[93490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:42:37 devstack sudo[93490]: pam_unix(sudo:session): session closed for user root Sep 10 16:42:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-480a3f3e-63f6-4295-a1dd-e95fde216c35 tempest-ServersNegativeTestJSON-903641859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.320s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:42:37 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-480a3f3e-63f6-4295-a1dd-e95fde216c35 tempest-ServersNegativeTestJSON-903641859 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:42:37 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-480a3f3e-63f6-4295-a1dd-e95fde216c35 tempest-ServersNegativeTestJSON-903641859 None] Deleted volume successfully. Sep 10 16:42:37 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-480a3f3e-63f6-4295-a1dd-e95fde216c35 tempest-ServersNegativeTestJSON-903641859 None] Lock "cinder-e7c8ce58-2977-4f57-9a18-81d0121f2ab1-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:42:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-a467fa31-ba70-40c1-8ca6-9e7f24aa8f21 req-6d701a6d-aabb-4ca5-83b9-cb70710cfb2d tempest-ServerActionsTestOtherA-1184087604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:42:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-a467fa31-ba70-40c1-8ca6-9e7f24aa8f21 req-6d701a6d-aabb-4ca5-83b9-cb70710cfb2d tempest-ServerActionsTestOtherA-1184087604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:42:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-a467fa31-ba70-40c1-8ca6-9e7f24aa8f21 req-6d701a6d-aabb-4ca5-83b9-cb70710cfb2d tempest-ServerActionsTestOtherA-1184087604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:42:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-a467fa31-ba70-40c1-8ca6-9e7f24aa8f21 req-6d701a6d-aabb-4ca5-83b9-cb70710cfb2d tempest-ServerActionsTestOtherA-1184087604 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8', 'name': 'volume-ce94a601-0c26-4b81-9061-683e09cb1f75', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '889b6c8d-8fd2-4ea5-881a-e47f6fa8ddf1', 'enforce_multipath': True} {{(pid=88189) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 16:42:40 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-a467fa31-ba70-40c1-8ca6-9e7f24aa8f21 req-6d701a6d-aabb-4ca5-83b9-cb70710cfb2d tempest-ServerActionsTestOtherA-1184087604 None] attachment_update completed successfully. Sep 10 16:42:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:42:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:42:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:42:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:42:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:42:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:42:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:42:49 devstack sudo[93964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:42:49 devstack sudo[93964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:42:50 devstack sudo[93964]: pam_unix(sudo:session): session closed for user root Sep 10 16:42:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.585s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:42:50 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:42:50 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager._thread_info {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:42:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread count: 28 {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 16:42:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread info: [<_MainThread(MainThread, started 125792070905984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 16:42:50 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:UPDATE=27,cinder:SELECT=29,cinder:INSERT=5,cinder:DELETE=2 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:42:50 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=24,cinder:UPDATE=36,cinder:INSERT=9,cinder:DELETE=3 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:43:01 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc3e7755-59a9-44a2-9c99-84c6cf13df3d tempest-VolumeTypesAccessTest-359739528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:43:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bc3e7755-59a9-44a2-9c99-84c6cf13df3d tempest-VolumeTypesAccessTest-359739528 None] Flow 'volume_create_manager' (c13136ca-d0ae-4ebe-ad14-bc941f61f66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:43:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bc3e7755-59a9-44a2-9c99-84c6cf13df3d tempest-VolumeTypesAccessTest-359739528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (827cbea4-35db-4584-b85a-860a17b53e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:43:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bc3e7755-59a9-44a2-9c99-84c6cf13df3d tempest-VolumeTypesAccessTest-359739528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (827cbea4-35db-4584-b85a-860a17b53e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1340147359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc3b28a3-e0da-41d0-b5c0-ea532fb48396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9416e8d982e4a359b3cd698acf37e28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:43:01Z,use_quota=True,user_id='94cade0a0df9401a9d1b6fa2f70954b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7b4079a-3035-4cc2-92bd-75431adfa904),volume_type_id=f7b4079a-3035-4cc2-92bd-75431adfa904)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:43:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bc3e7755-59a9-44a2-9c99-84c6cf13df3d tempest-VolumeTypesAccessTest-359739528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d19d99-7070-4189-b20c-52d0ceee34ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:43:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bc3e7755-59a9-44a2-9c99-84c6cf13df3d tempest-VolumeTypesAccessTest-359739528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d19d99-7070-4189-b20c-52d0ceee34ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:43:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bc3e7755-59a9-44a2-9c99-84c6cf13df3d tempest-VolumeTypesAccessTest-359739528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b759c07-c6ae-4501-b4e6-ba92617c9e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:43:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bc3e7755-59a9-44a2-9c99-84c6cf13df3d tempest-VolumeTypesAccessTest-359739528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b759c07-c6ae-4501-b4e6-ba92617c9e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc3b28a3-e0da-41d0-b5c0-ea532fb48396', 'volume_name': 'volume-fc3b28a3-e0da-41d0-b5c0-ea532fb48396', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:43:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bc3e7755-59a9-44a2-9c99-84c6cf13df3d tempest-VolumeTypesAccessTest-359739528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a408268e-967f-4da7-bb5e-8e408e1a6d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:43:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bc3e7755-59a9-44a2-9c99-84c6cf13df3d tempest-VolumeTypesAccessTest-359739528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a408268e-967f-4da7-bb5e-8e408e1a6d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:43:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bc3e7755-59a9-44a2-9c99-84c6cf13df3d tempest-VolumeTypesAccessTest-359739528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc1e422-f948-4ed0-b0aa-c1e44f272651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:43:01 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-bc3e7755-59a9-44a2-9c99-84c6cf13df3d tempest-VolumeTypesAccessTest-359739528 None] Volume fc3b28a3-e0da-41d0-b5c0-ea532fb48396: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc3b28a3-e0da-41d0-b5c0-ea532fb48396', 'volume_size': 1} Sep 10 16:43:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-bc3e7755-59a9-44a2-9c99-84c6cf13df3d tempest-VolumeTypesAccessTest-359739528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:43:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-bc3e7755-59a9-44a2-9c99-84c6cf13df3d tempest-VolumeTypesAccessTest-359739528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:43:01 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-bc3e7755-59a9-44a2-9c99-84c6cf13df3d tempest-VolumeTypesAccessTest-359739528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1340147359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc3b28a3-e0da-41d0-b5c0-ea532fb48396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9416e8d982e4a359b3cd698acf37e28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:43:01Z,use_quota=True,user_id='94cade0a0df9401a9d1b6fa2f70954b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7b4079a-3035-4cc2-92bd-75431adfa904),volume_type_id=f7b4079a-3035-4cc2-92bd-75431adfa904)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:43:01 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-bc3e7755-59a9-44a2-9c99-84c6cf13df3d tempest-VolumeTypesAccessTest-359739528 None] Creating volume fc3b28a3-e0da-41d0-b5c0-ea532fb48396 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:43:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-bc3e7755-59a9-44a2-9c99-84c6cf13df3d tempest-VolumeTypesAccessTest-359739528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:43:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-bc3e7755-59a9-44a2-9c99-84c6cf13df3d tempest-VolumeTypesAccessTest-359739528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:43:01 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-bc3e7755-59a9-44a2-9c99-84c6cf13df3d tempest-VolumeTypesAccessTest-359739528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:43:01 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-bc3e7755-59a9-44a2-9c99-84c6cf13df3d tempest-VolumeTypesAccessTest-359739528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:43:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-bc3e7755-59a9-44a2-9c99-84c6cf13df3d tempest-VolumeTypesAccessTest-359739528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:43:01 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-bc3e7755-59a9-44a2-9c99-84c6cf13df3d tempest-VolumeTypesAccessTest-359739528 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:43:01 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-bc3e7755-59a9-44a2-9c99-84c6cf13df3d tempest-VolumeTypesAccessTest-359739528 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:43:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bc3e7755-59a9-44a2-9c99-84c6cf13df3d tempest-VolumeTypesAccessTest-359739528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fc3b28a3-e0da-41d0-b5c0-ea532fb48396 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:01 devstack sudo[94055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fc3b28a3-e0da-41d0-b5c0-ea532fb48396 1073741824 Sep 10 16:43:01 devstack sudo[94055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:02 devstack sudo[94055]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bc3e7755-59a9-44a2-9c99-84c6cf13df3d tempest-VolumeTypesAccessTest-359739528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fc3b28a3-e0da-41d0-b5c0-ea532fb48396 1073741824" returned: 0 in 0.987s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bc3e7755-59a9-44a2-9c99-84c6cf13df3d tempest-VolumeTypesAccessTest-359739528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fc3b28a3-e0da-41d0-b5c0-ea532fb48396 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:02 devstack sudo[94104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fc3b28a3-e0da-41d0-b5c0-ea532fb48396 Sep 10 16:43:02 devstack sudo[94104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:03 devstack sudo[94104]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bc3e7755-59a9-44a2-9c99-84c6cf13df3d tempest-VolumeTypesAccessTest-359739528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fc3b28a3-e0da-41d0-b5c0-ea532fb48396" returned: 0 in 0.338s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:03 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-bc3e7755-59a9-44a2-9c99-84c6cf13df3d tempest-VolumeTypesAccessTest-359739528 None] <== create_volume: return (1434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:43:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-bc3e7755-59a9-44a2-9c99-84c6cf13df3d tempest-VolumeTypesAccessTest-359739528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:43:03 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bc3e7755-59a9-44a2-9c99-84c6cf13df3d tempest-VolumeTypesAccessTest-359739528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc1e422-f948-4ed0-b0aa-c1e44f272651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc3b28a3-e0da-41d0-b5c0-ea532fb48396', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:43:03 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bc3e7755-59a9-44a2-9c99-84c6cf13df3d tempest-VolumeTypesAccessTest-359739528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d51294fe-1014-48ed-896b-2de8db1f4661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:43:03 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-bc3e7755-59a9-44a2-9c99-84c6cf13df3d tempest-VolumeTypesAccessTest-359739528 None] Volume volume-fc3b28a3-e0da-41d0-b5c0-ea532fb48396 (fc3b28a3-e0da-41d0-b5c0-ea532fb48396): created successfully Sep 10 16:43:03 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bc3e7755-59a9-44a2-9c99-84c6cf13df3d tempest-VolumeTypesAccessTest-359739528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d51294fe-1014-48ed-896b-2de8db1f4661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:43:03 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bc3e7755-59a9-44a2-9c99-84c6cf13df3d tempest-VolumeTypesAccessTest-359739528 None] Flow 'volume_create_manager' (c13136ca-d0ae-4ebe-ad14-bc941f61f66c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:43:03 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-bc3e7755-59a9-44a2-9c99-84c6cf13df3d tempest-VolumeTypesAccessTest-359739528 None] Created volume successfully. Sep 10 16:43:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-786fb4a3-04b5-4a2a-ac9b-743f515bca41 tempest-VolumeTypesAccessTest-359739528 None] Acquiring lock "cinder-fc3b28a3-e0da-41d0-b5c0-ea532fb48396-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:43:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-786fb4a3-04b5-4a2a-ac9b-743f515bca41 tempest-VolumeTypesAccessTest-359739528 None] Lock "cinder-fc3b28a3-e0da-41d0-b5c0-ea532fb48396-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:43:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-786fb4a3-04b5-4a2a-ac9b-743f515bca41 tempest-VolumeTypesAccessTest-359739528 None] Acquiring lock "cinder-quobyte-fc3b28a3-e0da-41d0-b5c0-ea532fb48396" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:43:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-786fb4a3-04b5-4a2a-ac9b-743f515bca41 tempest-VolumeTypesAccessTest-359739528 None] Lock "cinder-quobyte-fc3b28a3-e0da-41d0-b5c0-ea532fb48396" acquired by "delete_volume" :: waited 0.024s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:43:04 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf726dc-31d1-415c-9422-5efed9b6e8a8]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:43:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-786fb4a3-04b5-4a2a-ac9b-743f515bca41 tempest-VolumeTypesAccessTest-359739528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fc3b28a3-e0da-41d0-b5c0-ea532fb48396 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:04 devstack sudo[94112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fc3b28a3-e0da-41d0-b5c0-ea532fb48396 Sep 10 16:43:04 devstack sudo[94112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:04 devstack sudo[94112]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-786fb4a3-04b5-4a2a-ac9b-743f515bca41 tempest-VolumeTypesAccessTest-359739528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fc3b28a3-e0da-41d0-b5c0-ea532fb48396" returned: 0 in 0.418s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-786fb4a3-04b5-4a2a-ac9b-743f515bca41 tempest-VolumeTypesAccessTest-359739528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fc3b28a3-e0da-41d0-b5c0-ea532fb48396 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:04 devstack sudo[94117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fc3b28a3-e0da-41d0-b5c0-ea532fb48396 Sep 10 16:43:04 devstack sudo[94117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:04 devstack sudo[94117]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-786fb4a3-04b5-4a2a-ac9b-743f515bca41 tempest-VolumeTypesAccessTest-359739528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fc3b28a3-e0da-41d0-b5c0-ea532fb48396" returned: 0 in 0.300s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:04 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-786fb4a3-04b5-4a2a-ac9b-743f515bca41 tempest-VolumeTypesAccessTest-359739528 None] Lock "cinder-quobyte-fc3b28a3-e0da-41d0-b5c0-ea532fb48396" released by "delete_volume" :: held 0.785s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:43:04 devstack cinder-volume[88189]: WARNING cinder.quota [None req-786fb4a3-04b5-4a2a-ac9b-743f515bca41 tempest-VolumeTypesAccessTest-359739528 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-920107873 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-920107873, it is now deprecated. Please use the default quota class for default quota. Sep 10 16:43:04 devstack cinder-volume[88189]: WARNING cinder.quota [None req-786fb4a3-04b5-4a2a-ac9b-743f515bca41 tempest-VolumeTypesAccessTest-359739528 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-920107873 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-920107873, it is now deprecated. Please use the default quota class for default quota. Sep 10 16:43:04 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-786fb4a3-04b5-4a2a-ac9b-743f515bca41 tempest-VolumeTypesAccessTest-359739528 None] Created reservations ['8b19c0f7-aa5e-4fab-b984-96a2a0972c8c', '4927d13a-948b-48d3-9905-332a10e8aa44', 'f0873c2c-d338-4dc6-be05-8946dd1f2f09', 'bcf9ec2c-1d13-443c-916b-e9327846c440'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:43:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-786fb4a3-04b5-4a2a-ac9b-743f515bca41 tempest-VolumeTypesAccessTest-359739528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:43:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-786fb4a3-04b5-4a2a-ac9b-743f515bca41 tempest-VolumeTypesAccessTest-359739528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:43:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-786fb4a3-04b5-4a2a-ac9b-743f515bca41 tempest-VolumeTypesAccessTest-359739528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:43:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-786fb4a3-04b5-4a2a-ac9b-743f515bca41 tempest-VolumeTypesAccessTest-359739528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:43:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-786fb4a3-04b5-4a2a-ac9b-743f515bca41 tempest-VolumeTypesAccessTest-359739528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:43:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-786fb4a3-04b5-4a2a-ac9b-743f515bca41 tempest-VolumeTypesAccessTest-359739528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:04 devstack sudo[94120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:43:04 devstack sudo[94120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:05 devstack sudo[94120]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-786fb4a3-04b5-4a2a-ac9b-743f515bca41 tempest-VolumeTypesAccessTest-359739528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.433s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:05 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-786fb4a3-04b5-4a2a-ac9b-743f515bca41 tempest-VolumeTypesAccessTest-359739528 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:43:05 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-786fb4a3-04b5-4a2a-ac9b-743f515bca41 tempest-VolumeTypesAccessTest-359739528 None] Deleted volume successfully. Sep 10 16:43:05 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-786fb4a3-04b5-4a2a-ac9b-743f515bca41 tempest-VolumeTypesAccessTest-359739528 None] Lock "cinder-fc3b28a3-e0da-41d0-b5c0-ea532fb48396-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:43:14 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-0935c835-b9dd-467f-bc5c-23ff1ff65e9c tempest-SnapshotsActionsTest-1365038666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:43:14 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0935c835-b9dd-467f-bc5c-23ff1ff65e9c tempest-SnapshotsActionsTest-1365038666 None] Flow 'volume_create_manager' (eebac9aa-03b8-4221-aed0-549b72031f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:43:14 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0935c835-b9dd-467f-bc5c-23ff1ff65e9c tempest-SnapshotsActionsTest-1365038666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (801a1000-cec8-4910-b6f7-db2436d25d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:43:14 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0935c835-b9dd-467f-bc5c-23ff1ff65e9c tempest-SnapshotsActionsTest-1365038666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (801a1000-cec8-4910-b6f7-db2436d25d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1693958692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=079aebfe-6793-483b-8d1b-02a6f2ed44b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75f115e2cea43aab84944a2bafa17b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:43:15Z,use_quota=True,user_id='f1de8daf3c494543a8a79538b185bf4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:43:14 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0935c835-b9dd-467f-bc5c-23ff1ff65e9c tempest-SnapshotsActionsTest-1365038666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d361b51-8842-4d1a-95ea-b3bda6d8794c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:43:14 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0935c835-b9dd-467f-bc5c-23ff1ff65e9c tempest-SnapshotsActionsTest-1365038666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d361b51-8842-4d1a-95ea-b3bda6d8794c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:43:14 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0935c835-b9dd-467f-bc5c-23ff1ff65e9c tempest-SnapshotsActionsTest-1365038666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ec0996d-3894-4828-b5db-17f6b8a11518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:43:14 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0935c835-b9dd-467f-bc5c-23ff1ff65e9c tempest-SnapshotsActionsTest-1365038666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ec0996d-3894-4828-b5db-17f6b8a11518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '079aebfe-6793-483b-8d1b-02a6f2ed44b7', 'volume_name': 'volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:43:14 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0935c835-b9dd-467f-bc5c-23ff1ff65e9c tempest-SnapshotsActionsTest-1365038666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8009acb-f871-4c5e-b440-b1a09ccfaf6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:43:14 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0935c835-b9dd-467f-bc5c-23ff1ff65e9c tempest-SnapshotsActionsTest-1365038666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8009acb-f871-4c5e-b440-b1a09ccfaf6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:43:14 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0935c835-b9dd-467f-bc5c-23ff1ff65e9c tempest-SnapshotsActionsTest-1365038666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa3bed2-ad40-47f4-984d-55080f62028c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:43:14 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-0935c835-b9dd-467f-bc5c-23ff1ff65e9c tempest-SnapshotsActionsTest-1365038666 None] Volume 079aebfe-6793-483b-8d1b-02a6f2ed44b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7', 'volume_size': 1} Sep 10 16:43:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0935c835-b9dd-467f-bc5c-23ff1ff65e9c tempest-SnapshotsActionsTest-1365038666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:43:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0935c835-b9dd-467f-bc5c-23ff1ff65e9c tempest-SnapshotsActionsTest-1365038666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:43:14 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0935c835-b9dd-467f-bc5c-23ff1ff65e9c tempest-SnapshotsActionsTest-1365038666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1693958692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=079aebfe-6793-483b-8d1b-02a6f2ed44b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75f115e2cea43aab84944a2bafa17b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:43:15Z,use_quota=True,user_id='f1de8daf3c494543a8a79538b185bf4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:43:14 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-0935c835-b9dd-467f-bc5c-23ff1ff65e9c tempest-SnapshotsActionsTest-1365038666 None] Creating volume 079aebfe-6793-483b-8d1b-02a6f2ed44b7 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:43:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0935c835-b9dd-467f-bc5c-23ff1ff65e9c tempest-SnapshotsActionsTest-1365038666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:43:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0935c835-b9dd-467f-bc5c-23ff1ff65e9c tempest-SnapshotsActionsTest-1365038666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:43:14 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0935c835-b9dd-467f-bc5c-23ff1ff65e9c tempest-SnapshotsActionsTest-1365038666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:43:14 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0935c835-b9dd-467f-bc5c-23ff1ff65e9c tempest-SnapshotsActionsTest-1365038666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:43:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0935c835-b9dd-467f-bc5c-23ff1ff65e9c tempest-SnapshotsActionsTest-1365038666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:43:14 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0935c835-b9dd-467f-bc5c-23ff1ff65e9c tempest-SnapshotsActionsTest-1365038666 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:43:14 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-0935c835-b9dd-467f-bc5c-23ff1ff65e9c tempest-SnapshotsActionsTest-1365038666 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:43:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0935c835-b9dd-467f-bc5c-23ff1ff65e9c tempest-SnapshotsActionsTest-1365038666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:14 devstack sudo[94173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7 1073741824 Sep 10 16:43:14 devstack sudo[94173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:15 devstack sudo[94173]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0935c835-b9dd-467f-bc5c-23ff1ff65e9c tempest-SnapshotsActionsTest-1365038666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7 1073741824" returned: 0 in 0.523s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0935c835-b9dd-467f-bc5c-23ff1ff65e9c tempest-SnapshotsActionsTest-1365038666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:15 devstack sudo[94179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7 Sep 10 16:43:15 devstack sudo[94179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:15 devstack sudo[94179]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0935c835-b9dd-467f-bc5c-23ff1ff65e9c tempest-SnapshotsActionsTest-1365038666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7" returned: 0 in 0.290s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0935c835-b9dd-467f-bc5c-23ff1ff65e9c tempest-SnapshotsActionsTest-1365038666 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:43:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0935c835-b9dd-467f-bc5c-23ff1ff65e9c tempest-SnapshotsActionsTest-1365038666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:43:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0935c835-b9dd-467f-bc5c-23ff1ff65e9c tempest-SnapshotsActionsTest-1365038666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa3bed2-ad40-47f4-984d-55080f62028c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:43:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0935c835-b9dd-467f-bc5c-23ff1ff65e9c tempest-SnapshotsActionsTest-1365038666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3f1ad2b-cf6e-4795-8a0c-d98a7b714460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:43:15 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-0935c835-b9dd-467f-bc5c-23ff1ff65e9c tempest-SnapshotsActionsTest-1365038666 None] Volume volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7 (079aebfe-6793-483b-8d1b-02a6f2ed44b7): created successfully Sep 10 16:43:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0935c835-b9dd-467f-bc5c-23ff1ff65e9c tempest-SnapshotsActionsTest-1365038666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3f1ad2b-cf6e-4795-8a0c-d98a7b714460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:43:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0935c835-b9dd-467f-bc5c-23ff1ff65e9c tempest-SnapshotsActionsTest-1365038666 None] Flow 'volume_create_manager' (eebac9aa-03b8-4221-aed0-549b72031f71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:43:15 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-0935c835-b9dd-467f-bc5c-23ff1ff65e9c tempest-SnapshotsActionsTest-1365038666 None] Created volume successfully. Sep 10 16:43:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-65a80804-f90e-4388-a916-7e88a2d85972 tempest-SnapshotsActionsTest-1365038666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:43:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-65a80804-f90e-4388-a916-7e88a2d85972 tempest-SnapshotsActionsTest-1365038666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:43:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-65a80804-f90e-4388-a916-7e88a2d85972 tempest-SnapshotsActionsTest-1365038666 None] Creating offline snapshot 65b89278-22e9-4b76-aecb-f500578ddf59 of volume 079aebfe-6793-483b-8d1b-02a6f2ed44b7 {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:43:16 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbe2939-a289-4240-a00d-aaff14e30393]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:43:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-65a80804-f90e-4388-a916-7e88a2d85972 tempest-SnapshotsActionsTest-1365038666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:17 devstack sudo[94209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7 Sep 10 16:43:17 devstack sudo[94209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:17 devstack sudo[94209]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-65a80804-f90e-4388-a916-7e88a2d85972 tempest-SnapshotsActionsTest-1365038666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7" returned: 0 in 0.484s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-65a80804-f90e-4388-a916-7e88a2d85972 tempest-SnapshotsActionsTest-1365038666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:17 devstack sudo[94216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 1G Sep 10 16:43:17 devstack sudo[94216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:18 devstack sudo[94216]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-65a80804-f90e-4388-a916-7e88a2d85972 tempest-SnapshotsActionsTest-1365038666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 1G" returned: 0 in 0.620s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-65a80804-f90e-4388-a916-7e88a2d85972 tempest-SnapshotsActionsTest-1365038666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:18 devstack sudo[94244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 Sep 10 16:43:18 devstack sudo[94244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:18 devstack sudo[94244]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-65a80804-f90e-4388-a916-7e88a2d85972 tempest-SnapshotsActionsTest-1365038666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59" returned: 0 in 0.387s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:18 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-65a80804-f90e-4388-a916-7e88a2d85972 tempest-SnapshotsActionsTest-1365038666 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 is being set with open permissions: ugo+rw Sep 10 16:43:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-65a80804-f90e-4388-a916-7e88a2d85972 tempest-SnapshotsActionsTest-1365038666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:18 devstack sudo[94250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 Sep 10 16:43:18 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:18 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-65a80804-f90e-4388-a916-7e88a2d85972 tempest-SnapshotsActionsTest-1365038666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59" returned: 0 in 0.327s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-65a80804-f90e-4388-a916-7e88a2d85972 tempest-SnapshotsActionsTest-1365038666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:18 devstack sudo[94253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.info Sep 10 16:43:18 devstack sudo[94253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:19 devstack sudo[94253]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-65a80804-f90e-4388-a916-7e88a2d85972 tempest-SnapshotsActionsTest-1365038666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.info" returned: 0 in 0.376s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:19 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-65a80804-f90e-4388-a916-7e88a2d85972 tempest-SnapshotsActionsTest-1365038666 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.info is being set with open permissions: ugo+rw Sep 10 16:43:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-65a80804-f90e-4388-a916-7e88a2d85972 tempest-SnapshotsActionsTest-1365038666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:19 devstack sudo[94258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.info Sep 10 16:43:19 devstack sudo[94258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:19 devstack sudo[94258]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-65a80804-f90e-4388-a916-7e88a2d85972 tempest-SnapshotsActionsTest-1365038666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.info" returned: 0 in 0.302s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-65a80804-f90e-4388-a916-7e88a2d85972 tempest-SnapshotsActionsTest-1365038666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.602s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:43:19 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-65a80804-f90e-4388-a916-7e88a2d85972 tempest-SnapshotsActionsTest-1365038666 None] Create snapshot completed successfully Sep 10 16:43:19 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-df618055-2fd0-48d7-87a8-e4e66181e57c req-1936b234-204e-485b-8d5c-0902743e2792 tempest-ServerActionsTestOtherA-1184087604 None] Terminate volume connection completed successfully. Sep 10 16:43:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-df618055-2fd0-48d7-87a8-e4e66181e57c req-1936b234-204e-485b-8d5c-0902743e2792 tempest-ServerActionsTestOtherA-1184087604 None] Deleting attachment 889b6c8d-8fd2-4ea5-881a-e47f6fa8ddf1. {{(pid=88189) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 16:43:19 devstack cinder-volume[88189]: DEBUG cinder.coordination [req-df618055-2fd0-48d7-87a8-e4e66181e57c req-6328b909-d0e3-41a6-9e94-f59f7442460d tempest-ServerActionsTestOtherA-1184087604 None] Acquiring lock "cinder-ce94a601-0c26-4b81-9061-683e09cb1f75-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:43:19 devstack cinder-volume[88189]: DEBUG cinder.coordination [req-df618055-2fd0-48d7-87a8-e4e66181e57c req-6328b909-d0e3-41a6-9e94-f59f7442460d tempest-ServerActionsTestOtherA-1184087604 None] Lock "cinder-ce94a601-0c26-4b81-9061-683e09cb1f75-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:43:19 devstack cinder-volume[88189]: DEBUG cinder.coordination [req-df618055-2fd0-48d7-87a8-e4e66181e57c req-6328b909-d0e3-41a6-9e94-f59f7442460d tempest-ServerActionsTestOtherA-1184087604 None] Acquiring lock "cinder-quobyte-ce94a601-0c26-4b81-9061-683e09cb1f75" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:43:19 devstack cinder-volume[88189]: DEBUG cinder.coordination [req-df618055-2fd0-48d7-87a8-e4e66181e57c req-6328b909-d0e3-41a6-9e94-f59f7442460d tempest-ServerActionsTestOtherA-1184087604 None] Lock "cinder-quobyte-ce94a601-0c26-4b81-9061-683e09cb1f75" acquired by "delete_volume" :: waited 0.022s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:43:19 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[72509b1d-6642-447c-81f1-32568a7bef39]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:43:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-df618055-2fd0-48d7-87a8-e4e66181e57c req-6328b909-d0e3-41a6-9e94-f59f7442460d tempest-ServerActionsTestOtherA-1184087604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ce94a601-0c26-4b81-9061-683e09cb1f75 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:20 devstack sudo[94263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ce94a601-0c26-4b81-9061-683e09cb1f75 Sep 10 16:43:20 devstack sudo[94263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:20 devstack sudo[94263]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-df618055-2fd0-48d7-87a8-e4e66181e57c req-6328b909-d0e3-41a6-9e94-f59f7442460d tempest-ServerActionsTestOtherA-1184087604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ce94a601-0c26-4b81-9061-683e09cb1f75" returned: 0 in 0.520s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-df618055-2fd0-48d7-87a8-e4e66181e57c req-6328b909-d0e3-41a6-9e94-f59f7442460d tempest-ServerActionsTestOtherA-1184087604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ce94a601-0c26-4b81-9061-683e09cb1f75 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:20 devstack sudo[94268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ce94a601-0c26-4b81-9061-683e09cb1f75 Sep 10 16:43:20 devstack sudo[94268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:20 devstack sudo[94268]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-df618055-2fd0-48d7-87a8-e4e66181e57c req-6328b909-d0e3-41a6-9e94-f59f7442460d tempest-ServerActionsTestOtherA-1184087604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ce94a601-0c26-4b81-9061-683e09cb1f75" returned: 0 in 0.288s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:20 devstack cinder-volume[88189]: DEBUG cinder.coordination [req-df618055-2fd0-48d7-87a8-e4e66181e57c req-6328b909-d0e3-41a6-9e94-f59f7442460d tempest-ServerActionsTestOtherA-1184087604 None] Lock "cinder-quobyte-ce94a601-0c26-4b81-9061-683e09cb1f75" released by "delete_volume" :: held 0.864s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:43:20 devstack cinder-volume[88189]: DEBUG cinder.quota [req-df618055-2fd0-48d7-87a8-e4e66181e57c req-6328b909-d0e3-41a6-9e94-f59f7442460d tempest-ServerActionsTestOtherA-1184087604 None] Created reservations ['639ecd0a-c343-4bf7-973c-8173d8664702', '40395764-ba57-42ed-a659-dc0f416ec0c3', '7674a12c-a241-4cdd-9a28-30782b0b3e4b', 'afd45a21-59c0-43ab-92a2-379307cc21c1'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:43:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-df618055-2fd0-48d7-87a8-e4e66181e57c req-6328b909-d0e3-41a6-9e94-f59f7442460d tempest-ServerActionsTestOtherA-1184087604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:43:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-df618055-2fd0-48d7-87a8-e4e66181e57c req-6328b909-d0e3-41a6-9e94-f59f7442460d tempest-ServerActionsTestOtherA-1184087604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:43:20 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [req-df618055-2fd0-48d7-87a8-e4e66181e57c req-6328b909-d0e3-41a6-9e94-f59f7442460d tempest-ServerActionsTestOtherA-1184087604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:43:20 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [req-df618055-2fd0-48d7-87a8-e4e66181e57c req-6328b909-d0e3-41a6-9e94-f59f7442460d tempest-ServerActionsTestOtherA-1184087604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:43:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-df618055-2fd0-48d7-87a8-e4e66181e57c req-6328b909-d0e3-41a6-9e94-f59f7442460d tempest-ServerActionsTestOtherA-1184087604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:43:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-df618055-2fd0-48d7-87a8-e4e66181e57c req-6328b909-d0e3-41a6-9e94-f59f7442460d tempest-ServerActionsTestOtherA-1184087604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:20 devstack sudo[94271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:43:20 devstack sudo[94271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-cb75f653-6110-4680-b211-62017f02b8be tempest-SnapshotsActionsTest-1365038666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:43:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-cb75f653-6110-4680-b211-62017f02b8be tempest-SnapshotsActionsTest-1365038666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:43:21 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-cb75f653-6110-4680-b211-62017f02b8be tempest-SnapshotsActionsTest-1365038666 None] Creating offline snapshot ff0a8626-8f2f-4a21-879f-ef4cbf6120c3 of volume 079aebfe-6793-483b-8d1b-02a6f2ed44b7 {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:43:21 devstack sudo[94271]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-df618055-2fd0-48d7-87a8-e4e66181e57c req-6328b909-d0e3-41a6-9e94-f59f7442460d tempest-ServerActionsTestOtherA-1184087604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.310s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:21 devstack cinder-volume[88189]: DEBUG cinder.manager [req-df618055-2fd0-48d7-87a8-e4e66181e57c req-6328b909-d0e3-41a6-9e94-f59f7442460d tempest-ServerActionsTestOtherA-1184087604 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:43:21 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[441c329e-80d9-401c-8e34-e0f3fb6e61e6]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:43:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cb75f653-6110-4680-b211-62017f02b8be tempest-SnapshotsActionsTest-1365038666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:21 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-df618055-2fd0-48d7-87a8-e4e66181e57c req-6328b909-d0e3-41a6-9e94-f59f7442460d tempest-ServerActionsTestOtherA-1184087604 None] Deleted volume successfully. Sep 10 16:43:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [req-df618055-2fd0-48d7-87a8-e4e66181e57c req-6328b909-d0e3-41a6-9e94-f59f7442460d tempest-ServerActionsTestOtherA-1184087604 None] Lock "cinder-ce94a601-0c26-4b81-9061-683e09cb1f75-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:43:21 devstack sudo[94274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 Sep 10 16:43:21 devstack sudo[94274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-309bc793-a233-4e3c-93d6-cd0e67953943 tempest-ServerActionsTestOtherA-1184087604 None] Acquiring lock "cinder-dc2f29eb-061b-4d43-96a4-3a0d3da1164f-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:43:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-309bc793-a233-4e3c-93d6-cd0e67953943 tempest-ServerActionsTestOtherA-1184087604 None] Lock "cinder-dc2f29eb-061b-4d43-96a4-3a0d3da1164f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:43:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-309bc793-a233-4e3c-93d6-cd0e67953943 tempest-ServerActionsTestOtherA-1184087604 None] Acquiring lock "cinder-quobyte-dc2f29eb-061b-4d43-96a4-3a0d3da1164f" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:43:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-309bc793-a233-4e3c-93d6-cd0e67953943 tempest-ServerActionsTestOtherA-1184087604 None] Lock "cinder-quobyte-dc2f29eb-061b-4d43-96a4-3a0d3da1164f" acquired by "delete_volume" :: waited 0.021s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:43:21 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e415540-8bda-4ce3-b09a-d3f9187470db]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:43:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-309bc793-a233-4e3c-93d6-cd0e67953943 tempest-ServerActionsTestOtherA-1184087604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dc2f29eb-061b-4d43-96a4-3a0d3da1164f {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:21 devstack sudo[94274]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cb75f653-6110-4680-b211-62017f02b8be tempest-SnapshotsActionsTest-1365038666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59" returned: 0 in 0.466s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:21 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-cb75f653-6110-4680-b211-62017f02b8be tempest-SnapshotsActionsTest-1365038666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:43:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cb75f653-6110-4680-b211-62017f02b8be tempest-SnapshotsActionsTest-1365038666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.ff0a8626-8f2f-4a21-879f-ef4cbf6120c3 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:21 devstack sudo[94281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.ff0a8626-8f2f-4a21-879f-ef4cbf6120c3 1G Sep 10 16:43:21 devstack sudo[94281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:21 devstack sudo[94280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dc2f29eb-061b-4d43-96a4-3a0d3da1164f Sep 10 16:43:21 devstack sudo[94280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:22 devstack sudo[94280]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-309bc793-a233-4e3c-93d6-cd0e67953943 tempest-ServerActionsTestOtherA-1184087604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dc2f29eb-061b-4d43-96a4-3a0d3da1164f" returned: 0 in 0.395s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-309bc793-a233-4e3c-93d6-cd0e67953943 tempest-ServerActionsTestOtherA-1184087604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dc2f29eb-061b-4d43-96a4-3a0d3da1164f {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:22 devstack sudo[94290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dc2f29eb-061b-4d43-96a4-3a0d3da1164f Sep 10 16:43:22 devstack sudo[94290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:22 devstack sudo[94281]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cb75f653-6110-4680-b211-62017f02b8be tempest-SnapshotsActionsTest-1365038666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.ff0a8626-8f2f-4a21-879f-ef4cbf6120c3 1G" returned: 0 in 0.496s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cb75f653-6110-4680-b211-62017f02b8be tempest-SnapshotsActionsTest-1365038666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.ff0a8626-8f2f-4a21-879f-ef4cbf6120c3 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:22 devstack sudo[94293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.ff0a8626-8f2f-4a21-879f-ef4cbf6120c3 Sep 10 16:43:22 devstack sudo[94293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:22 devstack sudo[94290]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-309bc793-a233-4e3c-93d6-cd0e67953943 tempest-ServerActionsTestOtherA-1184087604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dc2f29eb-061b-4d43-96a4-3a0d3da1164f" returned: 0 in 0.283s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:22 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-309bc793-a233-4e3c-93d6-cd0e67953943 tempest-ServerActionsTestOtherA-1184087604 None] Lock "cinder-quobyte-dc2f29eb-061b-4d43-96a4-3a0d3da1164f" released by "delete_volume" :: held 0.729s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:43:22 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-309bc793-a233-4e3c-93d6-cd0e67953943 tempest-ServerActionsTestOtherA-1184087604 None] Created reservations ['13be3fdd-3919-4d80-8321-d1772bd9a69f', '71d1f6a8-067b-43ce-8288-64a7f606416d', 'a96d8df7-8a32-4862-a202-9998d2dc646b', '9d17b24a-2599-498e-9aaa-1eec45d98bee'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:43:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-309bc793-a233-4e3c-93d6-cd0e67953943 tempest-ServerActionsTestOtherA-1184087604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:43:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-309bc793-a233-4e3c-93d6-cd0e67953943 tempest-ServerActionsTestOtherA-1184087604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:43:22 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-309bc793-a233-4e3c-93d6-cd0e67953943 tempest-ServerActionsTestOtherA-1184087604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:43:22 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-309bc793-a233-4e3c-93d6-cd0e67953943 tempest-ServerActionsTestOtherA-1184087604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:43:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-309bc793-a233-4e3c-93d6-cd0e67953943 tempest-ServerActionsTestOtherA-1184087604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:43:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-309bc793-a233-4e3c-93d6-cd0e67953943 tempest-ServerActionsTestOtherA-1184087604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:22 devstack sudo[94299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:43:22 devstack sudo[94299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:22 devstack sudo[94293]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cb75f653-6110-4680-b211-62017f02b8be tempest-SnapshotsActionsTest-1365038666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.ff0a8626-8f2f-4a21-879f-ef4cbf6120c3" returned: 0 in 0.339s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:22 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-cb75f653-6110-4680-b211-62017f02b8be tempest-SnapshotsActionsTest-1365038666 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.ff0a8626-8f2f-4a21-879f-ef4cbf6120c3 is being set with open permissions: ugo+rw Sep 10 16:43:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cb75f653-6110-4680-b211-62017f02b8be tempest-SnapshotsActionsTest-1365038666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.ff0a8626-8f2f-4a21-879f-ef4cbf6120c3 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:22 devstack sudo[94301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.ff0a8626-8f2f-4a21-879f-ef4cbf6120c3 Sep 10 16:43:22 devstack sudo[94301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:22 devstack sudo[94299]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-309bc793-a233-4e3c-93d6-cd0e67953943 tempest-ServerActionsTestOtherA-1184087604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.282s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:22 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-309bc793-a233-4e3c-93d6-cd0e67953943 tempest-ServerActionsTestOtherA-1184087604 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:43:22 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-309bc793-a233-4e3c-93d6-cd0e67953943 tempest-ServerActionsTestOtherA-1184087604 None] Deleted volume successfully. Sep 10 16:43:22 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-309bc793-a233-4e3c-93d6-cd0e67953943 tempest-ServerActionsTestOtherA-1184087604 None] Lock "cinder-dc2f29eb-061b-4d43-96a4-3a0d3da1164f-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:43:22 devstack sudo[94301]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cb75f653-6110-4680-b211-62017f02b8be tempest-SnapshotsActionsTest-1365038666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.ff0a8626-8f2f-4a21-879f-ef4cbf6120c3" returned: 0 in 0.341s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-cb75f653-6110-4680-b211-62017f02b8be tempest-SnapshotsActionsTest-1365038666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.756s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:43:22 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-cb75f653-6110-4680-b211-62017f02b8be tempest-SnapshotsActionsTest-1365038666 None] Create snapshot completed successfully Sep 10 16:43:23 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-556cef77-f33f-4991-b154-14847c7b1727 tempest-SnapshotsActionsTest-1858371615 None] Acquiring lock "cinder-ff0a8626-8f2f-4a21-879f-ef4cbf6120c3-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:43:23 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-556cef77-f33f-4991-b154-14847c7b1727 tempest-SnapshotsActionsTest-1858371615 None] Lock "cinder-ff0a8626-8f2f-4a21-879f-ef4cbf6120c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:43:23 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-556cef77-f33f-4991-b154-14847c7b1727 tempest-SnapshotsActionsTest-1858371615 None] Acquiring lock "cinder-quobyte-079aebfe-6793-483b-8d1b-02a6f2ed44b7" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:43:23 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-556cef77-f33f-4991-b154-14847c7b1727 tempest-SnapshotsActionsTest-1858371615 None] Lock "cinder-quobyte-079aebfe-6793-483b-8d1b-02a6f2ed44b7" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:43:23 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-556cef77-f33f-4991-b154-14847c7b1727 tempest-SnapshotsActionsTest-1858371615 None] Acquiring lock "cinder-quobyte-ff0a8626-8f2f-4a21-879f-ef4cbf6120c3" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:43:23 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-556cef77-f33f-4991-b154-14847c7b1727 tempest-SnapshotsActionsTest-1858371615 None] Lock "cinder-quobyte-ff0a8626-8f2f-4a21-879f-ef4cbf6120c3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:43:23 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-556cef77-f33f-4991-b154-14847c7b1727 tempest-SnapshotsActionsTest-1858371615 None] Deleting offline snapshot ff0a8626-8f2f-4a21-879f-ef4cbf6120c3 of volume 079aebfe-6793-483b-8d1b-02a6f2ed44b7 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:43:23 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-556cef77-f33f-4991-b154-14847c7b1727 tempest-SnapshotsActionsTest-1858371615 None] snapshot_file for this snap is: volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.ff0a8626-8f2f-4a21-879f-ef4cbf6120c3 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:43:23 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba317dd-ac03-45c1-8310-903f0779ce7f]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:43:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-556cef77-f33f-4991-b154-14847c7b1727 tempest-SnapshotsActionsTest-1858371615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.ff0a8626-8f2f-4a21-879f-ef4cbf6120c3 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:23 devstack sudo[94333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.ff0a8626-8f2f-4a21-879f-ef4cbf6120c3 Sep 10 16:43:23 devstack sudo[94333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:24 devstack sudo[94333]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-556cef77-f33f-4991-b154-14847c7b1727 tempest-SnapshotsActionsTest-1858371615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.ff0a8626-8f2f-4a21-879f-ef4cbf6120c3" returned: 0 in 0.596s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:24 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-556cef77-f33f-4991-b154-14847c7b1727 tempest-SnapshotsActionsTest-1858371615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:43:24 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abbae8b-eb71-4ecd-8d7e-74bbd6b3c015]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:43:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-556cef77-f33f-4991-b154-14847c7b1727 tempest-SnapshotsActionsTest-1858371615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:24 devstack sudo[94339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 Sep 10 16:43:24 devstack sudo[94339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:25 devstack sudo[94339]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-556cef77-f33f-4991-b154-14847c7b1727 tempest-SnapshotsActionsTest-1858371615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59" returned: 0 in 0.726s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-556cef77-f33f-4991-b154-14847c7b1727 tempest-SnapshotsActionsTest-1858371615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:43:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-556cef77-f33f-4991-b154-14847c7b1727 tempest-SnapshotsActionsTest-1858371615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.ff0a8626-8f2f-4a21-879f-ef4cbf6120c3 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:25 devstack sudo[94346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.ff0a8626-8f2f-4a21-879f-ef4cbf6120c3 Sep 10 16:43:25 devstack sudo[94346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:25 devstack sudo[94346]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-556cef77-f33f-4991-b154-14847c7b1727 tempest-SnapshotsActionsTest-1858371615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.ff0a8626-8f2f-4a21-879f-ef4cbf6120c3" returned: 0 in 0.480s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-556cef77-f33f-4991-b154-14847c7b1727 tempest-SnapshotsActionsTest-1858371615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.ff0a8626-8f2f-4a21-879f-ef4cbf6120c3 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:25 devstack sudo[94351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.ff0a8626-8f2f-4a21-879f-ef4cbf6120c3 Sep 10 16:43:25 devstack sudo[94351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:25 devstack sudo[94351]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-556cef77-f33f-4991-b154-14847c7b1727 tempest-SnapshotsActionsTest-1858371615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.ff0a8626-8f2f-4a21-879f-ef4cbf6120c3" returned: 0 in 0.266s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:25 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-556cef77-f33f-4991-b154-14847c7b1727 tempest-SnapshotsActionsTest-1858371615 None] Lock "cinder-quobyte-ff0a8626-8f2f-4a21-879f-ef4cbf6120c3" released by "_delete_snapshot" :: held 2.192s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:43:25 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-556cef77-f33f-4991-b154-14847c7b1727 tempest-SnapshotsActionsTest-1858371615 None] Lock "cinder-quobyte-079aebfe-6793-483b-8d1b-02a6f2ed44b7" released by "delete_snapshot" :: held 2.219s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:43:25 devstack cinder-volume[88189]: WARNING cinder.quota [None req-556cef77-f33f-4991-b154-14847c7b1727 tempest-SnapshotsActionsTest-1858371615 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 10 16:43:25 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-556cef77-f33f-4991-b154-14847c7b1727 tempest-SnapshotsActionsTest-1858371615 None] Created reservations ['7f25e104-e09e-4c7d-a568-08d87b88733f', '743f9fdf-95af-43a8-97ad-07288654423e', '13d9e365-164a-405b-9be2-578fc13d57e0', 'a1589384-1cc3-45b1-a5a1-67e8313b653b'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:43:26 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-556cef77-f33f-4991-b154-14847c7b1727 tempest-SnapshotsActionsTest-1858371615 None] Delete snapshot completed successfully. Sep 10 16:43:26 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-556cef77-f33f-4991-b154-14847c7b1727 tempest-SnapshotsActionsTest-1858371615 None] Lock "cinder-ff0a8626-8f2f-4a21-879f-ef4cbf6120c3-delete_snapshot" released by "delete_snapshot" :: held 2.468s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:43:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7c08afd4-d65e-4bd8-8af9-ed73919b54c5 tempest-SnapshotsActionsTest-1365038666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:43:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7c08afd4-d65e-4bd8-8af9-ed73919b54c5 tempest-SnapshotsActionsTest-1365038666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:43:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-7c08afd4-d65e-4bd8-8af9-ed73919b54c5 tempest-SnapshotsActionsTest-1365038666 None] Creating offline snapshot 891abf9b-78ff-476e-89e9-f0df210f99ff of volume 079aebfe-6793-483b-8d1b-02a6f2ed44b7 {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:43:27 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8559da-b26e-4f57-8c46-a644cf7ad672]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:43:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7c08afd4-d65e-4bd8-8af9-ed73919b54c5 tempest-SnapshotsActionsTest-1365038666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:27 devstack sudo[94360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 Sep 10 16:43:27 devstack sudo[94360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:27 devstack sudo[94360]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7c08afd4-d65e-4bd8-8af9-ed73919b54c5 tempest-SnapshotsActionsTest-1365038666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59" returned: 0 in 0.516s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-7c08afd4-d65e-4bd8-8af9-ed73919b54c5 tempest-SnapshotsActionsTest-1365038666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:43:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7c08afd4-d65e-4bd8-8af9-ed73919b54c5 tempest-SnapshotsActionsTest-1365038666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.891abf9b-78ff-476e-89e9-f0df210f99ff 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:27 devstack sudo[94366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.891abf9b-78ff-476e-89e9-f0df210f99ff 1G Sep 10 16:43:27 devstack sudo[94366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:27 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd2331fe-5de1-4696-9242-ac74367cdd1b tempest-AttachVolumeTestJSON-265770916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:43:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fd2331fe-5de1-4696-9242-ac74367cdd1b tempest-AttachVolumeTestJSON-265770916 None] Flow 'volume_create_manager' (59863cab-dd47-418e-a10d-f1ea5b86c1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:43:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fd2331fe-5de1-4696-9242-ac74367cdd1b tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9587be3d-f467-48f7-939e-3a4b5937159c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:43:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fd2331fe-5de1-4696-9242-ac74367cdd1b tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9587be3d-f467-48f7-939e-3a4b5937159c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-126318734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e67749ef-db7f-48c4-b683-338eab95fb96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45796b0a32f14262a3bd880e56ac6b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:43:28Z,use_quota=True,user_id='9e214a2542f344cca207ec605b9b45e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:43:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fd2331fe-5de1-4696-9242-ac74367cdd1b tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f83d1b73-8e31-40ca-9255-4498c36ffaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:43:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fd2331fe-5de1-4696-9242-ac74367cdd1b tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f83d1b73-8e31-40ca-9255-4498c36ffaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:43:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fd2331fe-5de1-4696-9242-ac74367cdd1b tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c9a97d-06aa-4efa-87f5-93eee74c69d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:43:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fd2331fe-5de1-4696-9242-ac74367cdd1b tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c9a97d-06aa-4efa-87f5-93eee74c69d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e67749ef-db7f-48c4-b683-338eab95fb96', 'volume_name': 'volume-e67749ef-db7f-48c4-b683-338eab95fb96', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:43:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fd2331fe-5de1-4696-9242-ac74367cdd1b tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f7482c-4464-42b7-aa7e-b83249e71e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:43:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fd2331fe-5de1-4696-9242-ac74367cdd1b tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f7482c-4464-42b7-aa7e-b83249e71e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:43:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fd2331fe-5de1-4696-9242-ac74367cdd1b tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f3c48d9-eb25-4d3c-bbb6-6421f78cc599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:43:28 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-fd2331fe-5de1-4696-9242-ac74367cdd1b tempest-AttachVolumeTestJSON-265770916 None] Volume e67749ef-db7f-48c4-b683-338eab95fb96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e67749ef-db7f-48c4-b683-338eab95fb96', 'volume_size': 1} Sep 10 16:43:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-fd2331fe-5de1-4696-9242-ac74367cdd1b tempest-AttachVolumeTestJSON-265770916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:43:28 devstack sudo[94366]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7c08afd4-d65e-4bd8-8af9-ed73919b54c5 tempest-SnapshotsActionsTest-1365038666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.891abf9b-78ff-476e-89e9-f0df210f99ff 1G" returned: 0 in 0.507s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7c08afd4-d65e-4bd8-8af9-ed73919b54c5 tempest-SnapshotsActionsTest-1365038666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.891abf9b-78ff-476e-89e9-f0df210f99ff {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:28 devstack sudo[94372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.891abf9b-78ff-476e-89e9-f0df210f99ff Sep 10 16:43:28 devstack sudo[94372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:28 devstack sudo[94372]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7c08afd4-d65e-4bd8-8af9-ed73919b54c5 tempest-SnapshotsActionsTest-1365038666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.891abf9b-78ff-476e-89e9-f0df210f99ff" returned: 0 in 0.305s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:28 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-7c08afd4-d65e-4bd8-8af9-ed73919b54c5 tempest-SnapshotsActionsTest-1365038666 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.891abf9b-78ff-476e-89e9-f0df210f99ff is being set with open permissions: ugo+rw Sep 10 16:43:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7c08afd4-d65e-4bd8-8af9-ed73919b54c5 tempest-SnapshotsActionsTest-1365038666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.891abf9b-78ff-476e-89e9-f0df210f99ff {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:28 devstack sudo[94378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.891abf9b-78ff-476e-89e9-f0df210f99ff Sep 10 16:43:28 devstack sudo[94378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:29 devstack sudo[94378]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7c08afd4-d65e-4bd8-8af9-ed73919b54c5 tempest-SnapshotsActionsTest-1365038666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.891abf9b-78ff-476e-89e9-f0df210f99ff" returned: 0 in 0.325s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7c08afd4-d65e-4bd8-8af9-ed73919b54c5 tempest-SnapshotsActionsTest-1365038666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.794s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:43:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-fd2331fe-5de1-4696-9242-ac74367cdd1b tempest-AttachVolumeTestJSON-265770916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.037s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:43:29 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-fd2331fe-5de1-4696-9242-ac74367cdd1b tempest-AttachVolumeTestJSON-265770916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-126318734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e67749ef-db7f-48c4-b683-338eab95fb96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45796b0a32f14262a3bd880e56ac6b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:43:28Z,use_quota=True,user_id='9e214a2542f344cca207ec605b9b45e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:43:29 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-fd2331fe-5de1-4696-9242-ac74367cdd1b tempest-AttachVolumeTestJSON-265770916 None] Creating volume e67749ef-db7f-48c4-b683-338eab95fb96 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:43:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-fd2331fe-5de1-4696-9242-ac74367cdd1b tempest-AttachVolumeTestJSON-265770916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:43:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-fd2331fe-5de1-4696-9242-ac74367cdd1b tempest-AttachVolumeTestJSON-265770916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:43:29 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-fd2331fe-5de1-4696-9242-ac74367cdd1b tempest-AttachVolumeTestJSON-265770916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:43:29 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-fd2331fe-5de1-4696-9242-ac74367cdd1b tempest-AttachVolumeTestJSON-265770916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:43:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-fd2331fe-5de1-4696-9242-ac74367cdd1b tempest-AttachVolumeTestJSON-265770916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:43:29 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-fd2331fe-5de1-4696-9242-ac74367cdd1b tempest-AttachVolumeTestJSON-265770916 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:43:29 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-fd2331fe-5de1-4696-9242-ac74367cdd1b tempest-AttachVolumeTestJSON-265770916 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:43:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fd2331fe-5de1-4696-9242-ac74367cdd1b tempest-AttachVolumeTestJSON-265770916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e67749ef-db7f-48c4-b683-338eab95fb96 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:29 devstack sudo[94381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e67749ef-db7f-48c4-b683-338eab95fb96 1073741824 Sep 10 16:43:29 devstack sudo[94381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:29 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-7c08afd4-d65e-4bd8-8af9-ed73919b54c5 tempest-SnapshotsActionsTest-1365038666 None] Create snapshot completed successfully Sep 10 16:43:29 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bf98c0ae-6a7a-49e8-a06b-650f160981be tempest-SnapshotsActionsTest-1858371615 None] Acquiring lock "cinder-891abf9b-78ff-476e-89e9-f0df210f99ff-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:43:29 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bf98c0ae-6a7a-49e8-a06b-650f160981be tempest-SnapshotsActionsTest-1858371615 None] Lock "cinder-891abf9b-78ff-476e-89e9-f0df210f99ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:43:29 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bf98c0ae-6a7a-49e8-a06b-650f160981be tempest-SnapshotsActionsTest-1858371615 None] Acquiring lock "cinder-quobyte-079aebfe-6793-483b-8d1b-02a6f2ed44b7" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:43:29 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bf98c0ae-6a7a-49e8-a06b-650f160981be tempest-SnapshotsActionsTest-1858371615 None] Lock "cinder-quobyte-079aebfe-6793-483b-8d1b-02a6f2ed44b7" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:43:29 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bf98c0ae-6a7a-49e8-a06b-650f160981be tempest-SnapshotsActionsTest-1858371615 None] Acquiring lock "cinder-quobyte-891abf9b-78ff-476e-89e9-f0df210f99ff" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:43:29 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bf98c0ae-6a7a-49e8-a06b-650f160981be tempest-SnapshotsActionsTest-1858371615 None] Lock "cinder-quobyte-891abf9b-78ff-476e-89e9-f0df210f99ff" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:43:29 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-bf98c0ae-6a7a-49e8-a06b-650f160981be tempest-SnapshotsActionsTest-1858371615 None] Deleting offline snapshot 891abf9b-78ff-476e-89e9-f0df210f99ff of volume 079aebfe-6793-483b-8d1b-02a6f2ed44b7 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:43:29 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-bf98c0ae-6a7a-49e8-a06b-650f160981be tempest-SnapshotsActionsTest-1858371615 None] snapshot_file for this snap is: volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.891abf9b-78ff-476e-89e9-f0df210f99ff {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:43:29 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a62acc1-909a-4bc7-bfca-2c97342f3173]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:43:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bf98c0ae-6a7a-49e8-a06b-650f160981be tempest-SnapshotsActionsTest-1858371615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.891abf9b-78ff-476e-89e9-f0df210f99ff {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:29 devstack sudo[94381]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fd2331fe-5de1-4696-9242-ac74367cdd1b tempest-AttachVolumeTestJSON-265770916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e67749ef-db7f-48c4-b683-338eab95fb96 1073741824" returned: 0 in 0.583s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fd2331fe-5de1-4696-9242-ac74367cdd1b tempest-AttachVolumeTestJSON-265770916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e67749ef-db7f-48c4-b683-338eab95fb96 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:29 devstack sudo[94390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e67749ef-db7f-48c4-b683-338eab95fb96 Sep 10 16:43:29 devstack sudo[94390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:29 devstack sudo[94387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.891abf9b-78ff-476e-89e9-f0df210f99ff Sep 10 16:43:29 devstack sudo[94387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:30 devstack sudo[94390]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fd2331fe-5de1-4696-9242-ac74367cdd1b tempest-AttachVolumeTestJSON-265770916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e67749ef-db7f-48c4-b683-338eab95fb96" returned: 0 in 0.341s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-fd2331fe-5de1-4696-9242-ac74367cdd1b tempest-AttachVolumeTestJSON-265770916 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:43:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-fd2331fe-5de1-4696-9242-ac74367cdd1b tempest-AttachVolumeTestJSON-265770916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:43:30 devstack sudo[94387]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fd2331fe-5de1-4696-9242-ac74367cdd1b tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f3c48d9-eb25-4d3c-bbb6-6421f78cc599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e67749ef-db7f-48c4-b683-338eab95fb96', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:43:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fd2331fe-5de1-4696-9242-ac74367cdd1b tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca16b343-b09a-45e8-9970-b36cef42f85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:43:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bf98c0ae-6a7a-49e8-a06b-650f160981be tempest-SnapshotsActionsTest-1858371615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.891abf9b-78ff-476e-89e9-f0df210f99ff" returned: 0 in 0.483s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-bf98c0ae-6a7a-49e8-a06b-650f160981be tempest-SnapshotsActionsTest-1858371615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:43:30 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-fd2331fe-5de1-4696-9242-ac74367cdd1b tempest-AttachVolumeTestJSON-265770916 None] Volume volume-e67749ef-db7f-48c4-b683-338eab95fb96 (e67749ef-db7f-48c4-b683-338eab95fb96): created successfully Sep 10 16:43:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fd2331fe-5de1-4696-9242-ac74367cdd1b tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca16b343-b09a-45e8-9970-b36cef42f85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:43:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fd2331fe-5de1-4696-9242-ac74367cdd1b tempest-AttachVolumeTestJSON-265770916 None] Flow 'volume_create_manager' (59863cab-dd47-418e-a10d-f1ea5b86c1d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:43:30 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1441d096-7457-43b7-a54f-23be4cf77003]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:43:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bf98c0ae-6a7a-49e8-a06b-650f160981be tempest-SnapshotsActionsTest-1858371615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:30 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-fd2331fe-5de1-4696-9242-ac74367cdd1b tempest-AttachVolumeTestJSON-265770916 None] Created volume successfully. Sep 10 16:43:30 devstack sudo[94398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 Sep 10 16:43:30 devstack sudo[94398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:30 devstack sudo[94398]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bf98c0ae-6a7a-49e8-a06b-650f160981be tempest-SnapshotsActionsTest-1858371615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59" returned: 0 in 0.390s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-bf98c0ae-6a7a-49e8-a06b-650f160981be tempest-SnapshotsActionsTest-1858371615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:43:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bf98c0ae-6a7a-49e8-a06b-650f160981be tempest-SnapshotsActionsTest-1858371615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.891abf9b-78ff-476e-89e9-f0df210f99ff {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:30 devstack sudo[94403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.891abf9b-78ff-476e-89e9-f0df210f99ff Sep 10 16:43:30 devstack sudo[94403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:31 devstack sudo[94403]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bf98c0ae-6a7a-49e8-a06b-650f160981be tempest-SnapshotsActionsTest-1858371615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.891abf9b-78ff-476e-89e9-f0df210f99ff" returned: 0 in 0.561s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bf98c0ae-6a7a-49e8-a06b-650f160981be tempest-SnapshotsActionsTest-1858371615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.891abf9b-78ff-476e-89e9-f0df210f99ff {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:31 devstack sudo[94409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.891abf9b-78ff-476e-89e9-f0df210f99ff Sep 10 16:43:31 devstack sudo[94409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:31 devstack sudo[94409]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bf98c0ae-6a7a-49e8-a06b-650f160981be tempest-SnapshotsActionsTest-1858371615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.891abf9b-78ff-476e-89e9-f0df210f99ff" returned: 0 in 0.293s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:31 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bf98c0ae-6a7a-49e8-a06b-650f160981be tempest-SnapshotsActionsTest-1858371615 None] Lock "cinder-quobyte-891abf9b-78ff-476e-89e9-f0df210f99ff" released by "_delete_snapshot" :: held 1.850s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:43:31 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bf98c0ae-6a7a-49e8-a06b-650f160981be tempest-SnapshotsActionsTest-1858371615 None] Lock "cinder-quobyte-079aebfe-6793-483b-8d1b-02a6f2ed44b7" released by "delete_snapshot" :: held 1.881s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:43:31 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-bf98c0ae-6a7a-49e8-a06b-650f160981be tempest-SnapshotsActionsTest-1858371615 None] Created reservations ['e68707c0-02c7-4f42-8e6e-348b3049c459', '1e9e446b-8e8b-4d4c-8010-2302f359f310', '30d220e3-9f1a-476f-88b9-a0bce99de106', '57327da8-1495-44aa-a54c-daced412531f'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:43:31 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-bf98c0ae-6a7a-49e8-a06b-650f160981be tempest-SnapshotsActionsTest-1858371615 None] Delete snapshot completed successfully. Sep 10 16:43:31 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bf98c0ae-6a7a-49e8-a06b-650f160981be tempest-SnapshotsActionsTest-1858371615 None] Lock "cinder-891abf9b-78ff-476e-89e9-f0df210f99ff-delete_snapshot" released by "delete_snapshot" :: held 2.060s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:43:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-d91e02a0-8b66-4c71-bf62-a7d2dafeea5e req-42cfd3a7-6ac4-495a-a2c1-bd2bc6a8baca tempest-AttachVolumeTestJSON-265770916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:43:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-d91e02a0-8b66-4c71-bf62-a7d2dafeea5e req-42cfd3a7-6ac4-495a-a2c1-bd2bc6a8baca tempest-AttachVolumeTestJSON-265770916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:43:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-d91e02a0-8b66-4c71-bf62-a7d2dafeea5e req-42cfd3a7-6ac4-495a-a2c1-bd2bc6a8baca tempest-AttachVolumeTestJSON-265770916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:43:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-d91e02a0-8b66-4c71-bf62-a7d2dafeea5e req-42cfd3a7-6ac4-495a-a2c1-bd2bc6a8baca tempest-AttachVolumeTestJSON-265770916 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8', 'name': 'volume-e67749ef-db7f-48c4-b683-338eab95fb96', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b396f8ed-7042-4c1e-88ed-7e6689b7845f', 'enforce_multipath': True} {{(pid=88189) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 16:43:32 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-d91e02a0-8b66-4c71-bf62-a7d2dafeea5e req-42cfd3a7-6ac4-495a-a2c1-bd2bc6a8baca tempest-AttachVolumeTestJSON-265770916 None] attachment_update completed successfully. Sep 10 16:43:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c67c9b5e-bd1c-4cc6-9a51-c20d6d87df1b tempest-SnapshotsActionsTest-1365038666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:43:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c67c9b5e-bd1c-4cc6-9a51-c20d6d87df1b tempest-SnapshotsActionsTest-1365038666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:43:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-c67c9b5e-bd1c-4cc6-9a51-c20d6d87df1b tempest-SnapshotsActionsTest-1365038666 None] Creating offline snapshot 6855544e-3505-4788-a91c-1b038c110152 of volume 079aebfe-6793-483b-8d1b-02a6f2ed44b7 {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:43:32 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27617c4-2bb6-4741-a709-cb275e51409f]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:43:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c67c9b5e-bd1c-4cc6-9a51-c20d6d87df1b tempest-SnapshotsActionsTest-1365038666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:32 devstack sudo[94448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 Sep 10 16:43:32 devstack sudo[94448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:32 devstack sudo[94448]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c67c9b5e-bd1c-4cc6-9a51-c20d6d87df1b tempest-SnapshotsActionsTest-1365038666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59" returned: 0 in 0.589s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-c67c9b5e-bd1c-4cc6-9a51-c20d6d87df1b tempest-SnapshotsActionsTest-1365038666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:43:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c67c9b5e-bd1c-4cc6-9a51-c20d6d87df1b tempest-SnapshotsActionsTest-1365038666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.6855544e-3505-4788-a91c-1b038c110152 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:32 devstack sudo[94813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.6855544e-3505-4788-a91c-1b038c110152 1G Sep 10 16:43:32 devstack sudo[94813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:33 devstack sudo[94813]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c67c9b5e-bd1c-4cc6-9a51-c20d6d87df1b tempest-SnapshotsActionsTest-1365038666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.6855544e-3505-4788-a91c-1b038c110152 1G" returned: 0 in 0.645s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c67c9b5e-bd1c-4cc6-9a51-c20d6d87df1b tempest-SnapshotsActionsTest-1365038666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.6855544e-3505-4788-a91c-1b038c110152 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:33 devstack sudo[94820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.6855544e-3505-4788-a91c-1b038c110152 Sep 10 16:43:33 devstack sudo[94820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:33 devstack sudo[94820]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c67c9b5e-bd1c-4cc6-9a51-c20d6d87df1b tempest-SnapshotsActionsTest-1365038666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.6855544e-3505-4788-a91c-1b038c110152" returned: 0 in 0.374s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:33 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-c67c9b5e-bd1c-4cc6-9a51-c20d6d87df1b tempest-SnapshotsActionsTest-1365038666 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.6855544e-3505-4788-a91c-1b038c110152 is being set with open permissions: ugo+rw Sep 10 16:43:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c67c9b5e-bd1c-4cc6-9a51-c20d6d87df1b tempest-SnapshotsActionsTest-1365038666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.6855544e-3505-4788-a91c-1b038c110152 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:33 devstack sudo[94825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.6855544e-3505-4788-a91c-1b038c110152 Sep 10 16:43:33 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:34 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c67c9b5e-bd1c-4cc6-9a51-c20d6d87df1b tempest-SnapshotsActionsTest-1365038666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.6855544e-3505-4788-a91c-1b038c110152" returned: 0 in 0.484s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c67c9b5e-bd1c-4cc6-9a51-c20d6d87df1b tempest-SnapshotsActionsTest-1365038666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.297s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:43:34 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-c67c9b5e-bd1c-4cc6-9a51-c20d6d87df1b tempest-SnapshotsActionsTest-1365038666 None] Create snapshot completed successfully Sep 10 16:43:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-265feb0c-0e2b-4429-ab80-85384c807022 tempest-SnapshotsActionsTest-1858371615 None] Acquiring lock "cinder-6855544e-3505-4788-a91c-1b038c110152-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:43:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-265feb0c-0e2b-4429-ab80-85384c807022 tempest-SnapshotsActionsTest-1858371615 None] Lock "cinder-6855544e-3505-4788-a91c-1b038c110152-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:43:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-265feb0c-0e2b-4429-ab80-85384c807022 tempest-SnapshotsActionsTest-1858371615 None] Acquiring lock "cinder-quobyte-079aebfe-6793-483b-8d1b-02a6f2ed44b7" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:43:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-265feb0c-0e2b-4429-ab80-85384c807022 tempest-SnapshotsActionsTest-1858371615 None] Lock "cinder-quobyte-079aebfe-6793-483b-8d1b-02a6f2ed44b7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:43:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-265feb0c-0e2b-4429-ab80-85384c807022 tempest-SnapshotsActionsTest-1858371615 None] Acquiring lock "cinder-quobyte-6855544e-3505-4788-a91c-1b038c110152" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:43:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-265feb0c-0e2b-4429-ab80-85384c807022 tempest-SnapshotsActionsTest-1858371615 None] Lock "cinder-quobyte-6855544e-3505-4788-a91c-1b038c110152" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:43:35 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-265feb0c-0e2b-4429-ab80-85384c807022 tempest-SnapshotsActionsTest-1858371615 None] Deleting offline snapshot 6855544e-3505-4788-a91c-1b038c110152 of volume 079aebfe-6793-483b-8d1b-02a6f2ed44b7 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:43:35 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-265feb0c-0e2b-4429-ab80-85384c807022 tempest-SnapshotsActionsTest-1858371615 None] snapshot_file for this snap is: volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.6855544e-3505-4788-a91c-1b038c110152 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:43:35 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[933092ae-dd2e-4251-9b80-6ca407c9a104]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:43:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-265feb0c-0e2b-4429-ab80-85384c807022 tempest-SnapshotsActionsTest-1858371615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.6855544e-3505-4788-a91c-1b038c110152 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:35 devstack sudo[94834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.6855544e-3505-4788-a91c-1b038c110152 Sep 10 16:43:35 devstack sudo[94834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:36 devstack sudo[94834]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-265feb0c-0e2b-4429-ab80-85384c807022 tempest-SnapshotsActionsTest-1858371615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.6855544e-3505-4788-a91c-1b038c110152" returned: 0 in 0.469s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:36 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-265feb0c-0e2b-4429-ab80-85384c807022 tempest-SnapshotsActionsTest-1858371615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:43:36 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0458c6-7953-472a-9806-0332b9c6621b]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:43:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-265feb0c-0e2b-4429-ab80-85384c807022 tempest-SnapshotsActionsTest-1858371615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:36 devstack sudo[94839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 Sep 10 16:43:36 devstack sudo[94839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:36 devstack sudo[94839]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-265feb0c-0e2b-4429-ab80-85384c807022 tempest-SnapshotsActionsTest-1858371615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59" returned: 0 in 0.548s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:36 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-265feb0c-0e2b-4429-ab80-85384c807022 tempest-SnapshotsActionsTest-1858371615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:43:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-265feb0c-0e2b-4429-ab80-85384c807022 tempest-SnapshotsActionsTest-1858371615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.6855544e-3505-4788-a91c-1b038c110152 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:36 devstack sudo[94846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.6855544e-3505-4788-a91c-1b038c110152 Sep 10 16:43:36 devstack sudo[94846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:37 devstack sudo[94846]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-265feb0c-0e2b-4429-ab80-85384c807022 tempest-SnapshotsActionsTest-1858371615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.6855544e-3505-4788-a91c-1b038c110152" returned: 0 in 0.508s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-265feb0c-0e2b-4429-ab80-85384c807022 tempest-SnapshotsActionsTest-1858371615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.6855544e-3505-4788-a91c-1b038c110152 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:37 devstack sudo[94852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.6855544e-3505-4788-a91c-1b038c110152 Sep 10 16:43:37 devstack sudo[94852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:37 devstack sudo[94852]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-265feb0c-0e2b-4429-ab80-85384c807022 tempest-SnapshotsActionsTest-1858371615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.6855544e-3505-4788-a91c-1b038c110152" returned: 0 in 0.373s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:37 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-265feb0c-0e2b-4429-ab80-85384c807022 tempest-SnapshotsActionsTest-1858371615 None] Lock "cinder-quobyte-6855544e-3505-4788-a91c-1b038c110152" released by "_delete_snapshot" :: held 2.101s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:43:37 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-265feb0c-0e2b-4429-ab80-85384c807022 tempest-SnapshotsActionsTest-1858371615 None] Lock "cinder-quobyte-079aebfe-6793-483b-8d1b-02a6f2ed44b7" released by "delete_snapshot" :: held 2.137s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:43:37 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-265feb0c-0e2b-4429-ab80-85384c807022 tempest-SnapshotsActionsTest-1858371615 None] Created reservations ['73995773-7994-4e12-b99f-c04f5546c42e', '8fd551f9-fb9c-482b-bc88-19bfa8f88e1b', '4b72d82d-e958-474f-b470-e00e587c93f0', '6121f0d6-8a9b-4299-b66c-708538e88855'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:43:37 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-265feb0c-0e2b-4429-ab80-85384c807022 tempest-SnapshotsActionsTest-1858371615 None] Delete snapshot completed successfully. Sep 10 16:43:38 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-265feb0c-0e2b-4429-ab80-85384c807022 tempest-SnapshotsActionsTest-1858371615 None] Lock "cinder-6855544e-3505-4788-a91c-1b038c110152-delete_snapshot" released by "delete_snapshot" :: held 2.426s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:43:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ce962549-8d0a-472c-96c3-78bb58e3a360 tempest-SnapshotsActionsTest-1365038666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:43:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ce962549-8d0a-472c-96c3-78bb58e3a360 tempest-SnapshotsActionsTest-1365038666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:43:39 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-ce962549-8d0a-472c-96c3-78bb58e3a360 tempest-SnapshotsActionsTest-1365038666 None] Creating offline snapshot 1a7fd639-2b3c-46ee-9f9b-34cb609f4558 of volume 079aebfe-6793-483b-8d1b-02a6f2ed44b7 {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:43:39 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbd6d0c-a28f-4245-bfc0-c394a0128e7e]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:43:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ce962549-8d0a-472c-96c3-78bb58e3a360 tempest-SnapshotsActionsTest-1365038666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:39 devstack sudo[95339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 Sep 10 16:43:39 devstack sudo[95339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:40 devstack sudo[95339]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ce962549-8d0a-472c-96c3-78bb58e3a360 tempest-SnapshotsActionsTest-1365038666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59" returned: 0 in 0.678s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:40 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-ce962549-8d0a-472c-96c3-78bb58e3a360 tempest-SnapshotsActionsTest-1365038666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:43:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ce962549-8d0a-472c-96c3-78bb58e3a360 tempest-SnapshotsActionsTest-1365038666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.1a7fd639-2b3c-46ee-9f9b-34cb609f4558 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:40 devstack sudo[95360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.1a7fd639-2b3c-46ee-9f9b-34cb609f4558 1G Sep 10 16:43:40 devstack sudo[95360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:40 devstack sudo[95360]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ce962549-8d0a-472c-96c3-78bb58e3a360 tempest-SnapshotsActionsTest-1365038666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.1a7fd639-2b3c-46ee-9f9b-34cb609f4558 1G" returned: 0 in 0.594s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ce962549-8d0a-472c-96c3-78bb58e3a360 tempest-SnapshotsActionsTest-1365038666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.1a7fd639-2b3c-46ee-9f9b-34cb609f4558 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:41 devstack sudo[95371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.1a7fd639-2b3c-46ee-9f9b-34cb609f4558 Sep 10 16:43:41 devstack sudo[95371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:41 devstack sudo[95371]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ce962549-8d0a-472c-96c3-78bb58e3a360 tempest-SnapshotsActionsTest-1365038666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.1a7fd639-2b3c-46ee-9f9b-34cb609f4558" returned: 0 in 0.580s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:41 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-ce962549-8d0a-472c-96c3-78bb58e3a360 tempest-SnapshotsActionsTest-1365038666 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.1a7fd639-2b3c-46ee-9f9b-34cb609f4558 is being set with open permissions: ugo+rw Sep 10 16:43:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ce962549-8d0a-472c-96c3-78bb58e3a360 tempest-SnapshotsActionsTest-1365038666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.1a7fd639-2b3c-46ee-9f9b-34cb609f4558 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:41 devstack sudo[95376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.1a7fd639-2b3c-46ee-9f9b-34cb609f4558 Sep 10 16:43:41 devstack sudo[95376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:41 devstack sudo[95376]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ce962549-8d0a-472c-96c3-78bb58e3a360 tempest-SnapshotsActionsTest-1365038666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.1a7fd639-2b3c-46ee-9f9b-34cb609f4558" returned: 0 in 0.421s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ce962549-8d0a-472c-96c3-78bb58e3a360 tempest-SnapshotsActionsTest-1365038666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.452s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:43:42 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-ce962549-8d0a-472c-96c3-78bb58e3a360 tempest-SnapshotsActionsTest-1365038666 None] Create snapshot completed successfully Sep 10 16:43:42 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8c744cc2-32db-40a2-b819-99cb1859282e tempest-SnapshotsActionsTest-1858371615 None] Acquiring lock "cinder-1a7fd639-2b3c-46ee-9f9b-34cb609f4558-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:43:42 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8c744cc2-32db-40a2-b819-99cb1859282e tempest-SnapshotsActionsTest-1858371615 None] Lock "cinder-1a7fd639-2b3c-46ee-9f9b-34cb609f4558-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:43:42 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8c744cc2-32db-40a2-b819-99cb1859282e tempest-SnapshotsActionsTest-1858371615 None] Acquiring lock "cinder-quobyte-079aebfe-6793-483b-8d1b-02a6f2ed44b7" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:43:43 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8c744cc2-32db-40a2-b819-99cb1859282e tempest-SnapshotsActionsTest-1858371615 None] Lock "cinder-quobyte-079aebfe-6793-483b-8d1b-02a6f2ed44b7" acquired by "delete_snapshot" :: waited 0.049s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:43:43 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8c744cc2-32db-40a2-b819-99cb1859282e tempest-SnapshotsActionsTest-1858371615 None] Acquiring lock "cinder-quobyte-1a7fd639-2b3c-46ee-9f9b-34cb609f4558" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:43:43 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8c744cc2-32db-40a2-b819-99cb1859282e tempest-SnapshotsActionsTest-1858371615 None] Lock "cinder-quobyte-1a7fd639-2b3c-46ee-9f9b-34cb609f4558" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:43:43 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-8c744cc2-32db-40a2-b819-99cb1859282e tempest-SnapshotsActionsTest-1858371615 None] Deleting offline snapshot 1a7fd639-2b3c-46ee-9f9b-34cb609f4558 of volume 079aebfe-6793-483b-8d1b-02a6f2ed44b7 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:43:43 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-8c744cc2-32db-40a2-b819-99cb1859282e tempest-SnapshotsActionsTest-1858371615 None] snapshot_file for this snap is: volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.1a7fd639-2b3c-46ee-9f9b-34cb609f4558 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:43:43 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6ef355-c4a9-4a86-a3e2-ab03132e02ca]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:43:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8c744cc2-32db-40a2-b819-99cb1859282e tempest-SnapshotsActionsTest-1858371615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.1a7fd639-2b3c-46ee-9f9b-34cb609f4558 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:43 devstack sudo[95380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.1a7fd639-2b3c-46ee-9f9b-34cb609f4558 Sep 10 16:43:43 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:43 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8c744cc2-32db-40a2-b819-99cb1859282e tempest-SnapshotsActionsTest-1858371615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.1a7fd639-2b3c-46ee-9f9b-34cb609f4558" returned: 0 in 0.559s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:43 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-8c744cc2-32db-40a2-b819-99cb1859282e tempest-SnapshotsActionsTest-1858371615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:43:43 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01688db-cac8-4262-b713-444bb2ff44f0]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:43:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8c744cc2-32db-40a2-b819-99cb1859282e tempest-SnapshotsActionsTest-1858371615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:43 devstack sudo[95386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 Sep 10 16:43:43 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:44 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8c744cc2-32db-40a2-b819-99cb1859282e tempest-SnapshotsActionsTest-1858371615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59" returned: 0 in 0.462s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:44 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-8c744cc2-32db-40a2-b819-99cb1859282e tempest-SnapshotsActionsTest-1858371615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:43:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8c744cc2-32db-40a2-b819-99cb1859282e tempest-SnapshotsActionsTest-1858371615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.1a7fd639-2b3c-46ee-9f9b-34cb609f4558 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:44 devstack sudo[95392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.1a7fd639-2b3c-46ee-9f9b-34cb609f4558 Sep 10 16:43:44 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:44 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8c744cc2-32db-40a2-b819-99cb1859282e tempest-SnapshotsActionsTest-1858371615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.1a7fd639-2b3c-46ee-9f9b-34cb609f4558" returned: 0 in 0.445s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8c744cc2-32db-40a2-b819-99cb1859282e tempest-SnapshotsActionsTest-1858371615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.1a7fd639-2b3c-46ee-9f9b-34cb609f4558 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:44 devstack sudo[95398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.1a7fd639-2b3c-46ee-9f9b-34cb609f4558 Sep 10 16:43:44 devstack sudo[95398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:45 devstack sudo[95398]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8c744cc2-32db-40a2-b819-99cb1859282e tempest-SnapshotsActionsTest-1858371615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.1a7fd639-2b3c-46ee-9f9b-34cb609f4558" returned: 0 in 0.479s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:45 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8c744cc2-32db-40a2-b819-99cb1859282e tempest-SnapshotsActionsTest-1858371615 None] Lock "cinder-quobyte-1a7fd639-2b3c-46ee-9f9b-34cb609f4558" released by "_delete_snapshot" :: held 2.100s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:43:45 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8c744cc2-32db-40a2-b819-99cb1859282e tempest-SnapshotsActionsTest-1858371615 None] Lock "cinder-quobyte-079aebfe-6793-483b-8d1b-02a6f2ed44b7" released by "delete_snapshot" :: held 2.152s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:43:45 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-8c744cc2-32db-40a2-b819-99cb1859282e tempest-SnapshotsActionsTest-1858371615 None] Created reservations ['f256ecb4-962a-4b18-8859-9090706f1955', 'b45d9f90-c1eb-4efc-9df5-b43f84f2a38d', '9d304c2b-f9a0-4067-8a31-80bda3b8fdb3', '417de31d-6506-489e-89e7-739ae720cc51'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:43:45 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-8c744cc2-32db-40a2-b819-99cb1859282e tempest-SnapshotsActionsTest-1858371615 None] Delete snapshot completed successfully. Sep 10 16:43:45 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8c744cc2-32db-40a2-b819-99cb1859282e tempest-SnapshotsActionsTest-1858371615 None] Lock "cinder-1a7fd639-2b3c-46ee-9f9b-34cb609f4558-delete_snapshot" released by "delete_snapshot" :: held 2.444s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:43:47 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-3245b6e5-52e2-4510-968d-cf6e997a46d7 tempest-SnapshotsActionsTest-1365038666 None] Acquiring lock "cinder-65b89278-22e9-4b76-aecb-f500578ddf59-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:43:47 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-3245b6e5-52e2-4510-968d-cf6e997a46d7 tempest-SnapshotsActionsTest-1365038666 None] Lock "cinder-65b89278-22e9-4b76-aecb-f500578ddf59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:43:47 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-3245b6e5-52e2-4510-968d-cf6e997a46d7 tempest-SnapshotsActionsTest-1365038666 None] Acquiring lock "cinder-quobyte-079aebfe-6793-483b-8d1b-02a6f2ed44b7" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:43:47 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-3245b6e5-52e2-4510-968d-cf6e997a46d7 tempest-SnapshotsActionsTest-1365038666 None] Lock "cinder-quobyte-079aebfe-6793-483b-8d1b-02a6f2ed44b7" acquired by "delete_snapshot" :: waited 0.050s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:43:47 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-3245b6e5-52e2-4510-968d-cf6e997a46d7 tempest-SnapshotsActionsTest-1365038666 None] Acquiring lock "cinder-quobyte-65b89278-22e9-4b76-aecb-f500578ddf59" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:43:47 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-3245b6e5-52e2-4510-968d-cf6e997a46d7 tempest-SnapshotsActionsTest-1365038666 None] Lock "cinder-quobyte-65b89278-22e9-4b76-aecb-f500578ddf59" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:43:47 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-3245b6e5-52e2-4510-968d-cf6e997a46d7 tempest-SnapshotsActionsTest-1365038666 None] Deleting offline snapshot 65b89278-22e9-4b76-aecb-f500578ddf59 of volume 079aebfe-6793-483b-8d1b-02a6f2ed44b7 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:43:47 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-3245b6e5-52e2-4510-968d-cf6e997a46d7 tempest-SnapshotsActionsTest-1365038666 None] snapshot_file for this snap is: volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:43:47 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0675b7b-5245-4d4d-986f-da26f70f78eb]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:43:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3245b6e5-52e2-4510-968d-cf6e997a46d7 tempest-SnapshotsActionsTest-1365038666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:47 devstack sudo[95410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 Sep 10 16:43:47 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:48 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3245b6e5-52e2-4510-968d-cf6e997a46d7 tempest-SnapshotsActionsTest-1365038666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59" returned: 0 in 0.725s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:48 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-3245b6e5-52e2-4510-968d-cf6e997a46d7 tempest-SnapshotsActionsTest-1365038666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:43:48 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a58035-b5b2-4dfc-80c6-6803d4a8dbeb]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:43:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3245b6e5-52e2-4510-968d-cf6e997a46d7 tempest-SnapshotsActionsTest-1365038666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:48 devstack sudo[95415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7 Sep 10 16:43:48 devstack sudo[95415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:48 devstack sudo[95415]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3245b6e5-52e2-4510-968d-cf6e997a46d7 tempest-SnapshotsActionsTest-1365038666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7" returned: 0 in 0.653s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3245b6e5-52e2-4510-968d-cf6e997a46d7 tempest-SnapshotsActionsTest-1365038666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:48 devstack sudo[95420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 Sep 10 16:43:48 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:49 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3245b6e5-52e2-4510-968d-cf6e997a46d7 tempest-SnapshotsActionsTest-1365038666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59" returned: 0 in 0.560s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3245b6e5-52e2-4510-968d-cf6e997a46d7 tempest-SnapshotsActionsTest-1365038666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:49 devstack sudo[95425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59 Sep 10 16:43:49 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:43:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:43:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:43:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:43:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:43:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:43:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:49 devstack sudo[95427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:43:49 devstack sudo[95427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:49 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3245b6e5-52e2-4510-968d-cf6e997a46d7 tempest-SnapshotsActionsTest-1365038666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7.65b89278-22e9-4b76-aecb-f500578ddf59" returned: 0 in 0.489s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:49 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-3245b6e5-52e2-4510-968d-cf6e997a46d7 tempest-SnapshotsActionsTest-1365038666 None] Lock "cinder-quobyte-65b89278-22e9-4b76-aecb-f500578ddf59" released by "_delete_snapshot" :: held 2.639s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:43:49 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-3245b6e5-52e2-4510-968d-cf6e997a46d7 tempest-SnapshotsActionsTest-1365038666 None] Lock "cinder-quobyte-079aebfe-6793-483b-8d1b-02a6f2ed44b7" released by "delete_snapshot" :: held 2.695s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:43:49 devstack sudo[95427]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.421s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:49 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:43:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager._thread_info {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:43:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread count: 28 {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 16:43:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread info: [<_MainThread(MainThread, started 125792070905984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 16:43:50 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-3245b6e5-52e2-4510-968d-cf6e997a46d7 tempest-SnapshotsActionsTest-1365038666 None] Created reservations ['fcd76470-7c97-403d-a880-71b575a539cc', 'a0a68c51-dbb4-4a0a-b9e7-9f43903c5ea4', '253886b6-371a-4fc1-9d7a-ae7aba2d5938', '973dd500-b69f-41b8-a681-bb09167e86d0'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:43:50 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-3245b6e5-52e2-4510-968d-cf6e997a46d7 tempest-SnapshotsActionsTest-1365038666 None] Delete snapshot completed successfully. Sep 10 16:43:50 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-3245b6e5-52e2-4510-968d-cf6e997a46d7 tempest-SnapshotsActionsTest-1365038666 None] Lock "cinder-65b89278-22e9-4b76-aecb-f500578ddf59-delete_snapshot" released by "delete_snapshot" :: held 2.966s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:43:50 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-14a4083d-690e-46ff-a103-e7ba497d97e7 tempest-SnapshotsActionsTest-1365038666 None] Acquiring lock "cinder-079aebfe-6793-483b-8d1b-02a6f2ed44b7-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:43:50 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-14a4083d-690e-46ff-a103-e7ba497d97e7 tempest-SnapshotsActionsTest-1365038666 None] Lock "cinder-079aebfe-6793-483b-8d1b-02a6f2ed44b7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:43:50 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-14a4083d-690e-46ff-a103-e7ba497d97e7 tempest-SnapshotsActionsTest-1365038666 None] Acquiring lock "cinder-quobyte-079aebfe-6793-483b-8d1b-02a6f2ed44b7" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:43:50 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-14a4083d-690e-46ff-a103-e7ba497d97e7 tempest-SnapshotsActionsTest-1365038666 None] Lock "cinder-quobyte-079aebfe-6793-483b-8d1b-02a6f2ed44b7" acquired by "delete_volume" :: waited 0.040s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:43:50 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa09c5c3-a94f-41fc-a8dc-6380c03a99de]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:43:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-14a4083d-690e-46ff-a103-e7ba497d97e7 tempest-SnapshotsActionsTest-1365038666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:50 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7 Sep 10 16:43:50 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:51 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-14a4083d-690e-46ff-a103-e7ba497d97e7 tempest-SnapshotsActionsTest-1365038666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7" returned: 0 in 0.647s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-14a4083d-690e-46ff-a103-e7ba497d97e7 tempest-SnapshotsActionsTest-1365038666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:51 devstack sudo[95437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7 Sep 10 16:43:51 devstack sudo[95437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:51 devstack sudo[95437]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-14a4083d-690e-46ff-a103-e7ba497d97e7 tempest-SnapshotsActionsTest-1365038666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-079aebfe-6793-483b-8d1b-02a6f2ed44b7" returned: 0 in 0.504s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:51 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-14a4083d-690e-46ff-a103-e7ba497d97e7 tempest-SnapshotsActionsTest-1365038666 None] Lock "cinder-quobyte-079aebfe-6793-483b-8d1b-02a6f2ed44b7" released by "delete_volume" :: held 1.253s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:43:52 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-14a4083d-690e-46ff-a103-e7ba497d97e7 tempest-SnapshotsActionsTest-1365038666 None] Created reservations ['1f70dbcd-a754-460b-bd35-81718e6f7d2e', '853249ed-56a3-462d-b4f7-7be47de5f410', '93c7b3a5-9591-474f-95a6-3ae77d54fcb1', '95aee2c6-5a57-4994-ad1b-7ef9990df539'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:43:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-14a4083d-690e-46ff-a103-e7ba497d97e7 tempest-SnapshotsActionsTest-1365038666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:43:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-14a4083d-690e-46ff-a103-e7ba497d97e7 tempest-SnapshotsActionsTest-1365038666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:43:52 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-14a4083d-690e-46ff-a103-e7ba497d97e7 tempest-SnapshotsActionsTest-1365038666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:43:52 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-14a4083d-690e-46ff-a103-e7ba497d97e7 tempest-SnapshotsActionsTest-1365038666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:43:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-14a4083d-690e-46ff-a103-e7ba497d97e7 tempest-SnapshotsActionsTest-1365038666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:43:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-14a4083d-690e-46ff-a103-e7ba497d97e7 tempest-SnapshotsActionsTest-1365038666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:43:52 devstack sudo[95440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:43:52 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:43:52 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root Sep 10 16:43:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-14a4083d-690e-46ff-a103-e7ba497d97e7 tempest-SnapshotsActionsTest-1365038666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.388s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:43:52 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-14a4083d-690e-46ff-a103-e7ba497d97e7 tempest-SnapshotsActionsTest-1365038666 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:43:52 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-14a4083d-690e-46ff-a103-e7ba497d97e7 tempest-SnapshotsActionsTest-1365038666 None] Deleted volume successfully. Sep 10 16:43:52 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-14a4083d-690e-46ff-a103-e7ba497d97e7 tempest-SnapshotsActionsTest-1365038666 None] Lock "cinder-079aebfe-6793-483b-8d1b-02a6f2ed44b7-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:44:02 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=71,cinder:UPDATE=68,cinder:INSERT=22,cinder:DELETE=5 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:44:02 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=71,cinder:UPDATE=84,cinder:DELETE=7,cinder:INSERT=18 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:44:06 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-afc0e612-27bd-4da1-ba98-33e77f1547ae req-994e8e34-9b07-419c-86a2-4948698868ff tempest-AttachVolumeTestJSON-265770916 None] Terminate volume connection completed successfully. Sep 10 16:44:06 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-afc0e612-27bd-4da1-ba98-33e77f1547ae req-994e8e34-9b07-419c-86a2-4948698868ff tempest-AttachVolumeTestJSON-265770916 None] Deleting attachment b396f8ed-7042-4c1e-88ed-7e6689b7845f. {{(pid=88189) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 16:44:16 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=1 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:44:16 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=1 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:44:17 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-acc80090-33c5-4d86-ac04-463f17f2f4ba tempest-VolumesServicesTestJSON-1163226485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:44:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-acc80090-33c5-4d86-ac04-463f17f2f4ba tempest-VolumesServicesTestJSON-1163226485 None] Flow 'volume_create_manager' (15abd114-d05a-4ce4-8026-6250e69e5ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:44:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-acc80090-33c5-4d86-ac04-463f17f2f4ba tempest-VolumesServicesTestJSON-1163226485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7caa8165-43b5-4628-b772-5502849a8e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-acc80090-33c5-4d86-ac04-463f17f2f4ba tempest-VolumesServicesTestJSON-1163226485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7caa8165-43b5-4628-b772-5502849a8e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1233362025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6584be1f-c93a-4b70-8a97-19bc9643e232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d71b52f5665421da1ae60aef6e3aa05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:44:17Z,use_quota=True,user_id='1bfaefe9f137426babef052bd55a1680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-acc80090-33c5-4d86-ac04-463f17f2f4ba tempest-VolumesServicesTestJSON-1163226485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee1935c6-4479-411f-b50b-1085575d82b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-acc80090-33c5-4d86-ac04-463f17f2f4ba tempest-VolumesServicesTestJSON-1163226485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee1935c6-4479-411f-b50b-1085575d82b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-acc80090-33c5-4d86-ac04-463f17f2f4ba tempest-VolumesServicesTestJSON-1163226485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (963f6d6a-26db-4c92-b6ed-b953b299e216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-acc80090-33c5-4d86-ac04-463f17f2f4ba tempest-VolumesServicesTestJSON-1163226485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (963f6d6a-26db-4c92-b6ed-b953b299e216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6584be1f-c93a-4b70-8a97-19bc9643e232', 'volume_name': 'volume-6584be1f-c93a-4b70-8a97-19bc9643e232', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-acc80090-33c5-4d86-ac04-463f17f2f4ba tempest-VolumesServicesTestJSON-1163226485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b7d838-978f-4a2f-ae1c-dd9374fd6977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-acc80090-33c5-4d86-ac04-463f17f2f4ba tempest-VolumesServicesTestJSON-1163226485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b7d838-978f-4a2f-ae1c-dd9374fd6977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-acc80090-33c5-4d86-ac04-463f17f2f4ba tempest-VolumesServicesTestJSON-1163226485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d754df2c-3115-4540-a36d-d258a27e8ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:17 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-acc80090-33c5-4d86-ac04-463f17f2f4ba tempest-VolumesServicesTestJSON-1163226485 None] Volume 6584be1f-c93a-4b70-8a97-19bc9643e232: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6584be1f-c93a-4b70-8a97-19bc9643e232', 'volume_size': 1} Sep 10 16:44:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-acc80090-33c5-4d86-ac04-463f17f2f4ba tempest-VolumesServicesTestJSON-1163226485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:44:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-acc80090-33c5-4d86-ac04-463f17f2f4ba tempest-VolumesServicesTestJSON-1163226485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:44:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-acc80090-33c5-4d86-ac04-463f17f2f4ba tempest-VolumesServicesTestJSON-1163226485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1233362025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6584be1f-c93a-4b70-8a97-19bc9643e232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d71b52f5665421da1ae60aef6e3aa05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:44:17Z,use_quota=True,user_id='1bfaefe9f137426babef052bd55a1680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:44:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-acc80090-33c5-4d86-ac04-463f17f2f4ba tempest-VolumesServicesTestJSON-1163226485 None] Creating volume 6584be1f-c93a-4b70-8a97-19bc9643e232 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:44:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-acc80090-33c5-4d86-ac04-463f17f2f4ba tempest-VolumesServicesTestJSON-1163226485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:44:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-acc80090-33c5-4d86-ac04-463f17f2f4ba tempest-VolumesServicesTestJSON-1163226485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:44:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-acc80090-33c5-4d86-ac04-463f17f2f4ba tempest-VolumesServicesTestJSON-1163226485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:44:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-acc80090-33c5-4d86-ac04-463f17f2f4ba tempest-VolumesServicesTestJSON-1163226485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:44:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-acc80090-33c5-4d86-ac04-463f17f2f4ba tempest-VolumesServicesTestJSON-1163226485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:44:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-acc80090-33c5-4d86-ac04-463f17f2f4ba tempest-VolumesServicesTestJSON-1163226485 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:44:17 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-acc80090-33c5-4d86-ac04-463f17f2f4ba tempest-VolumesServicesTestJSON-1163226485 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:44:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-acc80090-33c5-4d86-ac04-463f17f2f4ba tempest-VolumesServicesTestJSON-1163226485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6584be1f-c93a-4b70-8a97-19bc9643e232 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:17 devstack sudo[95720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6584be1f-c93a-4b70-8a97-19bc9643e232 1073741824 Sep 10 16:44:17 devstack sudo[95720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:18 devstack sudo[95720]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-acc80090-33c5-4d86-ac04-463f17f2f4ba tempest-VolumesServicesTestJSON-1163226485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6584be1f-c93a-4b70-8a97-19bc9643e232 1073741824" returned: 0 in 1.083s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-acc80090-33c5-4d86-ac04-463f17f2f4ba tempest-VolumesServicesTestJSON-1163226485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6584be1f-c93a-4b70-8a97-19bc9643e232 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:19 devstack sudo[95739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6584be1f-c93a-4b70-8a97-19bc9643e232 Sep 10 16:44:19 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:19 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-acc80090-33c5-4d86-ac04-463f17f2f4ba tempest-VolumesServicesTestJSON-1163226485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6584be1f-c93a-4b70-8a97-19bc9643e232" returned: 0 in 0.681s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:19 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-acc80090-33c5-4d86-ac04-463f17f2f4ba tempest-VolumesServicesTestJSON-1163226485 None] <== create_volume: return (1863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:44:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-acc80090-33c5-4d86-ac04-463f17f2f4ba tempest-VolumesServicesTestJSON-1163226485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.871s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:44:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-acc80090-33c5-4d86-ac04-463f17f2f4ba tempest-VolumesServicesTestJSON-1163226485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d754df2c-3115-4540-a36d-d258a27e8ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6584be1f-c93a-4b70-8a97-19bc9643e232', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-acc80090-33c5-4d86-ac04-463f17f2f4ba tempest-VolumesServicesTestJSON-1163226485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b609e821-5281-4916-8e1c-a501dccaa2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:19 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-acc80090-33c5-4d86-ac04-463f17f2f4ba tempest-VolumesServicesTestJSON-1163226485 None] Volume volume-6584be1f-c93a-4b70-8a97-19bc9643e232 (6584be1f-c93a-4b70-8a97-19bc9643e232): created successfully Sep 10 16:44:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-acc80090-33c5-4d86-ac04-463f17f2f4ba tempest-VolumesServicesTestJSON-1163226485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b609e821-5281-4916-8e1c-a501dccaa2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-acc80090-33c5-4d86-ac04-463f17f2f4ba tempest-VolumesServicesTestJSON-1163226485 None] Flow 'volume_create_manager' (15abd114-d05a-4ce4-8026-6250e69e5ac0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:44:19 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-acc80090-33c5-4d86-ac04-463f17f2f4ba tempest-VolumesServicesTestJSON-1163226485 None] Created volume successfully. Sep 10 16:44:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-34711baf-3b25-441f-bef5-44d386588dab tempest-VolumesServicesTestJSON-1163226485 None] Acquiring lock "cinder-6584be1f-c93a-4b70-8a97-19bc9643e232-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:44:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-34711baf-3b25-441f-bef5-44d386588dab tempest-VolumesServicesTestJSON-1163226485 None] Lock "cinder-6584be1f-c93a-4b70-8a97-19bc9643e232-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:44:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-34711baf-3b25-441f-bef5-44d386588dab tempest-VolumesServicesTestJSON-1163226485 None] Acquiring lock "cinder-quobyte-6584be1f-c93a-4b70-8a97-19bc9643e232" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:44:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-34711baf-3b25-441f-bef5-44d386588dab tempest-VolumesServicesTestJSON-1163226485 None] Lock "cinder-quobyte-6584be1f-c93a-4b70-8a97-19bc9643e232" acquired by "delete_volume" :: waited 0.034s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:44:21 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[187c6664-e9cc-450e-b2c3-bf00cb05100b]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:44:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-34711baf-3b25-441f-bef5-44d386588dab tempest-VolumesServicesTestJSON-1163226485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6584be1f-c93a-4b70-8a97-19bc9643e232 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:21 devstack sudo[95745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6584be1f-c93a-4b70-8a97-19bc9643e232 Sep 10 16:44:21 devstack sudo[95745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:21 devstack sudo[95745]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-34711baf-3b25-441f-bef5-44d386588dab tempest-VolumesServicesTestJSON-1163226485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6584be1f-c93a-4b70-8a97-19bc9643e232" returned: 0 in 0.507s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-34711baf-3b25-441f-bef5-44d386588dab tempest-VolumesServicesTestJSON-1163226485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6584be1f-c93a-4b70-8a97-19bc9643e232 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:21 devstack sudo[95750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6584be1f-c93a-4b70-8a97-19bc9643e232 Sep 10 16:44:21 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:22 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-34711baf-3b25-441f-bef5-44d386588dab tempest-VolumesServicesTestJSON-1163226485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6584be1f-c93a-4b70-8a97-19bc9643e232" returned: 0 in 1.068s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:22 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-34711baf-3b25-441f-bef5-44d386588dab tempest-VolumesServicesTestJSON-1163226485 None] Lock "cinder-quobyte-6584be1f-c93a-4b70-8a97-19bc9643e232" released by "delete_volume" :: held 1.730s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:44:23 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-34711baf-3b25-441f-bef5-44d386588dab tempest-VolumesServicesTestJSON-1163226485 None] Created reservations ['7e85876d-da32-46d9-8201-a32ca59add51', 'd3c168de-2026-4d54-a80b-94d5119ce6c7', 'd49275e1-16ac-4349-9ad0-efa29200c6e8', '00b0ef83-8225-4316-9c84-488435f541b4'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:44:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-34711baf-3b25-441f-bef5-44d386588dab tempest-VolumesServicesTestJSON-1163226485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:44:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-34711baf-3b25-441f-bef5-44d386588dab tempest-VolumesServicesTestJSON-1163226485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:44:23 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-34711baf-3b25-441f-bef5-44d386588dab tempest-VolumesServicesTestJSON-1163226485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:44:23 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-34711baf-3b25-441f-bef5-44d386588dab tempest-VolumesServicesTestJSON-1163226485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:44:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-34711baf-3b25-441f-bef5-44d386588dab tempest-VolumesServicesTestJSON-1163226485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:44:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-34711baf-3b25-441f-bef5-44d386588dab tempest-VolumesServicesTestJSON-1163226485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:23 devstack sudo[95814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:44:23 devstack sudo[95814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:24 devstack sudo[95814]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-34711baf-3b25-441f-bef5-44d386588dab tempest-VolumesServicesTestJSON-1163226485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.917s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:24 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-34711baf-3b25-441f-bef5-44d386588dab tempest-VolumesServicesTestJSON-1163226485 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:44:24 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-34711baf-3b25-441f-bef5-44d386588dab tempest-VolumesServicesTestJSON-1163226485 None] Deleted volume successfully. Sep 10 16:44:24 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-34711baf-3b25-441f-bef5-44d386588dab tempest-VolumesServicesTestJSON-1163226485 None] Lock "cinder-6584be1f-c93a-4b70-8a97-19bc9643e232-delete_volume" released by "delete_volume" :: held 3.164s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:44:27 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e54ff37-29d2-4101-8cbb-19280349dca2 tempest-VolumesActionsTest-1449905026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:44:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9e54ff37-29d2-4101-8cbb-19280349dca2 tempest-VolumesActionsTest-1449905026 None] Flow 'volume_create_manager' (db2ebc79-cff1-463c-a522-01e8c9e33c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:44:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9e54ff37-29d2-4101-8cbb-19280349dca2 tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (220f16e7-2ecd-4de0-a486-7edf4d865014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9e54ff37-29d2-4101-8cbb-19280349dca2 tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (220f16e7-2ecd-4de0-a486-7edf4d865014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-100920603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7d82f46-6afa-4c35-810c-f7a36ff147e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14538eec33cc4b48b06e1d3ba24b6165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:44:28Z,use_quota=True,user_id='fd9af4f2d013477a8191785fe708d35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9e54ff37-29d2-4101-8cbb-19280349dca2 tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0acbbe3a-0344-4091-a9ee-06dea4cef338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9e54ff37-29d2-4101-8cbb-19280349dca2 tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0acbbe3a-0344-4091-a9ee-06dea4cef338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9e54ff37-29d2-4101-8cbb-19280349dca2 tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd8ee32-c808-4fa3-94da-946ed44605f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9e54ff37-29d2-4101-8cbb-19280349dca2 tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd8ee32-c808-4fa3-94da-946ed44605f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7d82f46-6afa-4c35-810c-f7a36ff147e8', 'volume_name': 'volume-a7d82f46-6afa-4c35-810c-f7a36ff147e8', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9e54ff37-29d2-4101-8cbb-19280349dca2 tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (799e959d-d482-4e7d-9343-4f3789fd02e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9e54ff37-29d2-4101-8cbb-19280349dca2 tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (799e959d-d482-4e7d-9343-4f3789fd02e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9e54ff37-29d2-4101-8cbb-19280349dca2 tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77134f39-9d4f-4c94-936f-8f59f66631ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:27 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-9e54ff37-29d2-4101-8cbb-19280349dca2 tempest-VolumesActionsTest-1449905026 None] Volume a7d82f46-6afa-4c35-810c-f7a36ff147e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7d82f46-6afa-4c35-810c-f7a36ff147e8', 'volume_size': 1} Sep 10 16:44:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9e54ff37-29d2-4101-8cbb-19280349dca2 tempest-VolumesActionsTest-1449905026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:44:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9e54ff37-29d2-4101-8cbb-19280349dca2 tempest-VolumesActionsTest-1449905026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:44:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9e54ff37-29d2-4101-8cbb-19280349dca2 tempest-VolumesActionsTest-1449905026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-100920603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7d82f46-6afa-4c35-810c-f7a36ff147e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14538eec33cc4b48b06e1d3ba24b6165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:44:28Z,use_quota=True,user_id='fd9af4f2d013477a8191785fe708d35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:44:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-9e54ff37-29d2-4101-8cbb-19280349dca2 tempest-VolumesActionsTest-1449905026 None] Creating volume a7d82f46-6afa-4c35-810c-f7a36ff147e8 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:44:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9e54ff37-29d2-4101-8cbb-19280349dca2 tempest-VolumesActionsTest-1449905026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:44:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9e54ff37-29d2-4101-8cbb-19280349dca2 tempest-VolumesActionsTest-1449905026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:44:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9e54ff37-29d2-4101-8cbb-19280349dca2 tempest-VolumesActionsTest-1449905026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:44:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9e54ff37-29d2-4101-8cbb-19280349dca2 tempest-VolumesActionsTest-1449905026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:44:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9e54ff37-29d2-4101-8cbb-19280349dca2 tempest-VolumesActionsTest-1449905026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:44:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9e54ff37-29d2-4101-8cbb-19280349dca2 tempest-VolumesActionsTest-1449905026 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:44:27 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-9e54ff37-29d2-4101-8cbb-19280349dca2 tempest-VolumesActionsTest-1449905026 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:44:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9e54ff37-29d2-4101-8cbb-19280349dca2 tempest-VolumesActionsTest-1449905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7d82f46-6afa-4c35-810c-f7a36ff147e8 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:27 devstack sudo[95860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7d82f46-6afa-4c35-810c-f7a36ff147e8 1073741824 Sep 10 16:44:27 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:28 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9e54ff37-29d2-4101-8cbb-19280349dca2 tempest-VolumesActionsTest-1449905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7d82f46-6afa-4c35-810c-f7a36ff147e8 1073741824" returned: 0 in 0.612s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9e54ff37-29d2-4101-8cbb-19280349dca2 tempest-VolumesActionsTest-1449905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7d82f46-6afa-4c35-810c-f7a36ff147e8 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:28 devstack sudo[95866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7d82f46-6afa-4c35-810c-f7a36ff147e8 Sep 10 16:44:28 devstack sudo[95866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:28 devstack sudo[95866]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9e54ff37-29d2-4101-8cbb-19280349dca2 tempest-VolumesActionsTest-1449905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7d82f46-6afa-4c35-810c-f7a36ff147e8" returned: 0 in 0.468s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:28 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9e54ff37-29d2-4101-8cbb-19280349dca2 tempest-VolumesActionsTest-1449905026 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:44:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9e54ff37-29d2-4101-8cbb-19280349dca2 tempest-VolumesActionsTest-1449905026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:44:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9e54ff37-29d2-4101-8cbb-19280349dca2 tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77134f39-9d4f-4c94-936f-8f59f66631ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7d82f46-6afa-4c35-810c-f7a36ff147e8', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9e54ff37-29d2-4101-8cbb-19280349dca2 tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (184f2cb8-b458-4e71-8762-aa3c7ef9281e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:29 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-9e54ff37-29d2-4101-8cbb-19280349dca2 tempest-VolumesActionsTest-1449905026 None] Volume volume-a7d82f46-6afa-4c35-810c-f7a36ff147e8 (a7d82f46-6afa-4c35-810c-f7a36ff147e8): created successfully Sep 10 16:44:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9e54ff37-29d2-4101-8cbb-19280349dca2 tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (184f2cb8-b458-4e71-8762-aa3c7ef9281e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9e54ff37-29d2-4101-8cbb-19280349dca2 tempest-VolumesActionsTest-1449905026 None] Flow 'volume_create_manager' (db2ebc79-cff1-463c-a522-01e8c9e33c41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:44:29 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-9e54ff37-29d2-4101-8cbb-19280349dca2 tempest-VolumesActionsTest-1449905026 None] Created volume successfully. Sep 10 16:44:29 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5fcd2c78-0450-4e89-8497-cf62d7da2e51 tempest-VolumesActionsTest-1449905026 None] Acquiring lock "cinder-a7d82f46-6afa-4c35-810c-f7a36ff147e8" by "attach_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:44:29 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5fcd2c78-0450-4e89-8497-cf62d7da2e51 tempest-VolumesActionsTest-1449905026 None] Lock "cinder-a7d82f46-6afa-4c35-810c-f7a36ff147e8" acquired by "attach_volume" :: waited 0.027s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:44:29 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-5fcd2c78-0450-4e89-8497-cf62d7da2e51 tempest-VolumesActionsTest-1449905026 None] Attaching volume a7d82f46-6afa-4c35-810c-f7a36ff147e8 to instance 71cc8a8b-d889-4700-8e75-1fd3274f231d at mountpoint /dev/vdb on host None. Sep 10 16:44:29 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-5fcd2c78-0450-4e89-8497-cf62d7da2e51 tempest-VolumesActionsTest-1449905026 None] Attach volume completed successfully. Sep 10 16:44:29 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5fcd2c78-0450-4e89-8497-cf62d7da2e51 tempest-VolumesActionsTest-1449905026 None] Lock "cinder-a7d82f46-6afa-4c35-810c-f7a36ff147e8" released by "attach_volume" :: held 0.158s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:44:30 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-7a1fbeec-928d-4b6b-b339-5a6f864bbfe0 tempest-VolumesActionsTest-862026654 None] Terminate volume connection completed successfully. Sep 10 16:44:30 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-7a1fbeec-928d-4b6b-b339-5a6f864bbfe0 tempest-VolumesActionsTest-862026654 None] Acquiring lock "cinder-a7d82f46-6afa-4c35-810c-f7a36ff147e8-detach_volume" by "detach_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:44:30 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-7a1fbeec-928d-4b6b-b339-5a6f864bbfe0 tempest-VolumesActionsTest-862026654 None] Lock "cinder-a7d82f46-6afa-4c35-810c-f7a36ff147e8-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:44:30 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-7a1fbeec-928d-4b6b-b339-5a6f864bbfe0 tempest-VolumesActionsTest-862026654 None] Detaching volume a7d82f46-6afa-4c35-810c-f7a36ff147e8 from instance 71cc8a8b-d889-4700-8e75-1fd3274f231d. Sep 10 16:44:31 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-7a1fbeec-928d-4b6b-b339-5a6f864bbfe0 tempest-VolumesActionsTest-862026654 None] Detach volume completed successfully. Sep 10 16:44:31 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-7a1fbeec-928d-4b6b-b339-5a6f864bbfe0 tempest-VolumesActionsTest-862026654 None] Lock "cinder-a7d82f46-6afa-4c35-810c-f7a36ff147e8-detach_volume" released by "detach_volume" :: held 0.091s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:44:31 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f5984057-a034-4f1e-8698-15b9c2e36e8a tempest-VolumesActionsTest-1449905026 None] Acquiring lock "cinder-a7d82f46-6afa-4c35-810c-f7a36ff147e8-detach_volume" by "detach_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:44:31 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f5984057-a034-4f1e-8698-15b9c2e36e8a tempest-VolumesActionsTest-1449905026 None] Lock "cinder-a7d82f46-6afa-4c35-810c-f7a36ff147e8-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:44:31 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-f5984057-a034-4f1e-8698-15b9c2e36e8a tempest-VolumesActionsTest-1449905026 None] Volume detach called, but volume not attached. Sep 10 16:44:31 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f5984057-a034-4f1e-8698-15b9c2e36e8a tempest-VolumesActionsTest-1449905026 None] Lock "cinder-a7d82f46-6afa-4c35-810c-f7a36ff147e8-detach_volume" released by "detach_volume" :: held 0.034s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:44:31 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-21a73081-698d-45c3-8e86-0ff678ecc06c tempest-VolumesActionsTest-1449905026 None] Acquiring lock "cinder-a7d82f46-6afa-4c35-810c-f7a36ff147e8-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:44:31 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-21a73081-698d-45c3-8e86-0ff678ecc06c tempest-VolumesActionsTest-1449905026 None] Lock "cinder-a7d82f46-6afa-4c35-810c-f7a36ff147e8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:44:31 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-21a73081-698d-45c3-8e86-0ff678ecc06c tempest-VolumesActionsTest-1449905026 None] Acquiring lock "cinder-quobyte-a7d82f46-6afa-4c35-810c-f7a36ff147e8" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:44:31 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-21a73081-698d-45c3-8e86-0ff678ecc06c tempest-VolumesActionsTest-1449905026 None] Lock "cinder-quobyte-a7d82f46-6afa-4c35-810c-f7a36ff147e8" acquired by "delete_volume" :: waited 0.037s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:44:31 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3a0324-96a4-489d-9b9b-7709be34ca3d]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:44:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-21a73081-698d-45c3-8e86-0ff678ecc06c tempest-VolumesActionsTest-1449905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7d82f46-6afa-4c35-810c-f7a36ff147e8 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:32 devstack sudo[95871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7d82f46-6afa-4c35-810c-f7a36ff147e8 Sep 10 16:44:32 devstack sudo[95871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:32 devstack sudo[95871]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-21a73081-698d-45c3-8e86-0ff678ecc06c tempest-VolumesActionsTest-1449905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7d82f46-6afa-4c35-810c-f7a36ff147e8" returned: 0 in 0.526s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-21a73081-698d-45c3-8e86-0ff678ecc06c tempest-VolumesActionsTest-1449905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7d82f46-6afa-4c35-810c-f7a36ff147e8 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:32 devstack sudo[95878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7d82f46-6afa-4c35-810c-f7a36ff147e8 Sep 10 16:44:32 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:32 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-21a73081-698d-45c3-8e86-0ff678ecc06c tempest-VolumesActionsTest-1449905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7d82f46-6afa-4c35-810c-f7a36ff147e8" returned: 0 in 0.272s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:32 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-21a73081-698d-45c3-8e86-0ff678ecc06c tempest-VolumesActionsTest-1449905026 None] Lock "cinder-quobyte-a7d82f46-6afa-4c35-810c-f7a36ff147e8" released by "delete_volume" :: held 0.859s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:44:32 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-21a73081-698d-45c3-8e86-0ff678ecc06c tempest-VolumesActionsTest-1449905026 None] Created reservations ['efe03179-e76b-4fa6-9fd4-e2d734e73ebe', '4f2a95e7-4ac7-45d7-82e5-ad6a2d75efbe', '35444f99-a683-48b5-a1c5-70107ad8fc56', '36495b59-ff49-49b8-844e-f9aae0e5d882'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:44:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-21a73081-698d-45c3-8e86-0ff678ecc06c tempest-VolumesActionsTest-1449905026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:44:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-21a73081-698d-45c3-8e86-0ff678ecc06c tempest-VolumesActionsTest-1449905026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:44:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-21a73081-698d-45c3-8e86-0ff678ecc06c tempest-VolumesActionsTest-1449905026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:44:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-21a73081-698d-45c3-8e86-0ff678ecc06c tempest-VolumesActionsTest-1449905026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:44:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-21a73081-698d-45c3-8e86-0ff678ecc06c tempest-VolumesActionsTest-1449905026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:44:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-21a73081-698d-45c3-8e86-0ff678ecc06c tempest-VolumesActionsTest-1449905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:32 devstack sudo[95881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:44:32 devstack sudo[95881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:33 devstack sudo[95881]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-21a73081-698d-45c3-8e86-0ff678ecc06c tempest-VolumesActionsTest-1449905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.319s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:33 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-21a73081-698d-45c3-8e86-0ff678ecc06c tempest-VolumesActionsTest-1449905026 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:44:33 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-21a73081-698d-45c3-8e86-0ff678ecc06c tempest-VolumesActionsTest-1449905026 None] Deleted volume successfully. Sep 10 16:44:33 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-21a73081-698d-45c3-8e86-0ff678ecc06c tempest-VolumesActionsTest-1449905026 None] Lock "cinder-a7d82f46-6afa-4c35-810c-f7a36ff147e8-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:44:36 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc08f107-031a-4653-a374-0254d759e73b tempest-VolumesActionsTest-1449905026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:44:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fc08f107-031a-4653-a374-0254d759e73b tempest-VolumesActionsTest-1449905026 None] Flow 'volume_create_manager' (ca6f6606-e4d7-49a1-bdf3-4f337e28ae9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:44:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fc08f107-031a-4653-a374-0254d759e73b tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16847c68-585e-4aa4-afc9-94ecf86a5224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fc08f107-031a-4653-a374-0254d759e73b tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16847c68-585e-4aa4-afc9-94ecf86a5224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1357337074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f47ad82d-7562-49b0-b884-49a41aeaf56b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14538eec33cc4b48b06e1d3ba24b6165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:44:37Z,use_quota=True,user_id='fd9af4f2d013477a8191785fe708d35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fc08f107-031a-4653-a374-0254d759e73b tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b91da093-cef6-45bf-a4d3-b6adf42022cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fc08f107-031a-4653-a374-0254d759e73b tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b91da093-cef6-45bf-a4d3-b6adf42022cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fc08f107-031a-4653-a374-0254d759e73b tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69441564-b3d5-4662-b68c-85bf13c7c070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fc08f107-031a-4653-a374-0254d759e73b tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69441564-b3d5-4662-b68c-85bf13c7c070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f47ad82d-7562-49b0-b884-49a41aeaf56b', 'volume_name': 'volume-f47ad82d-7562-49b0-b884-49a41aeaf56b', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fc08f107-031a-4653-a374-0254d759e73b tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f2d8f7-88a2-447f-b684-f6443f3730c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fc08f107-031a-4653-a374-0254d759e73b tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f2d8f7-88a2-447f-b684-f6443f3730c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fc08f107-031a-4653-a374-0254d759e73b tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b504df7-2df8-46f7-a070-390c142d5ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:36 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-fc08f107-031a-4653-a374-0254d759e73b tempest-VolumesActionsTest-1449905026 None] Volume f47ad82d-7562-49b0-b884-49a41aeaf56b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f47ad82d-7562-49b0-b884-49a41aeaf56b', 'volume_size': 1} Sep 10 16:44:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-fc08f107-031a-4653-a374-0254d759e73b tempest-VolumesActionsTest-1449905026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:44:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-fc08f107-031a-4653-a374-0254d759e73b tempest-VolumesActionsTest-1449905026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:44:36 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-fc08f107-031a-4653-a374-0254d759e73b tempest-VolumesActionsTest-1449905026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1357337074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f47ad82d-7562-49b0-b884-49a41aeaf56b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14538eec33cc4b48b06e1d3ba24b6165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:44:37Z,use_quota=True,user_id='fd9af4f2d013477a8191785fe708d35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:44:36 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-fc08f107-031a-4653-a374-0254d759e73b tempest-VolumesActionsTest-1449905026 None] Creating volume f47ad82d-7562-49b0-b884-49a41aeaf56b {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:44:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-fc08f107-031a-4653-a374-0254d759e73b tempest-VolumesActionsTest-1449905026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:44:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-fc08f107-031a-4653-a374-0254d759e73b tempest-VolumesActionsTest-1449905026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:44:36 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-fc08f107-031a-4653-a374-0254d759e73b tempest-VolumesActionsTest-1449905026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:44:36 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-fc08f107-031a-4653-a374-0254d759e73b tempest-VolumesActionsTest-1449905026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:44:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-fc08f107-031a-4653-a374-0254d759e73b tempest-VolumesActionsTest-1449905026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:44:36 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-fc08f107-031a-4653-a374-0254d759e73b tempest-VolumesActionsTest-1449905026 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:44:36 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-fc08f107-031a-4653-a374-0254d759e73b tempest-VolumesActionsTest-1449905026 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:44:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fc08f107-031a-4653-a374-0254d759e73b tempest-VolumesActionsTest-1449905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f47ad82d-7562-49b0-b884-49a41aeaf56b 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:36 devstack sudo[95908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f47ad82d-7562-49b0-b884-49a41aeaf56b 1073741824 Sep 10 16:44:36 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:37 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fc08f107-031a-4653-a374-0254d759e73b tempest-VolumesActionsTest-1449905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f47ad82d-7562-49b0-b884-49a41aeaf56b 1073741824" returned: 0 in 0.421s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fc08f107-031a-4653-a374-0254d759e73b tempest-VolumesActionsTest-1449905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f47ad82d-7562-49b0-b884-49a41aeaf56b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:37 devstack sudo[95914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f47ad82d-7562-49b0-b884-49a41aeaf56b Sep 10 16:44:37 devstack sudo[95914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:37 devstack sudo[95914]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fc08f107-031a-4653-a374-0254d759e73b tempest-VolumesActionsTest-1449905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f47ad82d-7562-49b0-b884-49a41aeaf56b" returned: 0 in 0.249s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:37 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-fc08f107-031a-4653-a374-0254d759e73b tempest-VolumesActionsTest-1449905026 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:44:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-fc08f107-031a-4653-a374-0254d759e73b tempest-VolumesActionsTest-1449905026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:44:37 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fc08f107-031a-4653-a374-0254d759e73b tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b504df7-2df8-46f7-a070-390c142d5ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f47ad82d-7562-49b0-b884-49a41aeaf56b', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:37 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fc08f107-031a-4653-a374-0254d759e73b tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd7d588b-cbbb-442b-890e-c1b0cfbe575d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:37 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-fc08f107-031a-4653-a374-0254d759e73b tempest-VolumesActionsTest-1449905026 None] Volume volume-f47ad82d-7562-49b0-b884-49a41aeaf56b (f47ad82d-7562-49b0-b884-49a41aeaf56b): created successfully Sep 10 16:44:37 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fc08f107-031a-4653-a374-0254d759e73b tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd7d588b-cbbb-442b-890e-c1b0cfbe575d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:37 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fc08f107-031a-4653-a374-0254d759e73b tempest-VolumesActionsTest-1449905026 None] Flow 'volume_create_manager' (ca6f6606-e4d7-49a1-bdf3-4f337e28ae9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:44:37 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-fc08f107-031a-4653-a374-0254d759e73b tempest-VolumesActionsTest-1449905026 None] Created volume successfully. Sep 10 16:44:38 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-ce116474-d82e-4ca4-91be-8ccce10ed641 tempest-VolumesActionsTest-862026654 None] Acquiring lock "cinder-f47ad82d-7562-49b0-b884-49a41aeaf56b-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:44:38 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-ce116474-d82e-4ca4-91be-8ccce10ed641 tempest-VolumesActionsTest-862026654 None] Lock "cinder-f47ad82d-7562-49b0-b884-49a41aeaf56b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:44:38 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-ce116474-d82e-4ca4-91be-8ccce10ed641 tempest-VolumesActionsTest-862026654 None] Acquiring lock "cinder-quobyte-f47ad82d-7562-49b0-b884-49a41aeaf56b" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:44:38 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-ce116474-d82e-4ca4-91be-8ccce10ed641 tempest-VolumesActionsTest-862026654 None] Lock "cinder-quobyte-f47ad82d-7562-49b0-b884-49a41aeaf56b" acquired by "delete_volume" :: waited 0.019s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:44:38 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0133c657-962d-4ec1-b264-b7d1c02d3322]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:44:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ce116474-d82e-4ca4-91be-8ccce10ed641 tempest-VolumesActionsTest-862026654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f47ad82d-7562-49b0-b884-49a41aeaf56b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:38 devstack sudo[95917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f47ad82d-7562-49b0-b884-49a41aeaf56b Sep 10 16:44:38 devstack sudo[95917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:38 devstack sudo[95917]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ce116474-d82e-4ca4-91be-8ccce10ed641 tempest-VolumesActionsTest-862026654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f47ad82d-7562-49b0-b884-49a41aeaf56b" returned: 0 in 0.395s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ce116474-d82e-4ca4-91be-8ccce10ed641 tempest-VolumesActionsTest-862026654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f47ad82d-7562-49b0-b884-49a41aeaf56b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:38 devstack sudo[95922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f47ad82d-7562-49b0-b884-49a41aeaf56b Sep 10 16:44:38 devstack sudo[95922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:38 devstack sudo[95922]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ce116474-d82e-4ca4-91be-8ccce10ed641 tempest-VolumesActionsTest-862026654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f47ad82d-7562-49b0-b884-49a41aeaf56b" returned: 0 in 0.249s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:38 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-ce116474-d82e-4ca4-91be-8ccce10ed641 tempest-VolumesActionsTest-862026654 None] Lock "cinder-quobyte-f47ad82d-7562-49b0-b884-49a41aeaf56b" released by "delete_volume" :: held 0.690s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:44:38 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-ce116474-d82e-4ca4-91be-8ccce10ed641 tempest-VolumesActionsTest-862026654 None] Created reservations ['689e3657-a8d0-400d-9b1b-d4996fd54e9a', 'e4615d5e-3781-4b48-94f3-d42c47622ed9', 'f8093198-3182-48c7-bcc5-66bba6bf304a', '96014bfe-e026-4bae-8efb-5ef58b298de6'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:44:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ce116474-d82e-4ca4-91be-8ccce10ed641 tempest-VolumesActionsTest-862026654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:44:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ce116474-d82e-4ca4-91be-8ccce10ed641 tempest-VolumesActionsTest-862026654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:44:38 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ce116474-d82e-4ca4-91be-8ccce10ed641 tempest-VolumesActionsTest-862026654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:44:38 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ce116474-d82e-4ca4-91be-8ccce10ed641 tempest-VolumesActionsTest-862026654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:44:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ce116474-d82e-4ca4-91be-8ccce10ed641 tempest-VolumesActionsTest-862026654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:44:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ce116474-d82e-4ca4-91be-8ccce10ed641 tempest-VolumesActionsTest-862026654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:38 devstack sudo[95927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:44:38 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:38 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-2567ef09-4714-4401-8851-b373889d98fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:44:38 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2567ef09-4714-4401-8851-b373889d98fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Flow 'volume_create_manager' (484654ab-1f9b-4854-8e42-b19dbcc36e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:44:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2567ef09-4714-4401-8851-b373889d98fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d71e04ce-99c1-4639-b186-88ef34b30598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2567ef09-4714-4401-8851-b373889d98fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d71e04ce-99c1-4639-b186-88ef34b30598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-732938422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8076851-11e0-4032-893c-ec573d0659ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c5cddd3d0ef4d41a74f5f8e30690980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:44:39Z,use_quota=True,user_id='64f4a07be1aa44118c79162db2a00e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2567ef09-4714-4401-8851-b373889d98fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef04f990-05ff-4ef5-bb6e-c0a5b9f2c99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2567ef09-4714-4401-8851-b373889d98fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef04f990-05ff-4ef5-bb6e-c0a5b9f2c99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2567ef09-4714-4401-8851-b373889d98fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da0ee578-f9f4-4629-b2af-872a08eb75c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2567ef09-4714-4401-8851-b373889d98fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da0ee578-f9f4-4629-b2af-872a08eb75c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8076851-11e0-4032-893c-ec573d0659ef', 'volume_name': 'volume-a8076851-11e0-4032-893c-ec573d0659ef', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2567ef09-4714-4401-8851-b373889d98fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1287f3a7-7fe1-44fe-9e12-d9c7476697ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2567ef09-4714-4401-8851-b373889d98fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1287f3a7-7fe1-44fe-9e12-d9c7476697ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2567ef09-4714-4401-8851-b373889d98fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376587d3-b67a-4445-8a2d-7bfc96e04617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:39 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-2567ef09-4714-4401-8851-b373889d98fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Volume a8076851-11e0-4032-893c-ec573d0659ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8076851-11e0-4032-893c-ec573d0659ef', 'volume_size': 1} Sep 10 16:44:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2567ef09-4714-4401-8851-b373889d98fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:44:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2567ef09-4714-4401-8851-b373889d98fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:44:39 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-2567ef09-4714-4401-8851-b373889d98fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-732938422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8076851-11e0-4032-893c-ec573d0659ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c5cddd3d0ef4d41a74f5f8e30690980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:44:39Z,use_quota=True,user_id='64f4a07be1aa44118c79162db2a00e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:44:39 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-2567ef09-4714-4401-8851-b373889d98fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Creating volume a8076851-11e0-4032-893c-ec573d0659ef {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:44:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2567ef09-4714-4401-8851-b373889d98fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:44:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2567ef09-4714-4401-8851-b373889d98fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:44:39 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-2567ef09-4714-4401-8851-b373889d98fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:44:39 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-2567ef09-4714-4401-8851-b373889d98fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:44:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2567ef09-4714-4401-8851-b373889d98fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:44:39 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-2567ef09-4714-4401-8851-b373889d98fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:44:39 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-2567ef09-4714-4401-8851-b373889d98fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:44:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2567ef09-4714-4401-8851-b373889d98fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:39 devstack sudo[95929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef 1073741824 Sep 10 16:44:39 devstack sudo[95929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:39 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ce116474-d82e-4ca4-91be-8ccce10ed641 tempest-VolumesActionsTest-862026654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.372s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:39 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-ce116474-d82e-4ca4-91be-8ccce10ed641 tempest-VolumesActionsTest-862026654 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:44:39 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-ce116474-d82e-4ca4-91be-8ccce10ed641 tempest-VolumesActionsTest-862026654 None] Deleted volume successfully. Sep 10 16:44:39 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-ce116474-d82e-4ca4-91be-8ccce10ed641 tempest-VolumesActionsTest-862026654 None] Lock "cinder-f47ad82d-7562-49b0-b884-49a41aeaf56b-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:44:39 devstack sudo[95929]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2567ef09-4714-4401-8851-b373889d98fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef 1073741824" returned: 0 in 0.645s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2567ef09-4714-4401-8851-b373889d98fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:39 devstack sudo[95936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef Sep 10 16:44:39 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:40 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2567ef09-4714-4401-8851-b373889d98fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef" returned: 0 in 0.292s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-2567ef09-4714-4401-8851-b373889d98fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2567ef09-4714-4401-8851-b373889d98fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2567ef09-4714-4401-8851-b373889d98fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376587d3-b67a-4445-8a2d-7bfc96e04617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8076851-11e0-4032-893c-ec573d0659ef', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2567ef09-4714-4401-8851-b373889d98fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cfcc1f8-8e88-4b8d-b0e0-5e03a64c3645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:40 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-2567ef09-4714-4401-8851-b373889d98fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Volume volume-a8076851-11e0-4032-893c-ec573d0659ef (a8076851-11e0-4032-893c-ec573d0659ef): created successfully Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2567ef09-4714-4401-8851-b373889d98fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cfcc1f8-8e88-4b8d-b0e0-5e03a64c3645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2567ef09-4714-4401-8851-b373889d98fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Flow 'volume_create_manager' (484654ab-1f9b-4854-8e42-b19dbcc36e08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:44:40 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-2567ef09-4714-4401-8851-b373889d98fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Created volume successfully. Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-7489f022-f5f5-4d11-9839-53d4968623fe tempest-AttachVolumeNegativeTest-74284645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7489f022-f5f5-4d11-9839-53d4968623fe tempest-AttachVolumeNegativeTest-74284645 None] Flow 'volume_create_manager' (04ec48e3-22cc-4f12-a1c0-4fcbb62c64d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7489f022-f5f5-4d11-9839-53d4968623fe tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fea09c7c-f71d-44ba-915f-f0dd0c98f788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7489f022-f5f5-4d11-9839-53d4968623fe tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fea09c7c-f71d-44ba-915f-f0dd0c98f788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-92506029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=364d218d-b617-4614-9899-a9bd8dffa59e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e484ed10f924a7692981c4942bab1ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:44:40Z,use_quota=True,user_id='5cd571733ed54e5bb97da86075b3900b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7489f022-f5f5-4d11-9839-53d4968623fe tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af954a9-cb2d-4f44-b7ed-270c33caa62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7489f022-f5f5-4d11-9839-53d4968623fe tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af954a9-cb2d-4f44-b7ed-270c33caa62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7489f022-f5f5-4d11-9839-53d4968623fe tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0dc810c-c71b-4ace-9f9f-a9c06a1bec43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7489f022-f5f5-4d11-9839-53d4968623fe tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0dc810c-c71b-4ace-9f9f-a9c06a1bec43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '364d218d-b617-4614-9899-a9bd8dffa59e', 'volume_name': 'volume-364d218d-b617-4614-9899-a9bd8dffa59e', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7489f022-f5f5-4d11-9839-53d4968623fe tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace3580c-9608-45ce-a074-4143830cd427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7489f022-f5f5-4d11-9839-53d4968623fe tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace3580c-9608-45ce-a074-4143830cd427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7489f022-f5f5-4d11-9839-53d4968623fe tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2e782c-c23b-4504-8fea-3a2555cc1026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:40 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-7489f022-f5f5-4d11-9839-53d4968623fe tempest-AttachVolumeNegativeTest-74284645 None] Volume 364d218d-b617-4614-9899-a9bd8dffa59e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-364d218d-b617-4614-9899-a9bd8dffa59e', 'volume_size': 1} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7489f022-f5f5-4d11-9839-53d4968623fe tempest-AttachVolumeNegativeTest-74284645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7489f022-f5f5-4d11-9839-53d4968623fe tempest-AttachVolumeNegativeTest-74284645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7489f022-f5f5-4d11-9839-53d4968623fe tempest-AttachVolumeNegativeTest-74284645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-92506029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=364d218d-b617-4614-9899-a9bd8dffa59e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e484ed10f924a7692981c4942bab1ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:44:40Z,use_quota=True,user_id='5cd571733ed54e5bb97da86075b3900b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-7489f022-f5f5-4d11-9839-53d4968623fe tempest-AttachVolumeNegativeTest-74284645 None] Creating volume 364d218d-b617-4614-9899-a9bd8dffa59e {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7489f022-f5f5-4d11-9839-53d4968623fe tempest-AttachVolumeNegativeTest-74284645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7489f022-f5f5-4d11-9839-53d4968623fe tempest-AttachVolumeNegativeTest-74284645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7489f022-f5f5-4d11-9839-53d4968623fe tempest-AttachVolumeNegativeTest-74284645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7489f022-f5f5-4d11-9839-53d4968623fe tempest-AttachVolumeNegativeTest-74284645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7489f022-f5f5-4d11-9839-53d4968623fe tempest-AttachVolumeNegativeTest-74284645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7489f022-f5f5-4d11-9839-53d4968623fe tempest-AttachVolumeNegativeTest-74284645 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:44:40 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-7489f022-f5f5-4d11-9839-53d4968623fe tempest-AttachVolumeNegativeTest-74284645 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7489f022-f5f5-4d11-9839-53d4968623fe tempest-AttachVolumeNegativeTest-74284645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-364d218d-b617-4614-9899-a9bd8dffa59e 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:40 devstack sudo[95941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-364d218d-b617-4614-9899-a9bd8dffa59e 1073741824 Sep 10 16:44:40 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-38663367-ac0c-4b5d-92a4-0af3a7c6edc0 tempest-VolumesActionsTest-1449905026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-38663367-ac0c-4b5d-92a4-0af3a7c6edc0 tempest-VolumesActionsTest-1449905026 None] Flow 'volume_create_manager' (667e88e6-18b7-4419-b03e-5dd9f5801a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-38663367-ac0c-4b5d-92a4-0af3a7c6edc0 tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e13c5c-5160-474f-8f82-921a19b068ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-38663367-ac0c-4b5d-92a4-0af3a7c6edc0 tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e13c5c-5160-474f-8f82-921a19b068ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1561833258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f97b25b4-8d40-4b0d-9f38-ed3b9b843306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14538eec33cc4b48b06e1d3ba24b6165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:44:40Z,use_quota=True,user_id='fd9af4f2d013477a8191785fe708d35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-38663367-ac0c-4b5d-92a4-0af3a7c6edc0 tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (904be4a0-2c48-4ddc-ac9f-b731d144e689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-38663367-ac0c-4b5d-92a4-0af3a7c6edc0 tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (904be4a0-2c48-4ddc-ac9f-b731d144e689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-38663367-ac0c-4b5d-92a4-0af3a7c6edc0 tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d56fd40-a0a1-4c30-b414-fedd1cd5084a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-38663367-ac0c-4b5d-92a4-0af3a7c6edc0 tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d56fd40-a0a1-4c30-b414-fedd1cd5084a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f97b25b4-8d40-4b0d-9f38-ed3b9b843306', 'volume_name': 'volume-f97b25b4-8d40-4b0d-9f38-ed3b9b843306', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-38663367-ac0c-4b5d-92a4-0af3a7c6edc0 tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5938744e-a02e-4f92-8727-e3c0f51a35ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-38663367-ac0c-4b5d-92a4-0af3a7c6edc0 tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5938744e-a02e-4f92-8727-e3c0f51a35ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-38663367-ac0c-4b5d-92a4-0af3a7c6edc0 tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80cc23cc-7b2f-4ae2-a865-4cec1667a238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:40 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-38663367-ac0c-4b5d-92a4-0af3a7c6edc0 tempest-VolumesActionsTest-1449905026 None] Volume f97b25b4-8d40-4b0d-9f38-ed3b9b843306: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f97b25b4-8d40-4b0d-9f38-ed3b9b843306', 'volume_size': 1} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-38663367-ac0c-4b5d-92a4-0af3a7c6edc0 tempest-VolumesActionsTest-1449905026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:44:40 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7489f022-f5f5-4d11-9839-53d4968623fe tempest-AttachVolumeNegativeTest-74284645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-364d218d-b617-4614-9899-a9bd8dffa59e 1073741824" returned: 0 in 0.406s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7489f022-f5f5-4d11-9839-53d4968623fe tempest-AttachVolumeNegativeTest-74284645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-364d218d-b617-4614-9899-a9bd8dffa59e {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:40 devstack sudo[95947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-364d218d-b617-4614-9899-a9bd8dffa59e Sep 10 16:44:40 devstack sudo[95947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:41 devstack sudo[95947]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7489f022-f5f5-4d11-9839-53d4968623fe tempest-AttachVolumeNegativeTest-74284645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-364d218d-b617-4614-9899-a9bd8dffa59e" returned: 0 in 0.257s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:41 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7489f022-f5f5-4d11-9839-53d4968623fe tempest-AttachVolumeNegativeTest-74284645 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:44:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7489f022-f5f5-4d11-9839-53d4968623fe tempest-AttachVolumeNegativeTest-74284645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:44:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-38663367-ac0c-4b5d-92a4-0af3a7c6edc0 tempest-VolumesActionsTest-1449905026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.604s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:44:41 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-38663367-ac0c-4b5d-92a4-0af3a7c6edc0 tempest-VolumesActionsTest-1449905026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1561833258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f97b25b4-8d40-4b0d-9f38-ed3b9b843306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14538eec33cc4b48b06e1d3ba24b6165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:44:40Z,use_quota=True,user_id='fd9af4f2d013477a8191785fe708d35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:44:41 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-38663367-ac0c-4b5d-92a4-0af3a7c6edc0 tempest-VolumesActionsTest-1449905026 None] Creating volume f97b25b4-8d40-4b0d-9f38-ed3b9b843306 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:44:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-38663367-ac0c-4b5d-92a4-0af3a7c6edc0 tempest-VolumesActionsTest-1449905026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:44:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-38663367-ac0c-4b5d-92a4-0af3a7c6edc0 tempest-VolumesActionsTest-1449905026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:44:41 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-38663367-ac0c-4b5d-92a4-0af3a7c6edc0 tempest-VolumesActionsTest-1449905026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:44:41 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-38663367-ac0c-4b5d-92a4-0af3a7c6edc0 tempest-VolumesActionsTest-1449905026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:44:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-38663367-ac0c-4b5d-92a4-0af3a7c6edc0 tempest-VolumesActionsTest-1449905026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:44:41 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-38663367-ac0c-4b5d-92a4-0af3a7c6edc0 tempest-VolumesActionsTest-1449905026 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:44:41 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-38663367-ac0c-4b5d-92a4-0af3a7c6edc0 tempest-VolumesActionsTest-1449905026 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:44:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-38663367-ac0c-4b5d-92a4-0af3a7c6edc0 tempest-VolumesActionsTest-1449905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f97b25b4-8d40-4b0d-9f38-ed3b9b843306 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:41 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7489f022-f5f5-4d11-9839-53d4968623fe tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2e782c-c23b-4504-8fea-3a2555cc1026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-364d218d-b617-4614-9899-a9bd8dffa59e', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:41 devstack sudo[95950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f97b25b4-8d40-4b0d-9f38-ed3b9b843306 1073741824 Sep 10 16:44:41 devstack sudo[95950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:41 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7489f022-f5f5-4d11-9839-53d4968623fe tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7591eedb-3de0-4a52-b212-06a2ff9b5930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:41 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-7489f022-f5f5-4d11-9839-53d4968623fe tempest-AttachVolumeNegativeTest-74284645 None] Volume volume-364d218d-b617-4614-9899-a9bd8dffa59e (364d218d-b617-4614-9899-a9bd8dffa59e): created successfully Sep 10 16:44:41 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7489f022-f5f5-4d11-9839-53d4968623fe tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7591eedb-3de0-4a52-b212-06a2ff9b5930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:41 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7489f022-f5f5-4d11-9839-53d4968623fe tempest-AttachVolumeNegativeTest-74284645 None] Flow 'volume_create_manager' (04ec48e3-22cc-4f12-a1c0-4fcbb62c64d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:44:41 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-7489f022-f5f5-4d11-9839-53d4968623fe tempest-AttachVolumeNegativeTest-74284645 None] Created volume successfully. Sep 10 16:44:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e9fecbc2-ef6b-4a98-82cb-6f455238793a tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:44:41 devstack sudo[95950]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-38663367-ac0c-4b5d-92a4-0af3a7c6edc0 tempest-VolumesActionsTest-1449905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f97b25b4-8d40-4b0d-9f38-ed3b9b843306 1073741824" returned: 0 in 0.425s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-38663367-ac0c-4b5d-92a4-0af3a7c6edc0 tempest-VolumesActionsTest-1449905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f97b25b4-8d40-4b0d-9f38-ed3b9b843306 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:41 devstack sudo[95955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f97b25b4-8d40-4b0d-9f38-ed3b9b843306 Sep 10 16:44:41 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:41 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-38663367-ac0c-4b5d-92a4-0af3a7c6edc0 tempest-VolumesActionsTest-1449905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f97b25b4-8d40-4b0d-9f38-ed3b9b843306" returned: 0 in 0.244s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:41 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-38663367-ac0c-4b5d-92a4-0af3a7c6edc0 tempest-VolumesActionsTest-1449905026 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:44:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-38663367-ac0c-4b5d-92a4-0af3a7c6edc0 tempest-VolumesActionsTest-1449905026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:44:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e9fecbc2-ef6b-4a98-82cb-6f455238793a tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.582s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:44:41 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-38663367-ac0c-4b5d-92a4-0af3a7c6edc0 tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80cc23cc-7b2f-4ae2-a865-4cec1667a238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f97b25b4-8d40-4b0d-9f38-ed3b9b843306', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:41 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-38663367-ac0c-4b5d-92a4-0af3a7c6edc0 tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d52cca-50dc-4cf7-a3af-0e70629c3e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:41 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-e9fecbc2-ef6b-4a98-82cb-6f455238793a tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Creating offline snapshot 3fdd3f35-df5b-4da0-acad-b3f2b8da7bc1 of volume a8076851-11e0-4032-893c-ec573d0659ef {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:44:41 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-38663367-ac0c-4b5d-92a4-0af3a7c6edc0 tempest-VolumesActionsTest-1449905026 None] Volume volume-f97b25b4-8d40-4b0d-9f38-ed3b9b843306 (f97b25b4-8d40-4b0d-9f38-ed3b9b843306): created successfully Sep 10 16:44:41 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-38663367-ac0c-4b5d-92a4-0af3a7c6edc0 tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d52cca-50dc-4cf7-a3af-0e70629c3e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:41 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-38663367-ac0c-4b5d-92a4-0af3a7c6edc0 tempest-VolumesActionsTest-1449905026 None] Flow 'volume_create_manager' (667e88e6-18b7-4419-b03e-5dd9f5801a70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:44:41 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2e1376-36e5-4b05-99f7-ea93e1e09dae]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:44:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e9fecbc2-ef6b-4a98-82cb-6f455238793a tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:41 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-38663367-ac0c-4b5d-92a4-0af3a7c6edc0 tempest-VolumesActionsTest-1449905026 None] Created volume successfully. Sep 10 16:44:41 devstack sudo[95958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef Sep 10 16:44:41 devstack sudo[95958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:42 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d271b96e-4989-4809-84e3-cdc6af5aa6de tempest-VolumesActionsTest-862026654 None] Acquiring lock "cinder-f97b25b4-8d40-4b0d-9f38-ed3b9b843306-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:44:42 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d271b96e-4989-4809-84e3-cdc6af5aa6de tempest-VolumesActionsTest-862026654 None] Lock "cinder-f97b25b4-8d40-4b0d-9f38-ed3b9b843306-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:44:42 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d271b96e-4989-4809-84e3-cdc6af5aa6de tempest-VolumesActionsTest-862026654 None] Acquiring lock "cinder-quobyte-f97b25b4-8d40-4b0d-9f38-ed3b9b843306" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:44:42 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d271b96e-4989-4809-84e3-cdc6af5aa6de tempest-VolumesActionsTest-862026654 None] Lock "cinder-quobyte-f97b25b4-8d40-4b0d-9f38-ed3b9b843306" acquired by "delete_volume" :: waited 0.017s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:44:42 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4766eadb-093d-477c-995e-c76f509137f2]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:44:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d271b96e-4989-4809-84e3-cdc6af5aa6de tempest-VolumesActionsTest-862026654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f97b25b4-8d40-4b0d-9f38-ed3b9b843306 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:42 devstack sudo[95958]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e9fecbc2-ef6b-4a98-82cb-6f455238793a tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef" returned: 0 in 0.507s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e9fecbc2-ef6b-4a98-82cb-6f455238793a tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef.3fdd3f35-df5b-4da0-acad-b3f2b8da7bc1 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:42 devstack sudo[95971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef.3fdd3f35-df5b-4da0-acad-b3f2b8da7bc1 1G Sep 10 16:44:42 devstack sudo[95971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:42 devstack sudo[95970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f97b25b4-8d40-4b0d-9f38-ed3b9b843306 Sep 10 16:44:42 devstack sudo[95970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:42 devstack sudo[95970]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d271b96e-4989-4809-84e3-cdc6af5aa6de tempest-VolumesActionsTest-862026654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f97b25b4-8d40-4b0d-9f38-ed3b9b843306" returned: 0 in 0.608s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d271b96e-4989-4809-84e3-cdc6af5aa6de tempest-VolumesActionsTest-862026654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f97b25b4-8d40-4b0d-9f38-ed3b9b843306 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:42 devstack sudo[95971]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e9fecbc2-ef6b-4a98-82cb-6f455238793a tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef.3fdd3f35-df5b-4da0-acad-b3f2b8da7bc1 1G" returned: 0 in 0.627s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:43 devstack sudo[95991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f97b25b4-8d40-4b0d-9f38-ed3b9b843306 Sep 10 16:44:43 devstack sudo[95991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e9fecbc2-ef6b-4a98-82cb-6f455238793a tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8076851-11e0-4032-893c-ec573d0659ef -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef.3fdd3f35-df5b-4da0-acad-b3f2b8da7bc1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:43 devstack sudo[96002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8076851-11e0-4032-893c-ec573d0659ef -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef.3fdd3f35-df5b-4da0-acad-b3f2b8da7bc1 Sep 10 16:44:43 devstack sudo[96002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-0fc8e5dd-7412-431f-8d44-e0e352c73d32 req-3bc6c9ea-1efe-4c00-8add-7b3c2bc5c181 tempest-AttachVolumeNegativeTest-74284645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:44:43 devstack sudo[96002]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e9fecbc2-ef6b-4a98-82cb-6f455238793a tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8076851-11e0-4032-893c-ec573d0659ef -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef.3fdd3f35-df5b-4da0-acad-b3f2b8da7bc1" returned: 0 in 0.489s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:43 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-e9fecbc2-ef6b-4a98-82cb-6f455238793a tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef.3fdd3f35-df5b-4da0-acad-b3f2b8da7bc1 is being set with open permissions: ugo+rw Sep 10 16:44:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e9fecbc2-ef6b-4a98-82cb-6f455238793a tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef.3fdd3f35-df5b-4da0-acad-b3f2b8da7bc1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:43 devstack sudo[96021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef.3fdd3f35-df5b-4da0-acad-b3f2b8da7bc1 Sep 10 16:44:43 devstack sudo[96021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:43 devstack sudo[95991]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d271b96e-4989-4809-84e3-cdc6af5aa6de tempest-VolumesActionsTest-862026654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f97b25b4-8d40-4b0d-9f38-ed3b9b843306" returned: 0 in 0.601s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:43 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d271b96e-4989-4809-84e3-cdc6af5aa6de tempest-VolumesActionsTest-862026654 None] Lock "cinder-quobyte-f97b25b4-8d40-4b0d-9f38-ed3b9b843306" released by "delete_volume" :: held 1.261s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:44:43 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-d271b96e-4989-4809-84e3-cdc6af5aa6de tempest-VolumesActionsTest-862026654 None] Created reservations ['fe3792f8-6def-469b-9de3-507d489983d8', 'd41b4005-b273-4f08-b704-121289a100d8', 'f8553e0b-3fa7-43f9-b5fc-6a5dcac776e8', 'a544046e-43b9-4267-8dcf-33bd48d1f510'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:44:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d271b96e-4989-4809-84e3-cdc6af5aa6de tempest-VolumesActionsTest-862026654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:44:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d271b96e-4989-4809-84e3-cdc6af5aa6de tempest-VolumesActionsTest-862026654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:44:43 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d271b96e-4989-4809-84e3-cdc6af5aa6de tempest-VolumesActionsTest-862026654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:44:43 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d271b96e-4989-4809-84e3-cdc6af5aa6de tempest-VolumesActionsTest-862026654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:44:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d271b96e-4989-4809-84e3-cdc6af5aa6de tempest-VolumesActionsTest-862026654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:44:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d271b96e-4989-4809-84e3-cdc6af5aa6de tempest-VolumesActionsTest-862026654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:43 devstack sudo[96023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:44:43 devstack sudo[96023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:43 devstack sudo[96021]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e9fecbc2-ef6b-4a98-82cb-6f455238793a tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef.3fdd3f35-df5b-4da0-acad-b3f2b8da7bc1" returned: 0 in 0.298s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e9fecbc2-ef6b-4a98-82cb-6f455238793a tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:43 devstack sudo[96026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef.info Sep 10 16:44:43 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:43 devstack sudo[96023]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d271b96e-4989-4809-84e3-cdc6af5aa6de tempest-VolumesActionsTest-862026654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.285s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:44 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-d271b96e-4989-4809-84e3-cdc6af5aa6de tempest-VolumesActionsTest-862026654 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:44:44 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-d271b96e-4989-4809-84e3-cdc6af5aa6de tempest-VolumesActionsTest-862026654 None] Deleted volume successfully. Sep 10 16:44:44 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d271b96e-4989-4809-84e3-cdc6af5aa6de tempest-VolumesActionsTest-862026654 None] Lock "cinder-f97b25b4-8d40-4b0d-9f38-ed3b9b843306-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:44:44 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e9fecbc2-ef6b-4a98-82cb-6f455238793a tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef.info" returned: 0 in 0.308s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:44 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-e9fecbc2-ef6b-4a98-82cb-6f455238793a tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef.info is being set with open permissions: ugo+rw Sep 10 16:44:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e9fecbc2-ef6b-4a98-82cb-6f455238793a tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:44 devstack sudo[96030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef.info Sep 10 16:44:44 devstack sudo[96030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:44 devstack sudo[96030]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e9fecbc2-ef6b-4a98-82cb-6f455238793a tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef.info" returned: 0 in 0.278s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e9fecbc2-ef6b-4a98-82cb-6f455238793a tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.695s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:44:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-0fc8e5dd-7412-431f-8d44-e0e352c73d32 req-3bc6c9ea-1efe-4c00-8add-7b3c2bc5c181 tempest-AttachVolumeNegativeTest-74284645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.090s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:44:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-0fc8e5dd-7412-431f-8d44-e0e352c73d32 req-3bc6c9ea-1efe-4c00-8add-7b3c2bc5c181 tempest-AttachVolumeNegativeTest-74284645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:44:44 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-e9fecbc2-ef6b-4a98-82cb-6f455238793a tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Create snapshot completed successfully Sep 10 16:44:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-0fc8e5dd-7412-431f-8d44-e0e352c73d32 req-3bc6c9ea-1efe-4c00-8add-7b3c2bc5c181 tempest-AttachVolumeNegativeTest-74284645 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8', 'name': 'volume-364d218d-b617-4614-9899-a9bd8dffa59e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e2d790e0-2a4b-4c1c-8da8-6f8e71056a2b', 'enforce_multipath': True} {{(pid=88189) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 16:44:44 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-0fc8e5dd-7412-431f-8d44-e0e352c73d32 req-3bc6c9ea-1efe-4c00-8add-7b3c2bc5c181 tempest-AttachVolumeNegativeTest-74284645 None] attachment_update completed successfully. Sep 10 16:44:45 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c2f1d35-b8ef-47d6-8dfe-291f6b59a10f tempest-VolumesActionsTest-1449905026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:44:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8c2f1d35-b8ef-47d6-8dfe-291f6b59a10f tempest-VolumesActionsTest-1449905026 None] Flow 'volume_create_manager' (8a376f01-f594-43fe-8b7b-294364ae2533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:44:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8c2f1d35-b8ef-47d6-8dfe-291f6b59a10f tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506a6888-5b76-4658-81f2-257f157da97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8c2f1d35-b8ef-47d6-8dfe-291f6b59a10f tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506a6888-5b76-4658-81f2-257f157da97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-662436185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5f7f805-3d57-486e-8634-4742644c7db6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14538eec33cc4b48b06e1d3ba24b6165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:44:45Z,use_quota=True,user_id='fd9af4f2d013477a8191785fe708d35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8c2f1d35-b8ef-47d6-8dfe-291f6b59a10f tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54f5901c-cabc-436a-8bb8-ca63c4326e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8c2f1d35-b8ef-47d6-8dfe-291f6b59a10f tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54f5901c-cabc-436a-8bb8-ca63c4326e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8c2f1d35-b8ef-47d6-8dfe-291f6b59a10f tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c2f0fd4-c43a-475e-bb4c-f079abf01198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8c2f1d35-b8ef-47d6-8dfe-291f6b59a10f tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c2f0fd4-c43a-475e-bb4c-f079abf01198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5f7f805-3d57-486e-8634-4742644c7db6', 'volume_name': 'volume-a5f7f805-3d57-486e-8634-4742644c7db6', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8c2f1d35-b8ef-47d6-8dfe-291f6b59a10f tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cedb624f-82c5-49ac-949f-c5ec3d6f8f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8c2f1d35-b8ef-47d6-8dfe-291f6b59a10f tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cedb624f-82c5-49ac-949f-c5ec3d6f8f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8c2f1d35-b8ef-47d6-8dfe-291f6b59a10f tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2819db4-7c7c-4728-bc89-c6e2e324aba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:45 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-8c2f1d35-b8ef-47d6-8dfe-291f6b59a10f tempest-VolumesActionsTest-1449905026 None] Volume a5f7f805-3d57-486e-8634-4742644c7db6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5f7f805-3d57-486e-8634-4742644c7db6', 'volume_size': 1} Sep 10 16:44:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8c2f1d35-b8ef-47d6-8dfe-291f6b59a10f tempest-VolumesActionsTest-1449905026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:44:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8c2f1d35-b8ef-47d6-8dfe-291f6b59a10f tempest-VolumesActionsTest-1449905026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:44:45 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8c2f1d35-b8ef-47d6-8dfe-291f6b59a10f tempest-VolumesActionsTest-1449905026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-662436185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5f7f805-3d57-486e-8634-4742644c7db6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14538eec33cc4b48b06e1d3ba24b6165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:44:45Z,use_quota=True,user_id='fd9af4f2d013477a8191785fe708d35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:44:45 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-8c2f1d35-b8ef-47d6-8dfe-291f6b59a10f tempest-VolumesActionsTest-1449905026 None] Creating volume a5f7f805-3d57-486e-8634-4742644c7db6 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:44:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8c2f1d35-b8ef-47d6-8dfe-291f6b59a10f tempest-VolumesActionsTest-1449905026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:44:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8c2f1d35-b8ef-47d6-8dfe-291f6b59a10f tempest-VolumesActionsTest-1449905026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:44:45 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8c2f1d35-b8ef-47d6-8dfe-291f6b59a10f tempest-VolumesActionsTest-1449905026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:44:45 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8c2f1d35-b8ef-47d6-8dfe-291f6b59a10f tempest-VolumesActionsTest-1449905026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:44:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8c2f1d35-b8ef-47d6-8dfe-291f6b59a10f tempest-VolumesActionsTest-1449905026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:44:45 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8c2f1d35-b8ef-47d6-8dfe-291f6b59a10f tempest-VolumesActionsTest-1449905026 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:44:45 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-8c2f1d35-b8ef-47d6-8dfe-291f6b59a10f tempest-VolumesActionsTest-1449905026 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:44:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8c2f1d35-b8ef-47d6-8dfe-291f6b59a10f tempest-VolumesActionsTest-1449905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a5f7f805-3d57-486e-8634-4742644c7db6 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:45 devstack sudo[96417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a5f7f805-3d57-486e-8634-4742644c7db6 1073741824 Sep 10 16:44:45 devstack sudo[96417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:45 devstack sudo[96417]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8c2f1d35-b8ef-47d6-8dfe-291f6b59a10f tempest-VolumesActionsTest-1449905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a5f7f805-3d57-486e-8634-4742644c7db6 1073741824" returned: 0 in 0.546s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8c2f1d35-b8ef-47d6-8dfe-291f6b59a10f tempest-VolumesActionsTest-1449905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a5f7f805-3d57-486e-8634-4742644c7db6 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:45 devstack sudo[96423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a5f7f805-3d57-486e-8634-4742644c7db6 Sep 10 16:44:45 devstack sudo[96423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:46 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-43d8931b-f052-470c-89a1-98c3d1363715 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Acquiring lock "cinder-3fdd3f35-df5b-4da0-acad-b3f2b8da7bc1-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:44:46 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-43d8931b-f052-470c-89a1-98c3d1363715 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Lock "cinder-3fdd3f35-df5b-4da0-acad-b3f2b8da7bc1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:44:46 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-43d8931b-f052-470c-89a1-98c3d1363715 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Acquiring lock "cinder-quobyte-a8076851-11e0-4032-893c-ec573d0659ef" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:44:46 devstack sudo[96423]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8c2f1d35-b8ef-47d6-8dfe-291f6b59a10f tempest-VolumesActionsTest-1449905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a5f7f805-3d57-486e-8634-4742644c7db6" returned: 0 in 0.333s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:46 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8c2f1d35-b8ef-47d6-8dfe-291f6b59a10f tempest-VolumesActionsTest-1449905026 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:44:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8c2f1d35-b8ef-47d6-8dfe-291f6b59a10f tempest-VolumesActionsTest-1449905026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:44:46 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-43d8931b-f052-470c-89a1-98c3d1363715 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Lock "cinder-quobyte-a8076851-11e0-4032-893c-ec573d0659ef" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:44:46 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-43d8931b-f052-470c-89a1-98c3d1363715 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Acquiring lock "cinder-quobyte-3fdd3f35-df5b-4da0-acad-b3f2b8da7bc1" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:44:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8c2f1d35-b8ef-47d6-8dfe-291f6b59a10f tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2819db4-7c7c-4728-bc89-c6e2e324aba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5f7f805-3d57-486e-8634-4742644c7db6', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8c2f1d35-b8ef-47d6-8dfe-291f6b59a10f tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc3644a-ae23-4adf-98d1-a0e1a69ccd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:46 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-43d8931b-f052-470c-89a1-98c3d1363715 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Lock "cinder-quobyte-3fdd3f35-df5b-4da0-acad-b3f2b8da7bc1" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:44:46 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-43d8931b-f052-470c-89a1-98c3d1363715 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Deleting offline snapshot 3fdd3f35-df5b-4da0-acad-b3f2b8da7bc1 of volume a8076851-11e0-4032-893c-ec573d0659ef {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:44:46 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-43d8931b-f052-470c-89a1-98c3d1363715 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] snapshot_file for this snap is: volume-a8076851-11e0-4032-893c-ec573d0659ef.3fdd3f35-df5b-4da0-acad-b3f2b8da7bc1 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:44:46 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-8c2f1d35-b8ef-47d6-8dfe-291f6b59a10f tempest-VolumesActionsTest-1449905026 None] Volume volume-a5f7f805-3d57-486e-8634-4742644c7db6 (a5f7f805-3d57-486e-8634-4742644c7db6): created successfully Sep 10 16:44:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8c2f1d35-b8ef-47d6-8dfe-291f6b59a10f tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc3644a-ae23-4adf-98d1-a0e1a69ccd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8c2f1d35-b8ef-47d6-8dfe-291f6b59a10f tempest-VolumesActionsTest-1449905026 None] Flow 'volume_create_manager' (8a376f01-f594-43fe-8b7b-294364ae2533) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:44:46 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8e1828-4ce0-40ee-bd8c-270eb500ea00]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:44:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-43d8931b-f052-470c-89a1-98c3d1363715 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef.3fdd3f35-df5b-4da0-acad-b3f2b8da7bc1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:46 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-8c2f1d35-b8ef-47d6-8dfe-291f6b59a10f tempest-VolumesActionsTest-1449905026 None] Created volume successfully. Sep 10 16:44:46 devstack sudo[96426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef.3fdd3f35-df5b-4da0-acad-b3f2b8da7bc1 Sep 10 16:44:46 devstack sudo[96426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:46 devstack sudo[96426]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-43d8931b-f052-470c-89a1-98c3d1363715 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef.3fdd3f35-df5b-4da0-acad-b3f2b8da7bc1" returned: 0 in 0.488s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:46 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-43d8931b-f052-470c-89a1-98c3d1363715 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8076851-11e0-4032-893c-ec573d0659ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:44:46 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d358f3-7ceb-4ef8-b6b8-dd04c4a73bfd]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:44:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-43d8931b-f052-470c-89a1-98c3d1363715 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:47 devstack sudo[96440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef Sep 10 16:44:47 devstack sudo[96440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:47 devstack sudo[96440]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-43d8931b-f052-470c-89a1-98c3d1363715 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef" returned: 0 in 0.559s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-43d8931b-f052-470c-89a1-98c3d1363715 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef.3fdd3f35-df5b-4da0-acad-b3f2b8da7bc1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:47 devstack sudo[96445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef.3fdd3f35-df5b-4da0-acad-b3f2b8da7bc1 Sep 10 16:44:47 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:47 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c3fb8f36-c226-4b00-b9e4-ada504b92c67 tempest-VolumesActionsTest-862026654 None] Acquiring lock "cinder-a5f7f805-3d57-486e-8634-4742644c7db6-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:44:47 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c3fb8f36-c226-4b00-b9e4-ada504b92c67 tempest-VolumesActionsTest-862026654 None] Lock "cinder-a5f7f805-3d57-486e-8634-4742644c7db6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:44:47 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c3fb8f36-c226-4b00-b9e4-ada504b92c67 tempest-VolumesActionsTest-862026654 None] Acquiring lock "cinder-quobyte-a5f7f805-3d57-486e-8634-4742644c7db6" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:44:47 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c3fb8f36-c226-4b00-b9e4-ada504b92c67 tempest-VolumesActionsTest-862026654 None] Lock "cinder-quobyte-a5f7f805-3d57-486e-8634-4742644c7db6" acquired by "delete_volume" :: waited 0.034s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:44:47 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f479b9d3-88d1-4083-9c52-07bcca63a66f]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:44:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c3fb8f36-c226-4b00-b9e4-ada504b92c67 tempest-VolumesActionsTest-862026654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a5f7f805-3d57-486e-8634-4742644c7db6 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:47 devstack sudo[96449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a5f7f805-3d57-486e-8634-4742644c7db6 Sep 10 16:44:47 devstack sudo[96449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:47 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-43d8931b-f052-470c-89a1-98c3d1363715 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef.3fdd3f35-df5b-4da0-acad-b3f2b8da7bc1" returned: 0 in 0.528s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-43d8931b-f052-470c-89a1-98c3d1363715 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef.3fdd3f35-df5b-4da0-acad-b3f2b8da7bc1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:48 devstack sudo[96452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef.3fdd3f35-df5b-4da0-acad-b3f2b8da7bc1 Sep 10 16:44:48 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:48 devstack sudo[96449]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c3fb8f36-c226-4b00-b9e4-ada504b92c67 tempest-VolumesActionsTest-862026654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a5f7f805-3d57-486e-8634-4742644c7db6" returned: 0 in 0.494s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c3fb8f36-c226-4b00-b9e4-ada504b92c67 tempest-VolumesActionsTest-862026654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a5f7f805-3d57-486e-8634-4742644c7db6 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:48 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-43d8931b-f052-470c-89a1-98c3d1363715 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef.3fdd3f35-df5b-4da0-acad-b3f2b8da7bc1" returned: 0 in 0.321s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:48 devstack sudo[96459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a5f7f805-3d57-486e-8634-4742644c7db6 Sep 10 16:44:48 devstack sudo[96459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:48 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-43d8931b-f052-470c-89a1-98c3d1363715 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Lock "cinder-quobyte-3fdd3f35-df5b-4da0-acad-b3f2b8da7bc1" released by "_delete_snapshot" :: held 2.104s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:44:48 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-43d8931b-f052-470c-89a1-98c3d1363715 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Lock "cinder-quobyte-a8076851-11e0-4032-893c-ec573d0659ef" released by "delete_snapshot" :: held 2.161s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:44:48 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-43d8931b-f052-470c-89a1-98c3d1363715 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Created reservations ['7feba581-b33f-4e9c-a2bd-c78c8deae109', '9d23a86c-3325-45c3-97e9-b0c4efa31c70', 'e67fd73a-02f9-4344-ae4d-a4922ae100c7', '1d7dc09f-a85d-4dfc-9ce3-0ee99ff7ce15'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:44:48 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-43d8931b-f052-470c-89a1-98c3d1363715 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Delete snapshot completed successfully. Sep 10 16:44:48 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-43d8931b-f052-470c-89a1-98c3d1363715 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Lock "cinder-3fdd3f35-df5b-4da0-acad-b3f2b8da7bc1-delete_snapshot" released by "delete_snapshot" :: held 2.361s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:44:48 devstack sudo[96459]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c3fb8f36-c226-4b00-b9e4-ada504b92c67 tempest-VolumesActionsTest-862026654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a5f7f805-3d57-486e-8634-4742644c7db6" returned: 0 in 0.375s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:48 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c3fb8f36-c226-4b00-b9e4-ada504b92c67 tempest-VolumesActionsTest-862026654 None] Lock "cinder-quobyte-a5f7f805-3d57-486e-8634-4742644c7db6" released by "delete_volume" :: held 0.928s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:44:48 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-c3fb8f36-c226-4b00-b9e4-ada504b92c67 tempest-VolumesActionsTest-862026654 None] Created reservations ['1398853c-3eb5-4da0-bba1-c47a21cb6da3', '0324d4f4-e225-4597-a0e2-5e7201c86a56', 'cef69639-d616-43f0-8c9e-7deedc94e419', 'f34124d5-9eda-48a4-8937-cd13b8316159'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:44:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c3fb8f36-c226-4b00-b9e4-ada504b92c67 tempest-VolumesActionsTest-862026654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:44:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c3fb8f36-c226-4b00-b9e4-ada504b92c67 tempest-VolumesActionsTest-862026654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:44:48 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c3fb8f36-c226-4b00-b9e4-ada504b92c67 tempest-VolumesActionsTest-862026654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:44:48 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c3fb8f36-c226-4b00-b9e4-ada504b92c67 tempest-VolumesActionsTest-862026654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:44:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c3fb8f36-c226-4b00-b9e4-ada504b92c67 tempest-VolumesActionsTest-862026654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:44:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c3fb8f36-c226-4b00-b9e4-ada504b92c67 tempest-VolumesActionsTest-862026654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:48 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:44:48 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:49 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c3fb8f36-c226-4b00-b9e4-ada504b92c67 tempest-VolumesActionsTest-862026654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.274s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:49 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-c3fb8f36-c226-4b00-b9e4-ada504b92c67 tempest-VolumesActionsTest-862026654 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:44:49 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-c3fb8f36-c226-4b00-b9e4-ada504b92c67 tempest-VolumesActionsTest-862026654 None] Deleted volume successfully. Sep 10 16:44:49 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c3fb8f36-c226-4b00-b9e4-ada504b92c67 tempest-VolumesActionsTest-862026654 None] Lock "cinder-a5f7f805-3d57-486e-8634-4742644c7db6-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:44:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:44:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:44:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:44:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:44:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:44:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:44:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:49 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c5703b41-17f1-4c94-ad6f-3e5036bae9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Acquiring lock "cinder-a8076851-11e0-4032-893c-ec573d0659ef-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:44:49 devstack sudo[96465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:44:49 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:49 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c5703b41-17f1-4c94-ad6f-3e5036bae9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Lock "cinder-a8076851-11e0-4032-893c-ec573d0659ef-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:44:49 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c5703b41-17f1-4c94-ad6f-3e5036bae9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Acquiring lock "cinder-quobyte-a8076851-11e0-4032-893c-ec573d0659ef" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:44:49 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c5703b41-17f1-4c94-ad6f-3e5036bae9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Lock "cinder-quobyte-a8076851-11e0-4032-893c-ec573d0659ef" acquired by "delete_volume" :: waited 0.029s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:44:49 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b392de52-06c3-4663-b94a-94b656234433]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:44:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c5703b41-17f1-4c94-ad6f-3e5036bae9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:49 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef Sep 10 16:44:49 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:49 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.424s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:49 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:44:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager._thread_info {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:44:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread count: 28 {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 16:44:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread info: [<_MainThread(MainThread, started 125792070905984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 16:44:50 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c5703b41-17f1-4c94-ad6f-3e5036bae9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef" returned: 0 in 0.518s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c5703b41-17f1-4c94-ad6f-3e5036bae9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:50 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef Sep 10 16:44:50 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:50 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c5703b41-17f1-4c94-ad6f-3e5036bae9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a8076851-11e0-4032-893c-ec573d0659ef" returned: 0 in 0.363s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:50 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c5703b41-17f1-4c94-ad6f-3e5036bae9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Lock "cinder-quobyte-a8076851-11e0-4032-893c-ec573d0659ef" released by "delete_volume" :: held 0.953s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:44:50 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffe7829e-3975-4bfc-9730-1396a69d843a tempest-VolumesActionsTest-1449905026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:44:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ffe7829e-3975-4bfc-9730-1396a69d843a tempest-VolumesActionsTest-1449905026 None] Flow 'volume_create_manager' (cf83abc1-902f-451a-b212-3ed0715c8b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:44:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ffe7829e-3975-4bfc-9730-1396a69d843a tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22d5d6d6-d81c-48cf-8301-de9ee8302942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ffe7829e-3975-4bfc-9730-1396a69d843a tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22d5d6d6-d81c-48cf-8301-de9ee8302942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-500794411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd79386f-2dc5-488d-bbb6-c7a624bdf4fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14538eec33cc4b48b06e1d3ba24b6165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:44:51Z,use_quota=True,user_id='fd9af4f2d013477a8191785fe708d35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ffe7829e-3975-4bfc-9730-1396a69d843a tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d93b1c6e-83e1-44f1-91df-a8cd0656819f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ffe7829e-3975-4bfc-9730-1396a69d843a tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d93b1c6e-83e1-44f1-91df-a8cd0656819f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ffe7829e-3975-4bfc-9730-1396a69d843a tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd24deca-d14a-4ea7-99ab-370870728729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ffe7829e-3975-4bfc-9730-1396a69d843a tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd24deca-d14a-4ea7-99ab-370870728729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd79386f-2dc5-488d-bbb6-c7a624bdf4fa', 'volume_name': 'volume-fd79386f-2dc5-488d-bbb6-c7a624bdf4fa', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ffe7829e-3975-4bfc-9730-1396a69d843a tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9533b5f7-be25-4601-a865-b3022bae9ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ffe7829e-3975-4bfc-9730-1396a69d843a tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9533b5f7-be25-4601-a865-b3022bae9ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ffe7829e-3975-4bfc-9730-1396a69d843a tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97015837-cae2-4c6f-969d-c6afef3792af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:50 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-ffe7829e-3975-4bfc-9730-1396a69d843a tempest-VolumesActionsTest-1449905026 None] Volume fd79386f-2dc5-488d-bbb6-c7a624bdf4fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd79386f-2dc5-488d-bbb6-c7a624bdf4fa', 'volume_size': 1} Sep 10 16:44:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ffe7829e-3975-4bfc-9730-1396a69d843a tempest-VolumesActionsTest-1449905026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:44:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ffe7829e-3975-4bfc-9730-1396a69d843a tempest-VolumesActionsTest-1449905026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:44:50 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ffe7829e-3975-4bfc-9730-1396a69d843a tempest-VolumesActionsTest-1449905026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-500794411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd79386f-2dc5-488d-bbb6-c7a624bdf4fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14538eec33cc4b48b06e1d3ba24b6165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:44:51Z,use_quota=True,user_id='fd9af4f2d013477a8191785fe708d35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:44:50 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-ffe7829e-3975-4bfc-9730-1396a69d843a tempest-VolumesActionsTest-1449905026 None] Creating volume fd79386f-2dc5-488d-bbb6-c7a624bdf4fa {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:44:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ffe7829e-3975-4bfc-9730-1396a69d843a tempest-VolumesActionsTest-1449905026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:44:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ffe7829e-3975-4bfc-9730-1396a69d843a tempest-VolumesActionsTest-1449905026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:44:50 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ffe7829e-3975-4bfc-9730-1396a69d843a tempest-VolumesActionsTest-1449905026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:44:50 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ffe7829e-3975-4bfc-9730-1396a69d843a tempest-VolumesActionsTest-1449905026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:44:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ffe7829e-3975-4bfc-9730-1396a69d843a tempest-VolumesActionsTest-1449905026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:44:50 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ffe7829e-3975-4bfc-9730-1396a69d843a tempest-VolumesActionsTest-1449905026 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:44:50 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-ffe7829e-3975-4bfc-9730-1396a69d843a tempest-VolumesActionsTest-1449905026 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:44:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ffe7829e-3975-4bfc-9730-1396a69d843a tempest-VolumesActionsTest-1449905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fd79386f-2dc5-488d-bbb6-c7a624bdf4fa 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:50 devstack sudo[96481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fd79386f-2dc5-488d-bbb6-c7a624bdf4fa 1073741824 Sep 10 16:44:50 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:50 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-c5703b41-17f1-4c94-ad6f-3e5036bae9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Created reservations ['b861d105-8c9a-4d18-9727-eeff2ebad681', '8097855a-fef5-4860-a0df-75d3e918c370', 'f8c12bd5-b19b-40ee-a3aa-4c2321c978a5', 'b43d5197-263c-490d-8a47-2fc21a856245'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:44:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c5703b41-17f1-4c94-ad6f-3e5036bae9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:44:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c5703b41-17f1-4c94-ad6f-3e5036bae9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:44:50 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c5703b41-17f1-4c94-ad6f-3e5036bae9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:44:50 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c5703b41-17f1-4c94-ad6f-3e5036bae9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:44:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c5703b41-17f1-4c94-ad6f-3e5036bae9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:44:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c5703b41-17f1-4c94-ad6f-3e5036bae9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:50 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:44:50 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:51 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c5703b41-17f1-4c94-ad6f-3e5036bae9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.438s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:51 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-c5703b41-17f1-4c94-ad6f-3e5036bae9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:44:51 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-c5703b41-17f1-4c94-ad6f-3e5036bae9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Deleted volume successfully. Sep 10 16:44:51 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ffe7829e-3975-4bfc-9730-1396a69d843a tempest-VolumesActionsTest-1449905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fd79386f-2dc5-488d-bbb6-c7a624bdf4fa 1073741824" returned: 0 in 0.631s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:51 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c5703b41-17f1-4c94-ad6f-3e5036bae9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1146857287 None] Lock "cinder-a8076851-11e0-4032-893c-ec573d0659ef-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:44:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ffe7829e-3975-4bfc-9730-1396a69d843a tempest-VolumesActionsTest-1449905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fd79386f-2dc5-488d-bbb6-c7a624bdf4fa {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:51 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fd79386f-2dc5-488d-bbb6-c7a624bdf4fa Sep 10 16:44:51 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:51 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ffe7829e-3975-4bfc-9730-1396a69d843a tempest-VolumesActionsTest-1449905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fd79386f-2dc5-488d-bbb6-c7a624bdf4fa" returned: 0 in 0.304s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:51 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ffe7829e-3975-4bfc-9730-1396a69d843a tempest-VolumesActionsTest-1449905026 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:44:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ffe7829e-3975-4bfc-9730-1396a69d843a tempest-VolumesActionsTest-1449905026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:44:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ffe7829e-3975-4bfc-9730-1396a69d843a tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97015837-cae2-4c6f-969d-c6afef3792af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd79386f-2dc5-488d-bbb6-c7a624bdf4fa', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ffe7829e-3975-4bfc-9730-1396a69d843a tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2ff659-497c-447e-adc9-fadce3d5a7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:51 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-ffe7829e-3975-4bfc-9730-1396a69d843a tempest-VolumesActionsTest-1449905026 None] Volume volume-fd79386f-2dc5-488d-bbb6-c7a624bdf4fa (fd79386f-2dc5-488d-bbb6-c7a624bdf4fa): created successfully Sep 10 16:44:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ffe7829e-3975-4bfc-9730-1396a69d843a tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2ff659-497c-447e-adc9-fadce3d5a7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ffe7829e-3975-4bfc-9730-1396a69d843a tempest-VolumesActionsTest-1449905026 None] Flow 'volume_create_manager' (cf83abc1-902f-451a-b212-3ed0715c8b51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:44:51 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-ffe7829e-3975-4bfc-9730-1396a69d843a tempest-VolumesActionsTest-1449905026 None] Created volume successfully. Sep 10 16:44:53 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4dc763f3-0256-457e-b014-c185621dcf8d tempest-VolumesActionsTest-862026654 None] Acquiring lock "cinder-fd79386f-2dc5-488d-bbb6-c7a624bdf4fa-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:44:53 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4dc763f3-0256-457e-b014-c185621dcf8d tempest-VolumesActionsTest-862026654 None] Lock "cinder-fd79386f-2dc5-488d-bbb6-c7a624bdf4fa-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:44:53 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4dc763f3-0256-457e-b014-c185621dcf8d tempest-VolumesActionsTest-862026654 None] Acquiring lock "cinder-quobyte-fd79386f-2dc5-488d-bbb6-c7a624bdf4fa" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:44:53 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4dc763f3-0256-457e-b014-c185621dcf8d tempest-VolumesActionsTest-862026654 None] Lock "cinder-quobyte-fd79386f-2dc5-488d-bbb6-c7a624bdf4fa" acquired by "delete_volume" :: waited 0.039s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:44:53 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ee8d3a-c016-461d-a28e-5311b58631fb]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:44:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4dc763f3-0256-457e-b014-c185621dcf8d tempest-VolumesActionsTest-862026654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fd79386f-2dc5-488d-bbb6-c7a624bdf4fa {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:53 devstack sudo[96516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fd79386f-2dc5-488d-bbb6-c7a624bdf4fa Sep 10 16:44:53 devstack sudo[96516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:53 devstack sudo[96516]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4dc763f3-0256-457e-b014-c185621dcf8d tempest-VolumesActionsTest-862026654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fd79386f-2dc5-488d-bbb6-c7a624bdf4fa" returned: 0 in 0.584s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4dc763f3-0256-457e-b014-c185621dcf8d tempest-VolumesActionsTest-862026654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fd79386f-2dc5-488d-bbb6-c7a624bdf4fa {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:53 devstack sudo[96525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fd79386f-2dc5-488d-bbb6-c7a624bdf4fa Sep 10 16:44:53 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:54 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4dc763f3-0256-457e-b014-c185621dcf8d tempest-VolumesActionsTest-862026654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fd79386f-2dc5-488d-bbb6-c7a624bdf4fa" returned: 0 in 0.329s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:54 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4dc763f3-0256-457e-b014-c185621dcf8d tempest-VolumesActionsTest-862026654 None] Lock "cinder-quobyte-fd79386f-2dc5-488d-bbb6-c7a624bdf4fa" released by "delete_volume" :: held 0.988s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:44:54 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-4dc763f3-0256-457e-b014-c185621dcf8d tempest-VolumesActionsTest-862026654 None] Created reservations ['ea8dc569-cee7-4b64-aab1-98be70caeb24', '68ae9c6e-5fdb-49e7-8718-ae6496a5afbd', '6d3269d7-07a8-4655-9afa-c9f578354ea7', 'edc3bc57-b65b-4957-bf5c-d3933e9e8bb0'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:44:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4dc763f3-0256-457e-b014-c185621dcf8d tempest-VolumesActionsTest-862026654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:44:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4dc763f3-0256-457e-b014-c185621dcf8d tempest-VolumesActionsTest-862026654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:44:54 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-4dc763f3-0256-457e-b014-c185621dcf8d tempest-VolumesActionsTest-862026654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:44:54 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-4dc763f3-0256-457e-b014-c185621dcf8d tempest-VolumesActionsTest-862026654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:44:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4dc763f3-0256-457e-b014-c185621dcf8d tempest-VolumesActionsTest-862026654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:44:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4dc763f3-0256-457e-b014-c185621dcf8d tempest-VolumesActionsTest-862026654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:54 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:44:54 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:54 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4dc763f3-0256-457e-b014-c185621dcf8d tempest-VolumesActionsTest-862026654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.288s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:54 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-4dc763f3-0256-457e-b014-c185621dcf8d tempest-VolumesActionsTest-862026654 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:44:54 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-4dc763f3-0256-457e-b014-c185621dcf8d tempest-VolumesActionsTest-862026654 None] Deleted volume successfully. Sep 10 16:44:54 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4dc763f3-0256-457e-b014-c185621dcf8d tempest-VolumesActionsTest-862026654 None] Lock "cinder-fd79386f-2dc5-488d-bbb6-c7a624bdf4fa-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:44:56 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-7be45f3b-b6bf-4d01-bb95-259ca4243d6c tempest-VolumesActionsTest-1449905026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:44:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7be45f3b-b6bf-4d01-bb95-259ca4243d6c tempest-VolumesActionsTest-1449905026 None] Flow 'volume_create_manager' (e4ada5a1-a991-4115-a36b-7ab407de936a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:44:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7be45f3b-b6bf-4d01-bb95-259ca4243d6c tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c861133-5a56-4b66-b783-4d8d794d5f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7be45f3b-b6bf-4d01-bb95-259ca4243d6c tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c861133-5a56-4b66-b783-4d8d794d5f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1360230234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a63e63a-0363-4aec-ab85-0fb8293b6dc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14538eec33cc4b48b06e1d3ba24b6165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:44:56Z,use_quota=True,user_id='fd9af4f2d013477a8191785fe708d35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7be45f3b-b6bf-4d01-bb95-259ca4243d6c tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8ce4268-3f79-4725-a6e8-ec5d2c414cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7be45f3b-b6bf-4d01-bb95-259ca4243d6c tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8ce4268-3f79-4725-a6e8-ec5d2c414cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7be45f3b-b6bf-4d01-bb95-259ca4243d6c tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89a18d79-c266-4428-b409-f21e4ae73a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7be45f3b-b6bf-4d01-bb95-259ca4243d6c tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89a18d79-c266-4428-b409-f21e4ae73a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a63e63a-0363-4aec-ab85-0fb8293b6dc0', 'volume_name': 'volume-0a63e63a-0363-4aec-ab85-0fb8293b6dc0', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7be45f3b-b6bf-4d01-bb95-259ca4243d6c tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f667ec42-f013-4c45-aceb-63f9f79a241f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7be45f3b-b6bf-4d01-bb95-259ca4243d6c tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f667ec42-f013-4c45-aceb-63f9f79a241f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7be45f3b-b6bf-4d01-bb95-259ca4243d6c tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f926a7-fb14-4657-ad81-1ea340fa7b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:56 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-7be45f3b-b6bf-4d01-bb95-259ca4243d6c tempest-VolumesActionsTest-1449905026 None] Volume 0a63e63a-0363-4aec-ab85-0fb8293b6dc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a63e63a-0363-4aec-ab85-0fb8293b6dc0', 'volume_size': 1} Sep 10 16:44:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7be45f3b-b6bf-4d01-bb95-259ca4243d6c tempest-VolumesActionsTest-1449905026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:44:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7be45f3b-b6bf-4d01-bb95-259ca4243d6c tempest-VolumesActionsTest-1449905026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:44:56 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7be45f3b-b6bf-4d01-bb95-259ca4243d6c tempest-VolumesActionsTest-1449905026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1360230234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a63e63a-0363-4aec-ab85-0fb8293b6dc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14538eec33cc4b48b06e1d3ba24b6165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:44:56Z,use_quota=True,user_id='fd9af4f2d013477a8191785fe708d35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:44:56 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-7be45f3b-b6bf-4d01-bb95-259ca4243d6c tempest-VolumesActionsTest-1449905026 None] Creating volume 0a63e63a-0363-4aec-ab85-0fb8293b6dc0 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:44:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7be45f3b-b6bf-4d01-bb95-259ca4243d6c tempest-VolumesActionsTest-1449905026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:44:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7be45f3b-b6bf-4d01-bb95-259ca4243d6c tempest-VolumesActionsTest-1449905026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:44:56 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7be45f3b-b6bf-4d01-bb95-259ca4243d6c tempest-VolumesActionsTest-1449905026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:44:56 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7be45f3b-b6bf-4d01-bb95-259ca4243d6c tempest-VolumesActionsTest-1449905026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:44:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7be45f3b-b6bf-4d01-bb95-259ca4243d6c tempest-VolumesActionsTest-1449905026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:44:56 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7be45f3b-b6bf-4d01-bb95-259ca4243d6c tempest-VolumesActionsTest-1449905026 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:44:56 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-7be45f3b-b6bf-4d01-bb95-259ca4243d6c tempest-VolumesActionsTest-1449905026 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:44:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7be45f3b-b6bf-4d01-bb95-259ca4243d6c tempest-VolumesActionsTest-1449905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0a63e63a-0363-4aec-ab85-0fb8293b6dc0 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:56 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0a63e63a-0363-4aec-ab85-0fb8293b6dc0 1073741824 Sep 10 16:44:56 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:56 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7be45f3b-b6bf-4d01-bb95-259ca4243d6c tempest-VolumesActionsTest-1449905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0a63e63a-0363-4aec-ab85-0fb8293b6dc0 1073741824" returned: 0 in 0.813s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7be45f3b-b6bf-4d01-bb95-259ca4243d6c tempest-VolumesActionsTest-1449905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0a63e63a-0363-4aec-ab85-0fb8293b6dc0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:44:57 devstack sudo[96586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0a63e63a-0363-4aec-ab85-0fb8293b6dc0 Sep 10 16:44:57 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:44:57 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root Sep 10 16:44:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7be45f3b-b6bf-4d01-bb95-259ca4243d6c tempest-VolumesActionsTest-1449905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0a63e63a-0363-4aec-ab85-0fb8293b6dc0" returned: 0 in 0.629s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:44:57 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7be45f3b-b6bf-4d01-bb95-259ca4243d6c tempest-VolumesActionsTest-1449905026 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:44:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7be45f3b-b6bf-4d01-bb95-259ca4243d6c tempest-VolumesActionsTest-1449905026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:44:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7be45f3b-b6bf-4d01-bb95-259ca4243d6c tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f926a7-fb14-4657-ad81-1ea340fa7b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a63e63a-0363-4aec-ab85-0fb8293b6dc0', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7be45f3b-b6bf-4d01-bb95-259ca4243d6c tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (075df500-e2a3-4d0c-ad4d-33d7ebb54601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:44:57 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-7be45f3b-b6bf-4d01-bb95-259ca4243d6c tempest-VolumesActionsTest-1449905026 None] Volume volume-0a63e63a-0363-4aec-ab85-0fb8293b6dc0 (0a63e63a-0363-4aec-ab85-0fb8293b6dc0): created successfully Sep 10 16:44:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7be45f3b-b6bf-4d01-bb95-259ca4243d6c tempest-VolumesActionsTest-1449905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (075df500-e2a3-4d0c-ad4d-33d7ebb54601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:44:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7be45f3b-b6bf-4d01-bb95-259ca4243d6c tempest-VolumesActionsTest-1449905026 None] Flow 'volume_create_manager' (e4ada5a1-a991-4115-a36b-7ab407de936a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:44:57 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-7be45f3b-b6bf-4d01-bb95-259ca4243d6c tempest-VolumesActionsTest-1449905026 None] Created volume successfully. Sep 10 16:44:59 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-28f65e83-4342-4b0e-a226-41681a676d73 tempest-VolumesActionsTest-1449905026 None] Acquiring lock "cinder-0a63e63a-0363-4aec-ab85-0fb8293b6dc0-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:44:59 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-28f65e83-4342-4b0e-a226-41681a676d73 tempest-VolumesActionsTest-1449905026 None] Lock "cinder-0a63e63a-0363-4aec-ab85-0fb8293b6dc0-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:44:59 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-28f65e83-4342-4b0e-a226-41681a676d73 tempest-VolumesActionsTest-1449905026 None] Acquiring lock "cinder-quobyte-0a63e63a-0363-4aec-ab85-0fb8293b6dc0" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:44:59 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-28f65e83-4342-4b0e-a226-41681a676d73 tempest-VolumesActionsTest-1449905026 None] Lock "cinder-quobyte-0a63e63a-0363-4aec-ab85-0fb8293b6dc0" acquired by "delete_volume" :: waited 0.019s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:45:00 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d19ac2-27ab-4a15-9386-0a31f3aeaea6]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:45:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-28f65e83-4342-4b0e-a226-41681a676d73 tempest-VolumesActionsTest-1449905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0a63e63a-0363-4aec-ab85-0fb8293b6dc0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:00 devstack sudo[96662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0a63e63a-0363-4aec-ab85-0fb8293b6dc0 Sep 10 16:45:00 devstack sudo[96662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:00 devstack sudo[96662]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-28f65e83-4342-4b0e-a226-41681a676d73 tempest-VolumesActionsTest-1449905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0a63e63a-0363-4aec-ab85-0fb8293b6dc0" returned: 0 in 0.616s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-28f65e83-4342-4b0e-a226-41681a676d73 tempest-VolumesActionsTest-1449905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0a63e63a-0363-4aec-ab85-0fb8293b6dc0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:00 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0a63e63a-0363-4aec-ab85-0fb8293b6dc0 Sep 10 16:45:00 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:00 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-28f65e83-4342-4b0e-a226-41681a676d73 tempest-VolumesActionsTest-1449905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0a63e63a-0363-4aec-ab85-0fb8293b6dc0" returned: 0 in 0.363s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:01 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-28f65e83-4342-4b0e-a226-41681a676d73 tempest-VolumesActionsTest-1449905026 None] Lock "cinder-quobyte-0a63e63a-0363-4aec-ab85-0fb8293b6dc0" released by "delete_volume" :: held 1.087s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:45:01 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-28f65e83-4342-4b0e-a226-41681a676d73 tempest-VolumesActionsTest-1449905026 None] Created reservations ['8d043581-49d0-47a7-bc49-6d983415e681', 'b44364a7-2f41-4bbd-8474-e47cf183cb30', '52eeb4d1-a85b-416c-b2c4-09c7f49a5d98', 'e76830b2-4777-41c4-a44e-ca10ef8de4da'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:45:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-28f65e83-4342-4b0e-a226-41681a676d73 tempest-VolumesActionsTest-1449905026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-28f65e83-4342-4b0e-a226-41681a676d73 tempest-VolumesActionsTest-1449905026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:01 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-28f65e83-4342-4b0e-a226-41681a676d73 tempest-VolumesActionsTest-1449905026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:45:01 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-28f65e83-4342-4b0e-a226-41681a676d73 tempest-VolumesActionsTest-1449905026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:45:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-28f65e83-4342-4b0e-a226-41681a676d73 tempest-VolumesActionsTest-1449905026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-28f65e83-4342-4b0e-a226-41681a676d73 tempest-VolumesActionsTest-1449905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:01 devstack sudo[96671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:45:01 devstack sudo[96671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:01 devstack sudo[96671]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-28f65e83-4342-4b0e-a226-41681a676d73 tempest-VolumesActionsTest-1449905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.339s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:01 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-28f65e83-4342-4b0e-a226-41681a676d73 tempest-VolumesActionsTest-1449905026 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:45:01 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-28f65e83-4342-4b0e-a226-41681a676d73 tempest-VolumesActionsTest-1449905026 None] Deleted volume successfully. Sep 10 16:45:01 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-28f65e83-4342-4b0e-a226-41681a676d73 tempest-VolumesActionsTest-1449905026 None] Lock "cinder-0a63e63a-0363-4aec-ab85-0fb8293b6dc0-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:45:09 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-9de863cd-fe60-4f00-9511-cf14c14aa5d8 tempest-VolumesDeleteCascade-1099800671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:45:09 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9de863cd-fe60-4f00-9511-cf14c14aa5d8 tempest-VolumesDeleteCascade-1099800671 None] Flow 'volume_create_manager' (b1353e31-a439-407c-98fd-cf57b5f9d729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:45:10 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9de863cd-fe60-4f00-9511-cf14c14aa5d8 tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a2a3ab-50ec-4503-b8e3-0ca78646c67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:10 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9de863cd-fe60-4f00-9511-cf14c14aa5d8 tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a2a3ab-50ec-4503-b8e3-0ca78646c67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1978950316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e4e7da-b2e4-4e87-ad84-f05cd5e23331,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a9dc0577234cd091a2f18f666e93b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:45:10Z,use_quota=True,user_id='d068ac13698c46d1b43bbe300fd5a814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:10 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9de863cd-fe60-4f00-9511-cf14c14aa5d8 tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (300c506e-a27d-4217-9630-b34e4ff8f5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:10 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9de863cd-fe60-4f00-9511-cf14c14aa5d8 tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (300c506e-a27d-4217-9630-b34e4ff8f5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:10 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9de863cd-fe60-4f00-9511-cf14c14aa5d8 tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae6ffcbd-143c-4e8a-8026-864fd322fa35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:10 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9de863cd-fe60-4f00-9511-cf14c14aa5d8 tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae6ffcbd-143c-4e8a-8026-864fd322fa35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30e4e7da-b2e4-4e87-ad84-f05cd5e23331', 'volume_name': 'volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:10 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9de863cd-fe60-4f00-9511-cf14c14aa5d8 tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c76ca947-d173-4c7b-80c1-a20867f88c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:10 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9de863cd-fe60-4f00-9511-cf14c14aa5d8 tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c76ca947-d173-4c7b-80c1-a20867f88c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:10 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9de863cd-fe60-4f00-9511-cf14c14aa5d8 tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b867a726-acf8-44c0-bff0-21e506927ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:10 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-9de863cd-fe60-4f00-9511-cf14c14aa5d8 tempest-VolumesDeleteCascade-1099800671 None] Volume 30e4e7da-b2e4-4e87-ad84-f05cd5e23331: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331', 'volume_size': 1} Sep 10 16:45:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9de863cd-fe60-4f00-9511-cf14c14aa5d8 tempest-VolumesDeleteCascade-1099800671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9de863cd-fe60-4f00-9511-cf14c14aa5d8 tempest-VolumesDeleteCascade-1099800671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:10 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9de863cd-fe60-4f00-9511-cf14c14aa5d8 tempest-VolumesDeleteCascade-1099800671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1978950316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e4e7da-b2e4-4e87-ad84-f05cd5e23331,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a9dc0577234cd091a2f18f666e93b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:45:10Z,use_quota=True,user_id='d068ac13698c46d1b43bbe300fd5a814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:45:10 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-9de863cd-fe60-4f00-9511-cf14c14aa5d8 tempest-VolumesDeleteCascade-1099800671 None] Creating volume 30e4e7da-b2e4-4e87-ad84-f05cd5e23331 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:45:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9de863cd-fe60-4f00-9511-cf14c14aa5d8 tempest-VolumesDeleteCascade-1099800671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9de863cd-fe60-4f00-9511-cf14c14aa5d8 tempest-VolumesDeleteCascade-1099800671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:10 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9de863cd-fe60-4f00-9511-cf14c14aa5d8 tempest-VolumesDeleteCascade-1099800671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:45:10 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9de863cd-fe60-4f00-9511-cf14c14aa5d8 tempest-VolumesDeleteCascade-1099800671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:45:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9de863cd-fe60-4f00-9511-cf14c14aa5d8 tempest-VolumesDeleteCascade-1099800671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:10 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9de863cd-fe60-4f00-9511-cf14c14aa5d8 tempest-VolumesDeleteCascade-1099800671 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:45:10 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-9de863cd-fe60-4f00-9511-cf14c14aa5d8 tempest-VolumesDeleteCascade-1099800671 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:45:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9de863cd-fe60-4f00-9511-cf14c14aa5d8 tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:10 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331 1073741824 Sep 10 16:45:10 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:10 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9de863cd-fe60-4f00-9511-cf14c14aa5d8 tempest-VolumesDeleteCascade-1099800671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331 1073741824" returned: 0 in 0.603s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9de863cd-fe60-4f00-9511-cf14c14aa5d8 tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:10 devstack sudo[96752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331 Sep 10 16:45:10 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:11 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9de863cd-fe60-4f00-9511-cf14c14aa5d8 tempest-VolumesDeleteCascade-1099800671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331" returned: 0 in 0.460s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:11 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9de863cd-fe60-4f00-9511-cf14c14aa5d8 tempest-VolumesDeleteCascade-1099800671 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:45:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9de863cd-fe60-4f00-9511-cf14c14aa5d8 tempest-VolumesDeleteCascade-1099800671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:11 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9de863cd-fe60-4f00-9511-cf14c14aa5d8 tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b867a726-acf8-44c0-bff0-21e506927ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:11 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9de863cd-fe60-4f00-9511-cf14c14aa5d8 tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d058eb2-b635-496d-87cc-61f57d82d6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:11 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-9de863cd-fe60-4f00-9511-cf14c14aa5d8 tempest-VolumesDeleteCascade-1099800671 None] Volume volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331 (30e4e7da-b2e4-4e87-ad84-f05cd5e23331): created successfully Sep 10 16:45:11 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9de863cd-fe60-4f00-9511-cf14c14aa5d8 tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d058eb2-b635-496d-87cc-61f57d82d6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:11 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9de863cd-fe60-4f00-9511-cf14c14aa5d8 tempest-VolumesDeleteCascade-1099800671 None] Flow 'volume_create_manager' (b1353e31-a439-407c-98fd-cf57b5f9d729) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:45:11 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-9de863cd-fe60-4f00-9511-cf14c14aa5d8 tempest-VolumesDeleteCascade-1099800671 None] Created volume successfully. Sep 10 16:45:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6ee363ad-640d-45a8-bdb7-673ea1b025c6 tempest-VolumesDeleteCascade-1099800671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6ee363ad-640d-45a8-bdb7-673ea1b025c6 tempest-VolumesDeleteCascade-1099800671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:12 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-6ee363ad-640d-45a8-bdb7-673ea1b025c6 tempest-VolumesDeleteCascade-1099800671 None] Creating offline snapshot 1d908701-c375-4ae9-ae4d-c19f9622e692 of volume 30e4e7da-b2e4-4e87-ad84-f05cd5e23331 {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:45:12 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af8f7e3-5e74-48ae-8da4-6f1ca5b324dc]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:45:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ee363ad-640d-45a8-bdb7-673ea1b025c6 tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:12 devstack sudo[96757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331 Sep 10 16:45:12 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:12 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ee363ad-640d-45a8-bdb7-673ea1b025c6 tempest-VolumesDeleteCascade-1099800671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331" returned: 0 in 0.446s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ee363ad-640d-45a8-bdb7-673ea1b025c6 tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.1d908701-c375-4ae9-ae4d-c19f9622e692 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:12 devstack sudo[96763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.1d908701-c375-4ae9-ae4d-c19f9622e692 1G Sep 10 16:45:12 devstack sudo[96763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:13 devstack sudo[96763]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ee363ad-640d-45a8-bdb7-673ea1b025c6 tempest-VolumesDeleteCascade-1099800671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.1d908701-c375-4ae9-ae4d-c19f9622e692 1G" returned: 0 in 0.666s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ee363ad-640d-45a8-bdb7-673ea1b025c6 tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.1d908701-c375-4ae9-ae4d-c19f9622e692 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:13 devstack sudo[96805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.1d908701-c375-4ae9-ae4d-c19f9622e692 Sep 10 16:45:13 devstack sudo[96805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:13 devstack sudo[96805]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ee363ad-640d-45a8-bdb7-673ea1b025c6 tempest-VolumesDeleteCascade-1099800671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.1d908701-c375-4ae9-ae4d-c19f9622e692" returned: 0 in 0.317s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:13 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-6ee363ad-640d-45a8-bdb7-673ea1b025c6 tempest-VolumesDeleteCascade-1099800671 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.1d908701-c375-4ae9-ae4d-c19f9622e692 is being set with open permissions: ugo+rw Sep 10 16:45:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ee363ad-640d-45a8-bdb7-673ea1b025c6 tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.1d908701-c375-4ae9-ae4d-c19f9622e692 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:13 devstack sudo[96810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.1d908701-c375-4ae9-ae4d-c19f9622e692 Sep 10 16:45:13 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:14 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ee363ad-640d-45a8-bdb7-673ea1b025c6 tempest-VolumesDeleteCascade-1099800671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.1d908701-c375-4ae9-ae4d-c19f9622e692" returned: 0 in 0.274s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ee363ad-640d-45a8-bdb7-673ea1b025c6 tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:14 devstack sudo[96813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.info Sep 10 16:45:14 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:14 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ee363ad-640d-45a8-bdb7-673ea1b025c6 tempest-VolumesDeleteCascade-1099800671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.info" returned: 0 in 0.304s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:14 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-6ee363ad-640d-45a8-bdb7-673ea1b025c6 tempest-VolumesDeleteCascade-1099800671 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.info is being set with open permissions: ugo+rw Sep 10 16:45:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ee363ad-640d-45a8-bdb7-673ea1b025c6 tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:14 devstack sudo[96816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.info Sep 10 16:45:14 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:14 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ee363ad-640d-45a8-bdb7-673ea1b025c6 tempest-VolumesDeleteCascade-1099800671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.info" returned: 0 in 0.279s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6ee363ad-640d-45a8-bdb7-673ea1b025c6 tempest-VolumesDeleteCascade-1099800671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.416s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:14 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-6ee363ad-640d-45a8-bdb7-673ea1b025c6 tempest-VolumesDeleteCascade-1099800671 None] Create snapshot completed successfully Sep 10 16:45:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-aced320b-8c1e-4266-87ee-89ac60cdcfb4 tempest-VolumesDeleteCascade-1099800671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-aced320b-8c1e-4266-87ee-89ac60cdcfb4 tempest-VolumesDeleteCascade-1099800671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-aced320b-8c1e-4266-87ee-89ac60cdcfb4 tempest-VolumesDeleteCascade-1099800671 None] Creating offline snapshot 933db868-bf6e-4280-8022-ad4bbdab784c of volume 30e4e7da-b2e4-4e87-ad84-f05cd5e23331 {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:45:15 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[32225cf5-a6a0-4859-9f87-35c09b664ec9]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:45:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-aced320b-8c1e-4266-87ee-89ac60cdcfb4 tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.1d908701-c375-4ae9-ae4d-c19f9622e692 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:15 devstack sudo[96819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.1d908701-c375-4ae9-ae4d-c19f9622e692 Sep 10 16:45:15 devstack sudo[96819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:16 devstack sudo[96819]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-aced320b-8c1e-4266-87ee-89ac60cdcfb4 tempest-VolumesDeleteCascade-1099800671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.1d908701-c375-4ae9-ae4d-c19f9622e692" returned: 0 in 0.404s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-aced320b-8c1e-4266-87ee-89ac60cdcfb4 tempest-VolumesDeleteCascade-1099800671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:45:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-aced320b-8c1e-4266-87ee-89ac60cdcfb4 tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.1d908701-c375-4ae9-ae4d-c19f9622e692,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.933db868-bf6e-4280-8022-ad4bbdab784c 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:16 devstack sudo[96824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.1d908701-c375-4ae9-ae4d-c19f9622e692,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.933db868-bf6e-4280-8022-ad4bbdab784c 1G Sep 10 16:45:16 devstack sudo[96824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:16 devstack sudo[96824]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-aced320b-8c1e-4266-87ee-89ac60cdcfb4 tempest-VolumesDeleteCascade-1099800671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.1d908701-c375-4ae9-ae4d-c19f9622e692,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.933db868-bf6e-4280-8022-ad4bbdab784c 1G" returned: 0 in 0.576s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-aced320b-8c1e-4266-87ee-89ac60cdcfb4 tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.1d908701-c375-4ae9-ae4d-c19f9622e692 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.933db868-bf6e-4280-8022-ad4bbdab784c {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:16 devstack sudo[96843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.1d908701-c375-4ae9-ae4d-c19f9622e692 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.933db868-bf6e-4280-8022-ad4bbdab784c Sep 10 16:45:16 devstack sudo[96843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:17 devstack sudo[96843]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-aced320b-8c1e-4266-87ee-89ac60cdcfb4 tempest-VolumesDeleteCascade-1099800671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.1d908701-c375-4ae9-ae4d-c19f9622e692 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.933db868-bf6e-4280-8022-ad4bbdab784c" returned: 0 in 0.356s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:17 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-aced320b-8c1e-4266-87ee-89ac60cdcfb4 tempest-VolumesDeleteCascade-1099800671 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.933db868-bf6e-4280-8022-ad4bbdab784c is being set with open permissions: ugo+rw Sep 10 16:45:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-aced320b-8c1e-4266-87ee-89ac60cdcfb4 tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.933db868-bf6e-4280-8022-ad4bbdab784c {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:17 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.933db868-bf6e-4280-8022-ad4bbdab784c Sep 10 16:45:17 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:17 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-aced320b-8c1e-4266-87ee-89ac60cdcfb4 tempest-VolumesDeleteCascade-1099800671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.933db868-bf6e-4280-8022-ad4bbdab784c" returned: 0 in 0.278s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:17 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:UPDATE=107,cinder:SELECT=86,cinder:INSERT=26,cinder:DELETE=9 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:45:17 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=91,cinder:UPDATE=109,cinder:INSERT=24,cinder:DELETE=11 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:45:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-aced320b-8c1e-4266-87ee-89ac60cdcfb4 tempest-VolumesDeleteCascade-1099800671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.725s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:17 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-aced320b-8c1e-4266-87ee-89ac60cdcfb4 tempest-VolumesDeleteCascade-1099800671 None] Create snapshot completed successfully Sep 10 16:45:17 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Acquiring lock "cinder-30e4e7da-b2e4-4e87-ad84-f05cd5e23331-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:45:17 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Lock "cinder-30e4e7da-b2e4-4e87-ad84-f05cd5e23331-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:45:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Performing cascade delete. {{(pid=88189) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 10 16:45:17 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Acquiring lock "cinder-1d908701-c375-4ae9-ae4d-c19f9622e692-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:45:18 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Lock "cinder-1d908701-c375-4ae9-ae4d-c19f9622e692-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:45:18 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Acquiring lock "cinder-quobyte-30e4e7da-b2e4-4e87-ad84-f05cd5e23331" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:45:18 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Lock "cinder-quobyte-30e4e7da-b2e4-4e87-ad84-f05cd5e23331" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:45:18 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Acquiring lock "cinder-quobyte-1d908701-c375-4ae9-ae4d-c19f9622e692" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:45:18 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Lock "cinder-quobyte-1d908701-c375-4ae9-ae4d-c19f9622e692" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:45:18 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Deleting offline snapshot 1d908701-c375-4ae9-ae4d-c19f9622e692 of volume 30e4e7da-b2e4-4e87-ad84-f05cd5e23331 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:45:18 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] snapshot_file for this snap is: volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.1d908701-c375-4ae9-ae4d-c19f9622e692 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:45:18 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e3b91b-aeb6-49e4-96b4-21a6bb907e0f]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:45:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.1d908701-c375-4ae9-ae4d-c19f9622e692 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:18 devstack sudo[96851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.1d908701-c375-4ae9-ae4d-c19f9622e692 Sep 10 16:45:18 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:18 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.1d908701-c375-4ae9-ae4d-c19f9622e692" returned: 0 in 0.380s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:18 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:45:18 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[99845cf4-117a-4288-9465-c22b12d25849]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:45:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:18 devstack sudo[96856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331 Sep 10 16:45:18 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:18 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331" returned: 0 in 0.404s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:18 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[981c5edf-face-4d5d-9c5d-0826299c826b]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:45:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.933db868-bf6e-4280-8022-ad4bbdab784c {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:19 devstack sudo[96861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.933db868-bf6e-4280-8022-ad4bbdab784c Sep 10 16:45:19 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:19 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.933db868-bf6e-4280-8022-ad4bbdab784c" returned: 0 in 0.431s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:19 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:45:19 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc83a9d-63f2-4fdd-b387-8890dee9c94b]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:45:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.1d908701-c375-4ae9-ae4d-c19f9622e692 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:19 devstack sudo[96866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.1d908701-c375-4ae9-ae4d-c19f9622e692 Sep 10 16:45:19 devstack sudo[96866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:19 devstack sudo[96866]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.1d908701-c375-4ae9-ae4d-c19f9622e692" returned: 0 in 0.411s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:19 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:45:19 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c59e57-7bef-488b-a140-ab9cd649a5b7]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:45:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:19 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331 Sep 10 16:45:19 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:20 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331" returned: 0 in 0.384s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.1d908701-c375-4ae9-ae4d-c19f9622e692 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:20 devstack sudo[96877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.1d908701-c375-4ae9-ae4d-c19f9622e692 Sep 10 16:45:20 devstack sudo[96877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:20 devstack sudo[96877]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.1d908701-c375-4ae9-ae4d-c19f9622e692" returned: 0 in 0.398s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.1d908701-c375-4ae9-ae4d-c19f9622e692 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:20 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.1d908701-c375-4ae9-ae4d-c19f9622e692 Sep 10 16:45:20 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:20 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.1d908701-c375-4ae9-ae4d-c19f9622e692" returned: 0 in 0.263s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.933db868-bf6e-4280-8022-ad4bbdab784c -F qcow2 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:20 devstack sudo[96885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.933db868-bf6e-4280-8022-ad4bbdab784c -F qcow2 Sep 10 16:45:20 devstack sudo[96885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:21 devstack sudo[96885]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.933db868-bf6e-4280-8022-ad4bbdab784c -F qcow2" returned: 0 in 0.334s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Lock "cinder-quobyte-1d908701-c375-4ae9-ae4d-c19f9622e692" released by "_delete_snapshot" :: held 3.222s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:45:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Lock "cinder-quobyte-30e4e7da-b2e4-4e87-ad84-f05cd5e23331" released by "delete_snapshot" :: held 3.250s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:45:21 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Created reservations ['f3d08e0b-c3db-472c-9b12-9b302a649f69', '549b46d7-c33d-4e35-8647-cc9ff2e3771c', '4ff7b631-196f-4e41-a3c9-cf0293e66d47', '383d5ca9-03b8-4e23-9955-78de2390332a'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:45:21 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Delete snapshot completed successfully. Sep 10 16:45:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Lock "cinder-1d908701-c375-4ae9-ae4d-c19f9622e692-delete_snapshot" released by "delete_snapshot" :: held 3.415s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:45:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Acquiring lock "cinder-933db868-bf6e-4280-8022-ad4bbdab784c-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:45:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Lock "cinder-933db868-bf6e-4280-8022-ad4bbdab784c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:45:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Acquiring lock "cinder-quobyte-30e4e7da-b2e4-4e87-ad84-f05cd5e23331" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:45:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Lock "cinder-quobyte-30e4e7da-b2e4-4e87-ad84-f05cd5e23331" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:45:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Acquiring lock "cinder-quobyte-933db868-bf6e-4280-8022-ad4bbdab784c" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:45:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Lock "cinder-quobyte-933db868-bf6e-4280-8022-ad4bbdab784c" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:45:21 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Deleting offline snapshot 933db868-bf6e-4280-8022-ad4bbdab784c of volume 30e4e7da-b2e4-4e87-ad84-f05cd5e23331 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:45:21 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] snapshot_file for this snap is: volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.933db868-bf6e-4280-8022-ad4bbdab784c {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:45:21 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd25c54b-0bd3-4b66-bb22-6dcf6fbf927d]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:45:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.933db868-bf6e-4280-8022-ad4bbdab784c {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:21 devstack sudo[96890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.933db868-bf6e-4280-8022-ad4bbdab784c Sep 10 16:45:21 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:21 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.933db868-bf6e-4280-8022-ad4bbdab784c" returned: 0 in 0.447s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:22 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:45:22 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad08fed-3fa8-408b-b19d-bb0cdfab26cf]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:45:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:22 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-21b24c61-ab71-41d1-874f-4b1d62e58a9f tempest-VolumesListAdminTestJSON-864816612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:45:22 devstack sudo[96895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331 Sep 10 16:45:22 devstack sudo[96895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:22 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-21b24c61-ab71-41d1-874f-4b1d62e58a9f tempest-VolumesListAdminTestJSON-864816612 None] Flow 'volume_create_manager' (f70ed84f-ac1f-42ce-994f-78df569cf2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:45:22 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-21b24c61-ab71-41d1-874f-4b1d62e58a9f tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e07c7ebb-7c81-44b8-a61b-c1a3ae3dd15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:22 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-21b24c61-ab71-41d1-874f-4b1d62e58a9f tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e07c7ebb-7c81-44b8-a61b-c1a3ae3dd15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1022104653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c496fc6c-64f4-4bb0-9e60-2d68f5571ed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac0d4b71d5204a858fa28d1aa4636e85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:45:22Z,use_quota=True,user_id='4e783b52c3eb45c5ac0dd1b5d14312c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:22 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-21b24c61-ab71-41d1-874f-4b1d62e58a9f tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2e01fc2-6c20-462d-abaf-3653e8d34f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:22 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-21b24c61-ab71-41d1-874f-4b1d62e58a9f tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2e01fc2-6c20-462d-abaf-3653e8d34f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:22 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-21b24c61-ab71-41d1-874f-4b1d62e58a9f tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7577e897-7f47-41de-83de-5c957d4bfc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:22 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-21b24c61-ab71-41d1-874f-4b1d62e58a9f tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7577e897-7f47-41de-83de-5c957d4bfc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c496fc6c-64f4-4bb0-9e60-2d68f5571ed7', 'volume_name': 'volume-c496fc6c-64f4-4bb0-9e60-2d68f5571ed7', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:22 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-21b24c61-ab71-41d1-874f-4b1d62e58a9f tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85af711b-44e8-48da-abe3-efb9048e8193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:22 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-21b24c61-ab71-41d1-874f-4b1d62e58a9f tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85af711b-44e8-48da-abe3-efb9048e8193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:22 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-21b24c61-ab71-41d1-874f-4b1d62e58a9f tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c43bfd5a-bc0e-48f9-99ee-274d719ed912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:22 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-21b24c61-ab71-41d1-874f-4b1d62e58a9f tempest-VolumesListAdminTestJSON-864816612 None] Volume c496fc6c-64f4-4bb0-9e60-2d68f5571ed7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c496fc6c-64f4-4bb0-9e60-2d68f5571ed7', 'volume_size': 1} Sep 10 16:45:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-21b24c61-ab71-41d1-874f-4b1d62e58a9f tempest-VolumesListAdminTestJSON-864816612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-21b24c61-ab71-41d1-874f-4b1d62e58a9f tempest-VolumesListAdminTestJSON-864816612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:22 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-21b24c61-ab71-41d1-874f-4b1d62e58a9f tempest-VolumesListAdminTestJSON-864816612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1022104653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c496fc6c-64f4-4bb0-9e60-2d68f5571ed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac0d4b71d5204a858fa28d1aa4636e85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:45:22Z,use_quota=True,user_id='4e783b52c3eb45c5ac0dd1b5d14312c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:45:22 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-21b24c61-ab71-41d1-874f-4b1d62e58a9f tempest-VolumesListAdminTestJSON-864816612 None] Creating volume c496fc6c-64f4-4bb0-9e60-2d68f5571ed7 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:45:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-21b24c61-ab71-41d1-874f-4b1d62e58a9f tempest-VolumesListAdminTestJSON-864816612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-21b24c61-ab71-41d1-874f-4b1d62e58a9f tempest-VolumesListAdminTestJSON-864816612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:22 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-21b24c61-ab71-41d1-874f-4b1d62e58a9f tempest-VolumesListAdminTestJSON-864816612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:45:22 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-21b24c61-ab71-41d1-874f-4b1d62e58a9f tempest-VolumesListAdminTestJSON-864816612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:45:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-21b24c61-ab71-41d1-874f-4b1d62e58a9f tempest-VolumesListAdminTestJSON-864816612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:22 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-21b24c61-ab71-41d1-874f-4b1d62e58a9f tempest-VolumesListAdminTestJSON-864816612 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:45:22 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-21b24c61-ab71-41d1-874f-4b1d62e58a9f tempest-VolumesListAdminTestJSON-864816612 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:45:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-21b24c61-ab71-41d1-874f-4b1d62e58a9f tempest-VolumesListAdminTestJSON-864816612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c496fc6c-64f4-4bb0-9e60-2d68f5571ed7 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:22 devstack sudo[96897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c496fc6c-64f4-4bb0-9e60-2d68f5571ed7 1073741824 Sep 10 16:45:22 devstack sudo[96897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:22 devstack sudo[96895]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331" returned: 0 in 0.378s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.933db868-bf6e-4280-8022-ad4bbdab784c {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:22 devstack sudo[96902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.933db868-bf6e-4280-8022-ad4bbdab784c Sep 10 16:45:22 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:22 devstack sudo[96897]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-21b24c61-ab71-41d1-874f-4b1d62e58a9f tempest-VolumesListAdminTestJSON-864816612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c496fc6c-64f4-4bb0-9e60-2d68f5571ed7 1073741824" returned: 0 in 0.442s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-21b24c61-ab71-41d1-874f-4b1d62e58a9f tempest-VolumesListAdminTestJSON-864816612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c496fc6c-64f4-4bb0-9e60-2d68f5571ed7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:22 devstack sudo[96910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c496fc6c-64f4-4bb0-9e60-2d68f5571ed7 Sep 10 16:45:22 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:22 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.933db868-bf6e-4280-8022-ad4bbdab784c" returned: 0 in 0.374s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.933db868-bf6e-4280-8022-ad4bbdab784c {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:22 devstack sudo[96912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.933db868-bf6e-4280-8022-ad4bbdab784c Sep 10 16:45:22 devstack sudo[96912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:23 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-21b24c61-ab71-41d1-874f-4b1d62e58a9f tempest-VolumesListAdminTestJSON-864816612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c496fc6c-64f4-4bb0-9e60-2d68f5571ed7" returned: 0 in 0.253s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:23 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-21b24c61-ab71-41d1-874f-4b1d62e58a9f tempest-VolumesListAdminTestJSON-864816612 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:45:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-21b24c61-ab71-41d1-874f-4b1d62e58a9f tempest-VolumesListAdminTestJSON-864816612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-21b24c61-ab71-41d1-874f-4b1d62e58a9f tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c43bfd5a-bc0e-48f9-99ee-274d719ed912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c496fc6c-64f4-4bb0-9e60-2d68f5571ed7', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-21b24c61-ab71-41d1-874f-4b1d62e58a9f tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e79e4971-4d03-492f-bf8c-a034fa9a2af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:23 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-21b24c61-ab71-41d1-874f-4b1d62e58a9f tempest-VolumesListAdminTestJSON-864816612 None] Volume volume-c496fc6c-64f4-4bb0-9e60-2d68f5571ed7 (c496fc6c-64f4-4bb0-9e60-2d68f5571ed7): created successfully Sep 10 16:45:23 devstack sudo[96912]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-21b24c61-ab71-41d1-874f-4b1d62e58a9f tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e79e4971-4d03-492f-bf8c-a034fa9a2af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-21b24c61-ab71-41d1-874f-4b1d62e58a9f tempest-VolumesListAdminTestJSON-864816612 None] Flow 'volume_create_manager' (f70ed84f-ac1f-42ce-994f-78df569cf2b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:45:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331.933db868-bf6e-4280-8022-ad4bbdab784c" returned: 0 in 0.303s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:23 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Lock "cinder-quobyte-933db868-bf6e-4280-8022-ad4bbdab784c" released by "_delete_snapshot" :: held 1.641s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:45:23 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-21b24c61-ab71-41d1-874f-4b1d62e58a9f tempest-VolumesListAdminTestJSON-864816612 None] Created volume successfully. Sep 10 16:45:23 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Lock "cinder-quobyte-30e4e7da-b2e4-4e87-ad84-f05cd5e23331" released by "delete_snapshot" :: held 1.682s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:45:23 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Created reservations ['bc3d364d-2db0-4c41-b52d-0f6a58cd91e1', '66294cb8-19cb-4c22-b01f-57e0bee4ccdd', 'e5b94f95-c530-4084-bb0d-eee2b84a660f', '9e1f032e-7ab4-40f1-be8b-908433a51b3b'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:45:23 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Delete snapshot completed successfully. Sep 10 16:45:23 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Lock "cinder-933db868-bf6e-4280-8022-ad4bbdab784c-delete_snapshot" released by "delete_snapshot" :: held 1.853s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:45:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Snapshots deleted, issuing volume delete {{(pid=88189) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 10 16:45:23 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Acquiring lock "cinder-quobyte-30e4e7da-b2e4-4e87-ad84-f05cd5e23331" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:45:23 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Lock "cinder-quobyte-30e4e7da-b2e4-4e87-ad84-f05cd5e23331" acquired by "delete_volume" :: waited 0.017s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:45:23 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[467c8da1-1da4-4dbc-9591-12b77dab53a8]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:45:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:23 devstack sudo[96918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331 Sep 10 16:45:23 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:23 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331" returned: 0 in 0.407s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:23 devstack sudo[96930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331 Sep 10 16:45:23 devstack sudo[96930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:24 devstack sudo[96930]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-30e4e7da-b2e4-4e87-ad84-f05cd5e23331" returned: 0 in 0.387s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:24 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Lock "cinder-quobyte-30e4e7da-b2e4-4e87-ad84-f05cd5e23331" released by "delete_volume" :: held 0.891s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:45:24 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Created reservations ['d76e0b2f-133c-44e4-9aa5-ce8ae592d7ce', '5b217f12-3e2a-43a9-a509-b77bb8eecb40', 'c46badb0-4d0f-48f4-a76e-8f572bbac5a8', '99982aaf-6606-4013-be78-0e2bbace8ade'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:45:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:24 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:45:24 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:45:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:24 devstack sudo[96958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:45:24 devstack sudo[96958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:24 devstack sudo[96958]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.490s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:24 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:45:24 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Deleted volume successfully. Sep 10 16:45:24 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6ed9d7ad-c17e-4899-a8e8-2a75603a4b9c tempest-VolumesDeleteCascade-1099800671 None] Lock "cinder-30e4e7da-b2e4-4e87-ad84-f05cd5e23331-delete_volume" released by "delete_volume" :: held 7.041s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:45:25 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7318435-f4cd-46b7-92e3-30448b7a3fbc tempest-VolumesListAdminTestJSON-864816612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:45:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e7318435-f4cd-46b7-92e3-30448b7a3fbc tempest-VolumesListAdminTestJSON-864816612 None] Flow 'volume_create_manager' (af91a6c4-4146-4899-8af9-885a43e2ac48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:45:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e7318435-f4cd-46b7-92e3-30448b7a3fbc tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (123b7178-dbe7-426c-a355-44e689899006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e7318435-f4cd-46b7-92e3-30448b7a3fbc tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (123b7178-dbe7-426c-a355-44e689899006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1565108772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d64d0b-1698-4919-9930-e5755354d53b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac0d4b71d5204a858fa28d1aa4636e85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:45:25Z,use_quota=True,user_id='4e783b52c3eb45c5ac0dd1b5d14312c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e7318435-f4cd-46b7-92e3-30448b7a3fbc tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48707a46-a924-423e-84c5-1f108de93061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e7318435-f4cd-46b7-92e3-30448b7a3fbc tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48707a46-a924-423e-84c5-1f108de93061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e7318435-f4cd-46b7-92e3-30448b7a3fbc tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77709677-5e37-4473-9b39-42d9eec4a40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e7318435-f4cd-46b7-92e3-30448b7a3fbc tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77709677-5e37-4473-9b39-42d9eec4a40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4d64d0b-1698-4919-9930-e5755354d53b', 'volume_name': 'volume-f4d64d0b-1698-4919-9930-e5755354d53b', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e7318435-f4cd-46b7-92e3-30448b7a3fbc tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f28094-d7c2-4836-84dd-5d6433f4d2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e7318435-f4cd-46b7-92e3-30448b7a3fbc tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f28094-d7c2-4836-84dd-5d6433f4d2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e7318435-f4cd-46b7-92e3-30448b7a3fbc tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (695c568e-0c96-4099-b8ec-535582163d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:25 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-e7318435-f4cd-46b7-92e3-30448b7a3fbc tempest-VolumesListAdminTestJSON-864816612 None] Volume f4d64d0b-1698-4919-9930-e5755354d53b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4d64d0b-1698-4919-9930-e5755354d53b', 'volume_size': 1} Sep 10 16:45:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e7318435-f4cd-46b7-92e3-30448b7a3fbc tempest-VolumesListAdminTestJSON-864816612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e7318435-f4cd-46b7-92e3-30448b7a3fbc tempest-VolumesListAdminTestJSON-864816612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-e7318435-f4cd-46b7-92e3-30448b7a3fbc tempest-VolumesListAdminTestJSON-864816612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1565108772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d64d0b-1698-4919-9930-e5755354d53b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac0d4b71d5204a858fa28d1aa4636e85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:45:25Z,use_quota=True,user_id='4e783b52c3eb45c5ac0dd1b5d14312c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:45:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-e7318435-f4cd-46b7-92e3-30448b7a3fbc tempest-VolumesListAdminTestJSON-864816612 None] Creating volume f4d64d0b-1698-4919-9930-e5755354d53b {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:45:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e7318435-f4cd-46b7-92e3-30448b7a3fbc tempest-VolumesListAdminTestJSON-864816612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e7318435-f4cd-46b7-92e3-30448b7a3fbc tempest-VolumesListAdminTestJSON-864816612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-e7318435-f4cd-46b7-92e3-30448b7a3fbc tempest-VolumesListAdminTestJSON-864816612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:45:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-e7318435-f4cd-46b7-92e3-30448b7a3fbc tempest-VolumesListAdminTestJSON-864816612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:45:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e7318435-f4cd-46b7-92e3-30448b7a3fbc tempest-VolumesListAdminTestJSON-864816612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-e7318435-f4cd-46b7-92e3-30448b7a3fbc tempest-VolumesListAdminTestJSON-864816612 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:45:25 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-e7318435-f4cd-46b7-92e3-30448b7a3fbc tempest-VolumesListAdminTestJSON-864816612 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:45:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e7318435-f4cd-46b7-92e3-30448b7a3fbc tempest-VolumesListAdminTestJSON-864816612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f4d64d0b-1698-4919-9930-e5755354d53b 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:25 devstack sudo[96963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f4d64d0b-1698-4919-9930-e5755354d53b 1073741824 Sep 10 16:45:25 devstack sudo[96963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:26 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-1609ec55-b2c8-4609-a041-0abc18fdae61 tempest-VolumesDeleteCascade-1099800671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:45:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1609ec55-b2c8-4609-a041-0abc18fdae61 tempest-VolumesDeleteCascade-1099800671 None] Flow 'volume_create_manager' (44ac3d04-88df-4008-b0c0-110aceccc8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:45:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1609ec55-b2c8-4609-a041-0abc18fdae61 tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b9d199-3def-4bfa-bb4f-9ca91e34a085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:26 devstack sudo[96963]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1609ec55-b2c8-4609-a041-0abc18fdae61 tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b9d199-3def-4bfa-bb4f-9ca91e34a085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1035047434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf9686e8-639e-4c60-9cab-a0d45932e814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a9dc0577234cd091a2f18f666e93b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:45:26Z,use_quota=True,user_id='d068ac13698c46d1b43bbe300fd5a814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1609ec55-b2c8-4609-a041-0abc18fdae61 tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (690b48df-022b-413e-b6da-369e98754493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1609ec55-b2c8-4609-a041-0abc18fdae61 tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (690b48df-022b-413e-b6da-369e98754493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1609ec55-b2c8-4609-a041-0abc18fdae61 tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a35b85-214b-4418-b776-b359df6fb01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1609ec55-b2c8-4609-a041-0abc18fdae61 tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a35b85-214b-4418-b776-b359df6fb01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf9686e8-639e-4c60-9cab-a0d45932e814', 'volume_name': 'volume-bf9686e8-639e-4c60-9cab-a0d45932e814', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1609ec55-b2c8-4609-a041-0abc18fdae61 tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e0e6df-15d4-4819-93a2-345c1f363d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1609ec55-b2c8-4609-a041-0abc18fdae61 tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e0e6df-15d4-4819-93a2-345c1f363d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1609ec55-b2c8-4609-a041-0abc18fdae61 tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cef8b7f-0af3-4654-a859-9e445b4cf75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:26 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-1609ec55-b2c8-4609-a041-0abc18fdae61 tempest-VolumesDeleteCascade-1099800671 None] Volume bf9686e8-639e-4c60-9cab-a0d45932e814: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf9686e8-639e-4c60-9cab-a0d45932e814', 'volume_size': 1} Sep 10 16:45:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-1609ec55-b2c8-4609-a041-0abc18fdae61 tempest-VolumesDeleteCascade-1099800671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e7318435-f4cd-46b7-92e3-30448b7a3fbc tempest-VolumesListAdminTestJSON-864816612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f4d64d0b-1698-4919-9930-e5755354d53b 1073741824" returned: 0 in 0.806s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e7318435-f4cd-46b7-92e3-30448b7a3fbc tempest-VolumesListAdminTestJSON-864816612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f4d64d0b-1698-4919-9930-e5755354d53b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:26 devstack sudo[96970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f4d64d0b-1698-4919-9930-e5755354d53b Sep 10 16:45:26 devstack sudo[96970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:26 devstack sudo[96970]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e7318435-f4cd-46b7-92e3-30448b7a3fbc tempest-VolumesListAdminTestJSON-864816612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f4d64d0b-1698-4919-9930-e5755354d53b" returned: 0 in 0.337s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-e7318435-f4cd-46b7-92e3-30448b7a3fbc tempest-VolumesListAdminTestJSON-864816612 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:45:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e7318435-f4cd-46b7-92e3-30448b7a3fbc tempest-VolumesListAdminTestJSON-864816612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-1609ec55-b2c8-4609-a041-0abc18fdae61 tempest-VolumesDeleteCascade-1099800671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.397s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-1609ec55-b2c8-4609-a041-0abc18fdae61 tempest-VolumesDeleteCascade-1099800671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1035047434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf9686e8-639e-4c60-9cab-a0d45932e814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a9dc0577234cd091a2f18f666e93b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:45:26Z,use_quota=True,user_id='d068ac13698c46d1b43bbe300fd5a814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:45:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-1609ec55-b2c8-4609-a041-0abc18fdae61 tempest-VolumesDeleteCascade-1099800671 None] Creating volume bf9686e8-639e-4c60-9cab-a0d45932e814 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:45:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-1609ec55-b2c8-4609-a041-0abc18fdae61 tempest-VolumesDeleteCascade-1099800671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-1609ec55-b2c8-4609-a041-0abc18fdae61 tempest-VolumesDeleteCascade-1099800671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-1609ec55-b2c8-4609-a041-0abc18fdae61 tempest-VolumesDeleteCascade-1099800671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:45:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-1609ec55-b2c8-4609-a041-0abc18fdae61 tempest-VolumesDeleteCascade-1099800671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:45:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-1609ec55-b2c8-4609-a041-0abc18fdae61 tempest-VolumesDeleteCascade-1099800671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-1609ec55-b2c8-4609-a041-0abc18fdae61 tempest-VolumesDeleteCascade-1099800671 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:45:26 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-1609ec55-b2c8-4609-a041-0abc18fdae61 tempest-VolumesDeleteCascade-1099800671 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:45:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1609ec55-b2c8-4609-a041-0abc18fdae61 tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:26 devstack sudo[96973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814 1073741824 Sep 10 16:45:26 devstack sudo[96973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e7318435-f4cd-46b7-92e3-30448b7a3fbc tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (695c568e-0c96-4099-b8ec-535582163d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4d64d0b-1698-4919-9930-e5755354d53b', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e7318435-f4cd-46b7-92e3-30448b7a3fbc tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91610aac-0f71-450a-9ee5-786f304332e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:26 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-e7318435-f4cd-46b7-92e3-30448b7a3fbc tempest-VolumesListAdminTestJSON-864816612 None] Volume volume-f4d64d0b-1698-4919-9930-e5755354d53b (f4d64d0b-1698-4919-9930-e5755354d53b): created successfully Sep 10 16:45:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e7318435-f4cd-46b7-92e3-30448b7a3fbc tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91610aac-0f71-450a-9ee5-786f304332e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e7318435-f4cd-46b7-92e3-30448b7a3fbc tempest-VolumesListAdminTestJSON-864816612 None] Flow 'volume_create_manager' (af91a6c4-4146-4899-8af9-885a43e2ac48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:45:26 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-e7318435-f4cd-46b7-92e3-30448b7a3fbc tempest-VolumesListAdminTestJSON-864816612 None] Created volume successfully. Sep 10 16:45:27 devstack sudo[96973]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1609ec55-b2c8-4609-a041-0abc18fdae61 tempest-VolumesDeleteCascade-1099800671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814 1073741824" returned: 0 in 0.535s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1609ec55-b2c8-4609-a041-0abc18fdae61 tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:27 devstack sudo[96978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814 Sep 10 16:45:27 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:27 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1609ec55-b2c8-4609-a041-0abc18fdae61 tempest-VolumesDeleteCascade-1099800671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814" returned: 0 in 0.315s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-1609ec55-b2c8-4609-a041-0abc18fdae61 tempest-VolumesDeleteCascade-1099800671 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:45:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-1609ec55-b2c8-4609-a041-0abc18fdae61 tempest-VolumesDeleteCascade-1099800671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1609ec55-b2c8-4609-a041-0abc18fdae61 tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cef8b7f-0af3-4654-a859-9e445b4cf75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf9686e8-639e-4c60-9cab-a0d45932e814', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1609ec55-b2c8-4609-a041-0abc18fdae61 tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4297b15b-8a41-4563-997d-4c500b738e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:27 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-1609ec55-b2c8-4609-a041-0abc18fdae61 tempest-VolumesDeleteCascade-1099800671 None] Volume volume-bf9686e8-639e-4c60-9cab-a0d45932e814 (bf9686e8-639e-4c60-9cab-a0d45932e814): created successfully Sep 10 16:45:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1609ec55-b2c8-4609-a041-0abc18fdae61 tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4297b15b-8a41-4563-997d-4c500b738e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1609ec55-b2c8-4609-a041-0abc18fdae61 tempest-VolumesDeleteCascade-1099800671 None] Flow 'volume_create_manager' (44ac3d04-88df-4008-b0c0-110aceccc8df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:45:27 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-1609ec55-b2c8-4609-a041-0abc18fdae61 tempest-VolumesDeleteCascade-1099800671 None] Created volume successfully. Sep 10 16:45:27 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea2cf2a7-6f88-4760-b743-b7b53e8ecfa4 tempest-VolumesListAdminTestJSON-864816612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:45:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ea2cf2a7-6f88-4760-b743-b7b53e8ecfa4 tempest-VolumesListAdminTestJSON-864816612 None] Flow 'volume_create_manager' (0a390226-458f-400c-88fb-77696e9ddf46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:45:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ea2cf2a7-6f88-4760-b743-b7b53e8ecfa4 tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bbc043f-987c-41ce-aa2b-0e2125b1a476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ea2cf2a7-6f88-4760-b743-b7b53e8ecfa4 tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bbc043f-987c-41ce-aa2b-0e2125b1a476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-156567648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d802485-4b4c-40ff-b6be-f9403f4fcb67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac0d4b71d5204a858fa28d1aa4636e85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:45:28Z,use_quota=True,user_id='4e783b52c3eb45c5ac0dd1b5d14312c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ea2cf2a7-6f88-4760-b743-b7b53e8ecfa4 tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (573ea7f9-3320-49e6-a110-5ecb7f590e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ea2cf2a7-6f88-4760-b743-b7b53e8ecfa4 tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (573ea7f9-3320-49e6-a110-5ecb7f590e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ea2cf2a7-6f88-4760-b743-b7b53e8ecfa4 tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2549db3-e93d-49df-9213-ba45ffdba82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ea2cf2a7-6f88-4760-b743-b7b53e8ecfa4 tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2549db3-e93d-49df-9213-ba45ffdba82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d802485-4b4c-40ff-b6be-f9403f4fcb67', 'volume_name': 'volume-1d802485-4b4c-40ff-b6be-f9403f4fcb67', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ea2cf2a7-6f88-4760-b743-b7b53e8ecfa4 tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1181cfd4-ff10-481e-9e2c-4a65e99f6455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ea2cf2a7-6f88-4760-b743-b7b53e8ecfa4 tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1181cfd4-ff10-481e-9e2c-4a65e99f6455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ea2cf2a7-6f88-4760-b743-b7b53e8ecfa4 tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f08c11-738c-403f-ad9c-d14e4575d67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:27 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-ea2cf2a7-6f88-4760-b743-b7b53e8ecfa4 tempest-VolumesListAdminTestJSON-864816612 None] Volume 1d802485-4b4c-40ff-b6be-f9403f4fcb67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d802485-4b4c-40ff-b6be-f9403f4fcb67', 'volume_size': 1} Sep 10 16:45:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ea2cf2a7-6f88-4760-b743-b7b53e8ecfa4 tempest-VolumesListAdminTestJSON-864816612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ea2cf2a7-6f88-4760-b743-b7b53e8ecfa4 tempest-VolumesListAdminTestJSON-864816612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ea2cf2a7-6f88-4760-b743-b7b53e8ecfa4 tempest-VolumesListAdminTestJSON-864816612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-156567648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d802485-4b4c-40ff-b6be-f9403f4fcb67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac0d4b71d5204a858fa28d1aa4636e85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:45:28Z,use_quota=True,user_id='4e783b52c3eb45c5ac0dd1b5d14312c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:45:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-ea2cf2a7-6f88-4760-b743-b7b53e8ecfa4 tempest-VolumesListAdminTestJSON-864816612 None] Creating volume 1d802485-4b4c-40ff-b6be-f9403f4fcb67 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:45:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ea2cf2a7-6f88-4760-b743-b7b53e8ecfa4 tempest-VolumesListAdminTestJSON-864816612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ea2cf2a7-6f88-4760-b743-b7b53e8ecfa4 tempest-VolumesListAdminTestJSON-864816612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ea2cf2a7-6f88-4760-b743-b7b53e8ecfa4 tempest-VolumesListAdminTestJSON-864816612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:45:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ea2cf2a7-6f88-4760-b743-b7b53e8ecfa4 tempest-VolumesListAdminTestJSON-864816612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:45:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ea2cf2a7-6f88-4760-b743-b7b53e8ecfa4 tempest-VolumesListAdminTestJSON-864816612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ea2cf2a7-6f88-4760-b743-b7b53e8ecfa4 tempest-VolumesListAdminTestJSON-864816612 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:45:27 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-ea2cf2a7-6f88-4760-b743-b7b53e8ecfa4 tempest-VolumesListAdminTestJSON-864816612 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:45:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ea2cf2a7-6f88-4760-b743-b7b53e8ecfa4 tempest-VolumesListAdminTestJSON-864816612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1d802485-4b4c-40ff-b6be-f9403f4fcb67 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:28 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1d802485-4b4c-40ff-b6be-f9403f4fcb67 1073741824 Sep 10 16:45:28 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4f7f649d-8753-4450-a27a-e4e51b6a3cb4 tempest-VolumesDeleteCascade-1099800671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:28 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-c1f7c3ba-bb58-4691-ac59-3ecd15f1e940 req-042954b1-fc24-495f-a055-eb425ed5624b tempest-AttachVolumeNegativeTest-74284645 None] Terminate volume connection completed successfully. Sep 10 16:45:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-c1f7c3ba-bb58-4691-ac59-3ecd15f1e940 req-042954b1-fc24-495f-a055-eb425ed5624b tempest-AttachVolumeNegativeTest-74284645 None] Deleting attachment e2d790e0-2a4b-4c1c-8da8-6f8e71056a2b. {{(pid=88189) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 16:45:28 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ea2cf2a7-6f88-4760-b743-b7b53e8ecfa4 tempest-VolumesListAdminTestJSON-864816612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1d802485-4b4c-40ff-b6be-f9403f4fcb67 1073741824" returned: 0 in 0.616s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ea2cf2a7-6f88-4760-b743-b7b53e8ecfa4 tempest-VolumesListAdminTestJSON-864816612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1d802485-4b4c-40ff-b6be-f9403f4fcb67 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:28 devstack sudo[96992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1d802485-4b4c-40ff-b6be-f9403f4fcb67 Sep 10 16:45:28 devstack sudo[96992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:28 devstack sudo[96992]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ea2cf2a7-6f88-4760-b743-b7b53e8ecfa4 tempest-VolumesListAdminTestJSON-864816612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1d802485-4b4c-40ff-b6be-f9403f4fcb67" returned: 0 in 0.263s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:28 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ea2cf2a7-6f88-4760-b743-b7b53e8ecfa4 tempest-VolumesListAdminTestJSON-864816612 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:45:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ea2cf2a7-6f88-4760-b743-b7b53e8ecfa4 tempest-VolumesListAdminTestJSON-864816612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4f7f649d-8753-4450-a27a-e4e51b6a3cb4 tempest-VolumesDeleteCascade-1099800671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.603s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ea2cf2a7-6f88-4760-b743-b7b53e8ecfa4 tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f08c11-738c-403f-ad9c-d14e4575d67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d802485-4b4c-40ff-b6be-f9403f4fcb67', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ea2cf2a7-6f88-4760-b743-b7b53e8ecfa4 tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e1c8a6-bfd3-423e-8c1b-8f71d19880f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:28 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-4f7f649d-8753-4450-a27a-e4e51b6a3cb4 tempest-VolumesDeleteCascade-1099800671 None] Creating offline snapshot 957bc6ac-b403-40d4-8edb-3454600b6d4d of volume bf9686e8-639e-4c60-9cab-a0d45932e814 {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:45:28 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-ea2cf2a7-6f88-4760-b743-b7b53e8ecfa4 tempest-VolumesListAdminTestJSON-864816612 None] Volume volume-1d802485-4b4c-40ff-b6be-f9403f4fcb67 (1d802485-4b4c-40ff-b6be-f9403f4fcb67): created successfully Sep 10 16:45:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ea2cf2a7-6f88-4760-b743-b7b53e8ecfa4 tempest-VolumesListAdminTestJSON-864816612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e1c8a6-bfd3-423e-8c1b-8f71d19880f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ea2cf2a7-6f88-4760-b743-b7b53e8ecfa4 tempest-VolumesListAdminTestJSON-864816612 None] Flow 'volume_create_manager' (0a390226-458f-400c-88fb-77696e9ddf46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:45:28 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5dfee5-cac1-4ec6-b46d-9c391b75fc2e]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:45:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4f7f649d-8753-4450-a27a-e4e51b6a3cb4 tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:29 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-ea2cf2a7-6f88-4760-b743-b7b53e8ecfa4 tempest-VolumesListAdminTestJSON-864816612 None] Created volume successfully. Sep 10 16:45:29 devstack sudo[96995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814 Sep 10 16:45:29 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:29 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4f7f649d-8753-4450-a27a-e4e51b6a3cb4 tempest-VolumesDeleteCascade-1099800671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814" returned: 0 in 0.411s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4f7f649d-8753-4450-a27a-e4e51b6a3cb4 tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814.957bc6ac-b403-40d4-8edb-3454600b6d4d 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:29 devstack sudo[97001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814.957bc6ac-b403-40d4-8edb-3454600b6d4d 1G Sep 10 16:45:29 devstack sudo[97001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:30 devstack sudo[97001]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4f7f649d-8753-4450-a27a-e4e51b6a3cb4 tempest-VolumesDeleteCascade-1099800671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814.957bc6ac-b403-40d4-8edb-3454600b6d4d 1G" returned: 0 in 0.682s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4f7f649d-8753-4450-a27a-e4e51b6a3cb4 tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf9686e8-639e-4c60-9cab-a0d45932e814 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814.957bc6ac-b403-40d4-8edb-3454600b6d4d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:30 devstack sudo[97031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf9686e8-639e-4c60-9cab-a0d45932e814 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814.957bc6ac-b403-40d4-8edb-3454600b6d4d Sep 10 16:45:30 devstack sudo[97031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:30 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-da3a8e9c-d779-460e-acac-14b24fd95369 tempest-AttachVolumeTestJSON-265770916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:45:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-da3a8e9c-d779-460e-acac-14b24fd95369 tempest-AttachVolumeTestJSON-265770916 None] Flow 'volume_create_manager' (d5a6aae8-2d94-4076-8820-866e7eb6d617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:45:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-da3a8e9c-d779-460e-acac-14b24fd95369 tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e8b202-91c3-4210-a21a-3903123e50e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:30 devstack sudo[97031]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4f7f649d-8753-4450-a27a-e4e51b6a3cb4 tempest-VolumesDeleteCascade-1099800671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf9686e8-639e-4c60-9cab-a0d45932e814 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814.957bc6ac-b403-40d4-8edb-3454600b6d4d" returned: 0 in 0.504s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:30 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-4f7f649d-8753-4450-a27a-e4e51b6a3cb4 tempest-VolumesDeleteCascade-1099800671 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814.957bc6ac-b403-40d4-8edb-3454600b6d4d is being set with open permissions: ugo+rw Sep 10 16:45:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4f7f649d-8753-4450-a27a-e4e51b6a3cb4 tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814.957bc6ac-b403-40d4-8edb-3454600b6d4d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-da3a8e9c-d779-460e-acac-14b24fd95369 tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e8b202-91c3-4210-a21a-3903123e50e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1858659034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=532bc876-ef4c-4fb0-8e7c-3b594c03f881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45796b0a32f14262a3bd880e56ac6b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:45:30Z,use_quota=True,user_id='9e214a2542f344cca207ec605b9b45e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-da3a8e9c-d779-460e-acac-14b24fd95369 tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ec07b2-5207-4fae-a381-ba64e3191201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-da3a8e9c-d779-460e-acac-14b24fd95369 tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ec07b2-5207-4fae-a381-ba64e3191201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:30 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814.957bc6ac-b403-40d4-8edb-3454600b6d4d Sep 10 16:45:30 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-da3a8e9c-d779-460e-acac-14b24fd95369 tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d85c3ef-9e1c-489e-a126-508edd3ed2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-da3a8e9c-d779-460e-acac-14b24fd95369 tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d85c3ef-9e1c-489e-a126-508edd3ed2fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '532bc876-ef4c-4fb0-8e7c-3b594c03f881', 'volume_name': 'volume-532bc876-ef4c-4fb0-8e7c-3b594c03f881', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-da3a8e9c-d779-460e-acac-14b24fd95369 tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2c07e2c-5855-42c5-b988-d759e69c033e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-da3a8e9c-d779-460e-acac-14b24fd95369 tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2c07e2c-5855-42c5-b988-d759e69c033e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-da3a8e9c-d779-460e-acac-14b24fd95369 tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f9bb027-eb03-44b7-bab0-d75f265ef642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:30 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-da3a8e9c-d779-460e-acac-14b24fd95369 tempest-AttachVolumeTestJSON-265770916 None] Volume 532bc876-ef4c-4fb0-8e7c-3b594c03f881: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-532bc876-ef4c-4fb0-8e7c-3b594c03f881', 'volume_size': 1} Sep 10 16:45:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-da3a8e9c-d779-460e-acac-14b24fd95369 tempest-AttachVolumeTestJSON-265770916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:30 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4f7f649d-8753-4450-a27a-e4e51b6a3cb4 tempest-VolumesDeleteCascade-1099800671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814.957bc6ac-b403-40d4-8edb-3454600b6d4d" returned: 0 in 0.384s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4f7f649d-8753-4450-a27a-e4e51b6a3cb4 tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:31 devstack sudo[97040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814.info Sep 10 16:45:31 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:31 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d9c872e-6975-4113-824c-7102b993f0b5 tempest-VolumesListAdminTestJSON-2062899540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:45:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d9c872e-6975-4113-824c-7102b993f0b5 tempest-VolumesListAdminTestJSON-2062899540 None] Flow 'volume_create_manager' (cb12ce06-4886-4521-bea4-82bcd5e974e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:45:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d9c872e-6975-4113-824c-7102b993f0b5 tempest-VolumesListAdminTestJSON-2062899540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f674918-7f76-4b0b-a2ec-3c919cff36e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d9c872e-6975-4113-824c-7102b993f0b5 tempest-VolumesListAdminTestJSON-2062899540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f674918-7f76-4b0b-a2ec-3c919cff36e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5492bd12-55d2-428a-bb00-752cc9171978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ef0403a0a14b90949afb052ca61f19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:45:31Z,use_quota=True,user_id='04fe167496e94e349729b98ad3562d86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d9c872e-6975-4113-824c-7102b993f0b5 tempest-VolumesListAdminTestJSON-2062899540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdcad36f-8da6-4f27-ad21-3269d3d8c6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d9c872e-6975-4113-824c-7102b993f0b5 tempest-VolumesListAdminTestJSON-2062899540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdcad36f-8da6-4f27-ad21-3269d3d8c6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d9c872e-6975-4113-824c-7102b993f0b5 tempest-VolumesListAdminTestJSON-2062899540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cef0d90-22e7-4fe1-8c40-6ba390c18aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d9c872e-6975-4113-824c-7102b993f0b5 tempest-VolumesListAdminTestJSON-2062899540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cef0d90-22e7-4fe1-8c40-6ba390c18aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5492bd12-55d2-428a-bb00-752cc9171978', 'volume_name': 'volume-5492bd12-55d2-428a-bb00-752cc9171978', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d9c872e-6975-4113-824c-7102b993f0b5 tempest-VolumesListAdminTestJSON-2062899540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88572fc9-1742-4ae5-8252-7d4415673a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d9c872e-6975-4113-824c-7102b993f0b5 tempest-VolumesListAdminTestJSON-2062899540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88572fc9-1742-4ae5-8252-7d4415673a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d9c872e-6975-4113-824c-7102b993f0b5 tempest-VolumesListAdminTestJSON-2062899540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (081dbe53-9f87-441c-b396-667880f1258a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:31 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-6d9c872e-6975-4113-824c-7102b993f0b5 tempest-VolumesListAdminTestJSON-2062899540 None] Volume 5492bd12-55d2-428a-bb00-752cc9171978: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5492bd12-55d2-428a-bb00-752cc9171978', 'volume_size': 1} Sep 10 16:45:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6d9c872e-6975-4113-824c-7102b993f0b5 tempest-VolumesListAdminTestJSON-2062899540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:31 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4f7f649d-8753-4450-a27a-e4e51b6a3cb4 tempest-VolumesDeleteCascade-1099800671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814.info" returned: 0 in 0.315s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:31 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-4f7f649d-8753-4450-a27a-e4e51b6a3cb4 tempest-VolumesDeleteCascade-1099800671 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814.info is being set with open permissions: ugo+rw Sep 10 16:45:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4f7f649d-8753-4450-a27a-e4e51b6a3cb4 tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:31 devstack sudo[97044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814.info Sep 10 16:45:31 devstack sudo[97044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:31 devstack sudo[97044]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4f7f649d-8753-4450-a27a-e4e51b6a3cb4 tempest-VolumesDeleteCascade-1099800671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814.info" returned: 0 in 0.272s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4f7f649d-8753-4450-a27a-e4e51b6a3cb4 tempest-VolumesDeleteCascade-1099800671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.714s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-da3a8e9c-d779-460e-acac-14b24fd95369 tempest-AttachVolumeTestJSON-265770916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.962s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:31 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-da3a8e9c-d779-460e-acac-14b24fd95369 tempest-AttachVolumeTestJSON-265770916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1858659034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=532bc876-ef4c-4fb0-8e7c-3b594c03f881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45796b0a32f14262a3bd880e56ac6b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:45:30Z,use_quota=True,user_id='9e214a2542f344cca207ec605b9b45e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:45:31 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-da3a8e9c-d779-460e-acac-14b24fd95369 tempest-AttachVolumeTestJSON-265770916 None] Creating volume 532bc876-ef4c-4fb0-8e7c-3b594c03f881 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:45:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-da3a8e9c-d779-460e-acac-14b24fd95369 tempest-AttachVolumeTestJSON-265770916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-da3a8e9c-d779-460e-acac-14b24fd95369 tempest-AttachVolumeTestJSON-265770916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:31 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-da3a8e9c-d779-460e-acac-14b24fd95369 tempest-AttachVolumeTestJSON-265770916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:45:31 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-da3a8e9c-d779-460e-acac-14b24fd95369 tempest-AttachVolumeTestJSON-265770916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:45:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-da3a8e9c-d779-460e-acac-14b24fd95369 tempest-AttachVolumeTestJSON-265770916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:31 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-da3a8e9c-d779-460e-acac-14b24fd95369 tempest-AttachVolumeTestJSON-265770916 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:45:31 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-da3a8e9c-d779-460e-acac-14b24fd95369 tempest-AttachVolumeTestJSON-265770916 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:45:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-da3a8e9c-d779-460e-acac-14b24fd95369 tempest-AttachVolumeTestJSON-265770916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-532bc876-ef4c-4fb0-8e7c-3b594c03f881 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:31 devstack sudo[97048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-532bc876-ef4c-4fb0-8e7c-3b594c03f881 1073741824 Sep 10 16:45:31 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:31 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-4f7f649d-8753-4450-a27a-e4e51b6a3cb4 tempest-VolumesDeleteCascade-1099800671 None] Create snapshot completed successfully Sep 10 16:45:32 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-da3a8e9c-d779-460e-acac-14b24fd95369 tempest-AttachVolumeTestJSON-265770916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-532bc876-ef4c-4fb0-8e7c-3b594c03f881 1073741824" returned: 0 in 0.544s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-da3a8e9c-d779-460e-acac-14b24fd95369 tempest-AttachVolumeTestJSON-265770916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-532bc876-ef4c-4fb0-8e7c-3b594c03f881 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:32 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-532bc876-ef4c-4fb0-8e7c-3b594c03f881 Sep 10 16:45:32 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:32 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-da3a8e9c-d779-460e-acac-14b24fd95369 tempest-AttachVolumeTestJSON-265770916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-532bc876-ef4c-4fb0-8e7c-3b594c03f881" returned: 0 in 0.252s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-da3a8e9c-d779-460e-acac-14b24fd95369 tempest-AttachVolumeTestJSON-265770916 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:45:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-da3a8e9c-d779-460e-acac-14b24fd95369 tempest-AttachVolumeTestJSON-265770916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6d9c872e-6975-4113-824c-7102b993f0b5 tempest-VolumesListAdminTestJSON-2062899540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.215s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6d9c872e-6975-4113-824c-7102b993f0b5 tempest-VolumesListAdminTestJSON-2062899540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5492bd12-55d2-428a-bb00-752cc9171978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ef0403a0a14b90949afb052ca61f19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:45:31Z,use_quota=True,user_id='04fe167496e94e349729b98ad3562d86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:45:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-6d9c872e-6975-4113-824c-7102b993f0b5 tempest-VolumesListAdminTestJSON-2062899540 None] Creating volume 5492bd12-55d2-428a-bb00-752cc9171978 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:45:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6d9c872e-6975-4113-824c-7102b993f0b5 tempest-VolumesListAdminTestJSON-2062899540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6d9c872e-6975-4113-824c-7102b993f0b5 tempest-VolumesListAdminTestJSON-2062899540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6d9c872e-6975-4113-824c-7102b993f0b5 tempest-VolumesListAdminTestJSON-2062899540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:45:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6d9c872e-6975-4113-824c-7102b993f0b5 tempest-VolumesListAdminTestJSON-2062899540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:45:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6d9c872e-6975-4113-824c-7102b993f0b5 tempest-VolumesListAdminTestJSON-2062899540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6d9c872e-6975-4113-824c-7102b993f0b5 tempest-VolumesListAdminTestJSON-2062899540 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:45:32 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-6d9c872e-6975-4113-824c-7102b993f0b5 tempest-VolumesListAdminTestJSON-2062899540 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:45:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6d9c872e-6975-4113-824c-7102b993f0b5 tempest-VolumesListAdminTestJSON-2062899540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5492bd12-55d2-428a-bb00-752cc9171978 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:32 devstack sudo[97057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5492bd12-55d2-428a-bb00-752cc9171978 1073741824 Sep 10 16:45:32 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-da3a8e9c-d779-460e-acac-14b24fd95369 tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f9bb027-eb03-44b7-bab0-d75f265ef642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-532bc876-ef4c-4fb0-8e7c-3b594c03f881', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-da3a8e9c-d779-460e-acac-14b24fd95369 tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d056a0f-59e9-4b82-a17f-d37e91a8e020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:32 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-da3a8e9c-d779-460e-acac-14b24fd95369 tempest-AttachVolumeTestJSON-265770916 None] Volume volume-532bc876-ef4c-4fb0-8e7c-3b594c03f881 (532bc876-ef4c-4fb0-8e7c-3b594c03f881): created successfully Sep 10 16:45:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-da3a8e9c-d779-460e-acac-14b24fd95369 tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d056a0f-59e9-4b82-a17f-d37e91a8e020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-da3a8e9c-d779-460e-acac-14b24fd95369 tempest-AttachVolumeTestJSON-265770916 None] Flow 'volume_create_manager' (d5a6aae8-2d94-4076-8820-866e7eb6d617) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:45:32 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-da3a8e9c-d779-460e-acac-14b24fd95369 tempest-AttachVolumeTestJSON-265770916 None] Created volume successfully. Sep 10 16:45:33 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6d9c872e-6975-4113-824c-7102b993f0b5 tempest-VolumesListAdminTestJSON-2062899540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5492bd12-55d2-428a-bb00-752cc9171978 1073741824" returned: 0 in 0.507s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6d9c872e-6975-4113-824c-7102b993f0b5 tempest-VolumesListAdminTestJSON-2062899540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5492bd12-55d2-428a-bb00-752cc9171978 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:33 devstack sudo[97063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5492bd12-55d2-428a-bb00-752cc9171978 Sep 10 16:45:33 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Flow 'volume_create_manager' (2e6901dd-7a3b-4e1b-987c-683643624045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0f71fc2-40dd-4447-b1ae-71ef9de65f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0f71fc2-40dd-4447-b1ae-71ef9de65f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-175718014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c030f1a-e5d9-425b-9eab-2c81699ee73b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a9dc0577234cd091a2f18f666e93b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=957bc6ac-b403-40d4-8edb-3454600b6d4d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:45:33Z,use_quota=True,user_id='d068ac13698c46d1b43bbe300fd5a814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f253f9a7-c5d4-4899-b787-fbb143f7ff13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f253f9a7-c5d4-4899-b787-fbb143f7ff13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed97fcb-da31-48e5-8dbd-92d90a0b46b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed97fcb-da31-48e5-8dbd-92d90a0b46b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5c030f1a-e5d9-425b-9eab-2c81699ee73b', 'volume_name': 'volume-5c030f1a-e5d9-425b-9eab-2c81699ee73b', 'volume_size': 1, 'snapshot_id': '957bc6ac-b403-40d4-8edb-3454600b6d4d'}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70af2e4e-289d-4ac6-abf7-0bb60238725b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70af2e4e-289d-4ac6-abf7-0bb60238725b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b66613-d574-4a6e-8860-617a946d223d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:33 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Volume 5c030f1a-e5d9-425b-9eab-2c81699ee73b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5c030f1a-e5d9-425b-9eab-2c81699ee73b', 'volume_size': 1, 'snapshot_id': '957bc6ac-b403-40d4-8edb-3454600b6d4d'} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:33 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6d9c872e-6975-4113-824c-7102b993f0b5 tempest-VolumesListAdminTestJSON-2062899540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5492bd12-55d2-428a-bb00-752cc9171978" returned: 0 in 0.301s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6d9c872e-6975-4113-824c-7102b993f0b5 tempest-VolumesListAdminTestJSON-2062899540 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6d9c872e-6975-4113-824c-7102b993f0b5 tempest-VolumesListAdminTestJSON-2062899540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.076s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Acquiring lock "cinder-quobyte-957bc6ac-b403-40d4-8edb-3454600b6d4d-5c030f1a-e5d9-425b-9eab-2c81699ee73b" by "_create_volume_from_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d9c872e-6975-4113-824c-7102b993f0b5 tempest-VolumesListAdminTestJSON-2062899540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (081dbe53-9f87-441c-b396-667880f1258a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5492bd12-55d2-428a-bb00-752cc9171978', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d9c872e-6975-4113-824c-7102b993f0b5 tempest-VolumesListAdminTestJSON-2062899540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f171637-8fcd-4d5b-81e4-a34822586327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Lock "cinder-quobyte-957bc6ac-b403-40d4-8edb-3454600b6d4d-5c030f1a-e5d9-425b-9eab-2c81699ee73b" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Creating volume 5c030f1a-e5d9-425b-9eab-2c81699ee73b from snapshot 957bc6ac-b403-40d4-8edb-3454600b6d4d {{(pid=88189) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Acquiring lock "cinder-quobyte-5c030f1a-e5d9-425b-9eab-2c81699ee73b" by "_copy_volume_from_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:45:33 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-6d9c872e-6975-4113-824c-7102b993f0b5 tempest-VolumesListAdminTestJSON-2062899540 None] Volume volume-5492bd12-55d2-428a-bb00-752cc9171978 (5492bd12-55d2-428a-bb00-752cc9171978): created successfully Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d9c872e-6975-4113-824c-7102b993f0b5 tempest-VolumesListAdminTestJSON-2062899540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f171637-8fcd-4d5b-81e4-a34822586327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d9c872e-6975-4113-824c-7102b993f0b5 tempest-VolumesListAdminTestJSON-2062899540 None] Flow 'volume_create_manager' (cb12ce06-4886-4521-bea4-82bcd5e974e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Lock "cinder-quobyte-5c030f1a-e5d9-425b-9eab-2c81699ee73b" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] snapshot: 957bc6ac-b403-40d4-8edb-3454600b6d4d, volume: 5c030f1a-e5d9-425b-9eab-2c81699ee73b, {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:33 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-6d9c872e-6975-4113-824c-7102b993f0b5 tempest-VolumesListAdminTestJSON-2062899540 None] Created volume successfully. Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cf0ca8-62a2-4208-aa0d-cd6fd7068943]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814.957bc6ac-b403-40d4-8edb-3454600b6d4d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:33 devstack sudo[97066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814.957bc6ac-b403-40d4-8edb-3454600b6d4d Sep 10 16:45:33 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:33 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814.957bc6ac-b403-40d4-8edb-3454600b6d4d" returned: 0 in 0.449s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf9686e8-639e-4c60-9cab-a0d45932e814(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f3a393-a3b8-422e-b2df-4c09f71523f9]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:45:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:34 devstack sudo[97075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814 Sep 10 16:45:34 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:34 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:34 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-39dce581-b3cf-4b08-a073-bbb358b30bb3 tempest-VolumesListAdminTestJSON-2062899540 None] Acquiring lock "cinder-5492bd12-55d2-428a-bb00-752cc9171978-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:45:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814" returned: 0 in 0.533s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:34 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] will copy from snapshot at /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814 {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 16:45:34 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Creating direct copy from snapshot {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 16:45:34 devstack cinder-volume[88189]: DEBUG cinder.utils [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Path /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5c030f1a-e5d9-425b-9eab-2c81699ee73b not found in is_blk_device check {{(pid=88189) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 16:45:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5c030f1a-e5d9-425b-9eab-2c81699ee73b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:34 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-39dce581-b3cf-4b08-a073-bbb358b30bb3 tempest-VolumesListAdminTestJSON-2062899540 None] Lock "cinder-5492bd12-55d2-428a-bb00-752cc9171978-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:45:34 devstack sudo[97082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5c030f1a-e5d9-425b-9eab-2c81699ee73b Sep 10 16:45:34 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:34 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-39dce581-b3cf-4b08-a073-bbb358b30bb3 tempest-VolumesListAdminTestJSON-2062899540 None] Acquiring lock "cinder-quobyte-5492bd12-55d2-428a-bb00-752cc9171978" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:45:34 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-39dce581-b3cf-4b08-a073-bbb358b30bb3 tempest-VolumesListAdminTestJSON-2062899540 None] Lock "cinder-quobyte-5492bd12-55d2-428a-bb00-752cc9171978" acquired by "delete_volume" :: waited 0.029s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:45:34 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-15c508d3-b81c-4fa6-a621-fda9bc5d94af tempest-VolumesListAdminTestJSON-864816612 None] Acquiring lock "cinder-1d802485-4b4c-40ff-b6be-f9403f4fcb67-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:45:34 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[93260526-2612-4d30-9ac8-3967a20b0cc9]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:45:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-39dce581-b3cf-4b08-a073-bbb358b30bb3 tempest-VolumesListAdminTestJSON-2062899540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5492bd12-55d2-428a-bb00-752cc9171978 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:34 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-15c508d3-b81c-4fa6-a621-fda9bc5d94af tempest-VolumesListAdminTestJSON-864816612 None] Lock "cinder-1d802485-4b4c-40ff-b6be-f9403f4fcb67-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:45:34 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-15c508d3-b81c-4fa6-a621-fda9bc5d94af tempest-VolumesListAdminTestJSON-864816612 None] Acquiring lock "cinder-quobyte-1d802485-4b4c-40ff-b6be-f9403f4fcb67" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:45:34 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-15c508d3-b81c-4fa6-a621-fda9bc5d94af tempest-VolumesListAdminTestJSON-864816612 None] Lock "cinder-quobyte-1d802485-4b4c-40ff-b6be-f9403f4fcb67" acquired by "delete_volume" :: waited 0.036s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:45:34 devstack sudo[97091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5492bd12-55d2-428a-bb00-752cc9171978 Sep 10 16:45:34 devstack sudo[97091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:34 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbecd095-006f-4f3f-bad1-ede013912bb4]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:45:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-15c508d3-b81c-4fa6-a621-fda9bc5d94af tempest-VolumesListAdminTestJSON-864816612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1d802485-4b4c-40ff-b6be-f9403f4fcb67 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-74934899-8ba8-471b-ac43-13500a2d7e3b req-da425fc5-5f93-463e-be71-9d2e0d5a21ad tempest-AttachVolumeTestJSON-265770916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:35 devstack sudo[97096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1d802485-4b4c-40ff-b6be-f9403f4fcb67 Sep 10 16:45:35 devstack sudo[97096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:35 devstack sudo[97091]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-39dce581-b3cf-4b08-a073-bbb358b30bb3 tempest-VolumesListAdminTestJSON-2062899540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5492bd12-55d2-428a-bb00-752cc9171978" returned: 0 in 0.608s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-39dce581-b3cf-4b08-a073-bbb358b30bb3 tempest-VolumesListAdminTestJSON-2062899540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5492bd12-55d2-428a-bb00-752cc9171978 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:35 devstack sudo[97102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5492bd12-55d2-428a-bb00-752cc9171978 Sep 10 16:45:35 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:35 devstack sudo[97096]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-15c508d3-b81c-4fa6-a621-fda9bc5d94af tempest-VolumesListAdminTestJSON-864816612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1d802485-4b4c-40ff-b6be-f9403f4fcb67" returned: 0 in 0.753s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-15c508d3-b81c-4fa6-a621-fda9bc5d94af tempest-VolumesListAdminTestJSON-864816612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1d802485-4b4c-40ff-b6be-f9403f4fcb67 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:35 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1d802485-4b4c-40ff-b6be-f9403f4fcb67 Sep 10 16:45:35 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:36 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:36 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-15c508d3-b81c-4fa6-a621-fda9bc5d94af tempest-VolumesListAdminTestJSON-864816612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1d802485-4b4c-40ff-b6be-f9403f4fcb67" returned: 0 in 0.797s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-39dce581-b3cf-4b08-a073-bbb358b30bb3 tempest-VolumesListAdminTestJSON-2062899540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5492bd12-55d2-428a-bb00-752cc9171978" returned: 0 in 1.196s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-15c508d3-b81c-4fa6-a621-fda9bc5d94af tempest-VolumesListAdminTestJSON-864816612 None] Lock "cinder-quobyte-1d802485-4b4c-40ff-b6be-f9403f4fcb67" released by "delete_volume" :: held 1.671s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:45:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-39dce581-b3cf-4b08-a073-bbb358b30bb3 tempest-VolumesListAdminTestJSON-2062899540 None] Lock "cinder-quobyte-5492bd12-55d2-428a-bb00-752cc9171978" released by "delete_volume" :: held 1.918s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:45:36 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-15c508d3-b81c-4fa6-a621-fda9bc5d94af tempest-VolumesListAdminTestJSON-864816612 None] Created reservations ['857c453e-a9f1-446d-8171-dc894963afd8', 'a5d68e4b-a742-4e03-ba92-9ca52a6cf485', '40c75f41-5bec-4c8b-b2b6-5e266dfde316', '75f5aa3f-d657-4f0f-89b7-7064a0f44e33'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:45:36 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-39dce581-b3cf-4b08-a073-bbb358b30bb3 tempest-VolumesListAdminTestJSON-2062899540 None] Created reservations ['d5c7e421-962f-4d2b-9aff-5b5ece289793', '1b25b4d7-494c-443d-972f-acaebadc7593', '5baa23a8-0d45-4ee9-a66a-dc8d1e9d06f7', 'b55c98d3-7c03-4b60-96f1-85bec7049400'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:45:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-15c508d3-b81c-4fa6-a621-fda9bc5d94af tempest-VolumesListAdminTestJSON-864816612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-15c508d3-b81c-4fa6-a621-fda9bc5d94af tempest-VolumesListAdminTestJSON-864816612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:36 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-15c508d3-b81c-4fa6-a621-fda9bc5d94af tempest-VolumesListAdminTestJSON-864816612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:45:36 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-15c508d3-b81c-4fa6-a621-fda9bc5d94af tempest-VolumesListAdminTestJSON-864816612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:45:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-15c508d3-b81c-4fa6-a621-fda9bc5d94af tempest-VolumesListAdminTestJSON-864816612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-15c508d3-b81c-4fa6-a621-fda9bc5d94af tempest-VolumesListAdminTestJSON-864816612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:37 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:45:37 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-39dce581-b3cf-4b08-a073-bbb358b30bb3 tempest-VolumesListAdminTestJSON-2062899540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-39dce581-b3cf-4b08-a073-bbb358b30bb3 tempest-VolumesListAdminTestJSON-2062899540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:37 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-39dce581-b3cf-4b08-a073-bbb358b30bb3 tempest-VolumesListAdminTestJSON-2062899540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:45:37 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-39dce581-b3cf-4b08-a073-bbb358b30bb3 tempest-VolumesListAdminTestJSON-2062899540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:45:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-39dce581-b3cf-4b08-a073-bbb358b30bb3 tempest-VolumesListAdminTestJSON-2062899540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-39dce581-b3cf-4b08-a073-bbb358b30bb3 tempest-VolumesListAdminTestJSON-2062899540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:37 devstack sudo[97135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:45:37 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:37 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-da6b011b-d7f3-4a0d-8179-c0bdb20475eb tempest-VolumesListAdminTestJSON-864816612 None] Acquiring lock "cinder-f4d64d0b-1698-4919-9930-e5755354d53b-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:45:37 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:37 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-da6b011b-d7f3-4a0d-8179-c0bdb20475eb tempest-VolumesListAdminTestJSON-864816612 None] Lock "cinder-f4d64d0b-1698-4919-9930-e5755354d53b-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:45:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-15c508d3-b81c-4fa6-a621-fda9bc5d94af tempest-VolumesListAdminTestJSON-864816612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.729s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:37 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-15c508d3-b81c-4fa6-a621-fda9bc5d94af tempest-VolumesListAdminTestJSON-864816612 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:45:37 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-15c508d3-b81c-4fa6-a621-fda9bc5d94af tempest-VolumesListAdminTestJSON-864816612 None] Deleted volume successfully. Sep 10 16:45:37 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-da6b011b-d7f3-4a0d-8179-c0bdb20475eb tempest-VolumesListAdminTestJSON-864816612 None] Acquiring lock "cinder-quobyte-f4d64d0b-1698-4919-9930-e5755354d53b" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:45:37 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-15c508d3-b81c-4fa6-a621-fda9bc5d94af tempest-VolumesListAdminTestJSON-864816612 None] Lock "cinder-1d802485-4b4c-40ff-b6be-f9403f4fcb67-delete_volume" released by "delete_volume" :: held 3.148s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:45:37 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-da6b011b-d7f3-4a0d-8179-c0bdb20475eb tempest-VolumesListAdminTestJSON-864816612 None] Lock "cinder-quobyte-f4d64d0b-1698-4919-9930-e5755354d53b" acquired by "delete_volume" :: waited 0.075s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:45:37 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-39dce581-b3cf-4b08-a073-bbb358b30bb3 tempest-VolumesListAdminTestJSON-2062899540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.921s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:38 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-39dce581-b3cf-4b08-a073-bbb358b30bb3 tempest-VolumesListAdminTestJSON-2062899540 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:45:38 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-39dce581-b3cf-4b08-a073-bbb358b30bb3 tempest-VolumesListAdminTestJSON-2062899540 None] Deleted volume successfully. Sep 10 16:45:38 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c37995b-fe0e-40a9-a79f-68d72cc8d985]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:45:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-da6b011b-d7f3-4a0d-8179-c0bdb20475eb tempest-VolumesListAdminTestJSON-864816612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f4d64d0b-1698-4919-9930-e5755354d53b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:38 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-39dce581-b3cf-4b08-a073-bbb358b30bb3 tempest-VolumesListAdminTestJSON-2062899540 None] Lock "cinder-5492bd12-55d2-428a-bb00-752cc9171978-delete_volume" released by "delete_volume" :: held 3.629s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:45:38 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f4d64d0b-1698-4919-9930-e5755354d53b Sep 10 16:45:38 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:39 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-da6b011b-d7f3-4a0d-8179-c0bdb20475eb tempest-VolumesListAdminTestJSON-864816612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f4d64d0b-1698-4919-9930-e5755354d53b" returned: 0 in 1.450s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-da6b011b-d7f3-4a0d-8179-c0bdb20475eb tempest-VolumesListAdminTestJSON-864816612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f4d64d0b-1698-4919-9930-e5755354d53b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:39 devstack sudo[97144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f4d64d0b-1698-4919-9930-e5755354d53b Sep 10 16:45:39 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:40 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-da6b011b-d7f3-4a0d-8179-c0bdb20475eb tempest-VolumesListAdminTestJSON-864816612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f4d64d0b-1698-4919-9930-e5755354d53b" returned: 0 in 0.960s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:40 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-da6b011b-d7f3-4a0d-8179-c0bdb20475eb tempest-VolumesListAdminTestJSON-864816612 None] Lock "cinder-quobyte-f4d64d0b-1698-4919-9930-e5755354d53b" released by "delete_volume" :: held 2.585s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:45:40 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-da6b011b-d7f3-4a0d-8179-c0bdb20475eb tempest-VolumesListAdminTestJSON-864816612 None] Created reservations ['be8de088-923d-4a5a-8d10-e8ee6f55583b', '7e92ede4-b0c2-465b-898b-902f5a691e99', '190d6fb0-a0ec-41d3-9f34-c7874654a929', 'd6dfe11d-5b22-4273-bb3c-11e9fb5c84a1'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:45:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-da6b011b-d7f3-4a0d-8179-c0bdb20475eb tempest-VolumesListAdminTestJSON-864816612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-da6b011b-d7f3-4a0d-8179-c0bdb20475eb tempest-VolumesListAdminTestJSON-864816612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:40 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-da6b011b-d7f3-4a0d-8179-c0bdb20475eb tempest-VolumesListAdminTestJSON-864816612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:45:40 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-da6b011b-d7f3-4a0d-8179-c0bdb20475eb tempest-VolumesListAdminTestJSON-864816612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:45:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-da6b011b-d7f3-4a0d-8179-c0bdb20475eb tempest-VolumesListAdminTestJSON-864816612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-da6b011b-d7f3-4a0d-8179-c0bdb20475eb tempest-VolumesListAdminTestJSON-864816612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:40 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:45:40 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:41 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-da6b011b-d7f3-4a0d-8179-c0bdb20475eb tempest-VolumesListAdminTestJSON-864816612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.440s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:41 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-da6b011b-d7f3-4a0d-8179-c0bdb20475eb tempest-VolumesListAdminTestJSON-864816612 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:45:41 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-da6b011b-d7f3-4a0d-8179-c0bdb20475eb tempest-VolumesListAdminTestJSON-864816612 None] Deleted volume successfully. Sep 10 16:45:41 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-da6b011b-d7f3-4a0d-8179-c0bdb20475eb tempest-VolumesListAdminTestJSON-864816612 None] Lock "cinder-f4d64d0b-1698-4919-9930-e5755354d53b-delete_volume" released by "delete_volume" :: held 3.730s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:45:41 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5c030f1a-e5d9-425b-9eab-2c81699ee73b" returned: 0 in 6.928s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:41 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Image conversion details: src /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814, size 1024.00 MB, duration 6.93 sec, destination /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5c030f1a-e5d9-425b-9eab-2c81699ee73b {{(pid=88189) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 16:45:41 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Converted 1024.00 MB image at 147.78 MB/s Sep 10 16:45:41 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5c030f1a-e5d9-425b-9eab-2c81699ee73b is being set with open permissions: ugo+rw Sep 10 16:45:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5c030f1a-e5d9-425b-9eab-2c81699ee73b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:41 devstack sudo[97152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5c030f1a-e5d9-425b-9eab-2c81699ee73b Sep 10 16:45:41 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:41 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f70dba4c-66bf-44b3-b4fb-ce1688fe09a4 tempest-VolumesListAdminTestJSON-864816612 None] Acquiring lock "cinder-c496fc6c-64f4-4bb0-9e60-2d68f5571ed7-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:45:41 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f70dba4c-66bf-44b3-b4fb-ce1688fe09a4 tempest-VolumesListAdminTestJSON-864816612 None] Lock "cinder-c496fc6c-64f4-4bb0-9e60-2d68f5571ed7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:45:41 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f70dba4c-66bf-44b3-b4fb-ce1688fe09a4 tempest-VolumesListAdminTestJSON-864816612 None] Acquiring lock "cinder-quobyte-c496fc6c-64f4-4bb0-9e60-2d68f5571ed7" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:45:41 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f70dba4c-66bf-44b3-b4fb-ce1688fe09a4 tempest-VolumesListAdminTestJSON-864816612 None] Lock "cinder-quobyte-c496fc6c-64f4-4bb0-9e60-2d68f5571ed7" acquired by "delete_volume" :: waited 0.018s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:45:41 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f590b8-2c2d-4057-b9bb-ab53575270ae]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:45:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f70dba4c-66bf-44b3-b4fb-ce1688fe09a4 tempest-VolumesListAdminTestJSON-864816612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c496fc6c-64f4-4bb0-9e60-2d68f5571ed7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:41 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5c030f1a-e5d9-425b-9eab-2c81699ee73b" returned: 0 in 0.307s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:41 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Lock "cinder-quobyte-5c030f1a-e5d9-425b-9eab-2c81699ee73b" released by "_copy_volume_from_snapshot" :: held 8.328s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:45:41 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c496fc6c-64f4-4bb0-9e60-2d68f5571ed7 Sep 10 16:45:41 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:41 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Lock "cinder-quobyte-957bc6ac-b403-40d4-8edb-3454600b6d4d-5c030f1a-e5d9-425b-9eab-2c81699ee73b" released by "_create_volume_from_snapshot" :: held 8.413s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:45:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.441s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-74934899-8ba8-471b-ac43-13500a2d7e3b req-da425fc5-5f93-463e-be71-9d2e0d5a21ad tempest-AttachVolumeTestJSON-265770916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.779s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-74934899-8ba8-471b-ac43-13500a2d7e3b req-da425fc5-5f93-463e-be71-9d2e0d5a21ad tempest-AttachVolumeTestJSON-265770916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:41 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b66613-d574-4a6e-8860-617a946d223d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c030f1a-e5d9-425b-9eab-2c81699ee73b', 'volume_size': 1, 'snapshot_id': '957bc6ac-b403-40d4-8edb-3454600b6d4d'}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:41 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1644e7c8-cd2f-4e45-8fd0-527a40843095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:41 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Volume volume-5c030f1a-e5d9-425b-9eab-2c81699ee73b (5c030f1a-e5d9-425b-9eab-2c81699ee73b): created successfully Sep 10 16:45:41 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1644e7c8-cd2f-4e45-8fd0-527a40843095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:41 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Flow 'volume_create_manager' (2e6901dd-7a3b-4e1b-987c-683643624045) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:45:41 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-74934899-8ba8-471b-ac43-13500a2d7e3b req-da425fc5-5f93-463e-be71-9d2e0d5a21ad tempest-AttachVolumeTestJSON-265770916 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8', 'name': 'volume-532bc876-ef4c-4fb0-8e7c-3b594c03f881', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6f865d86-1d34-42d8-a460-7e249c512b12', 'enforce_multipath': True} {{(pid=88189) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 16:45:41 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-04944eec-3835-4dab-a7c5-5d33234d41dd tempest-VolumesDeleteCascade-1099800671 None] Created volume successfully. Sep 10 16:45:41 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-74934899-8ba8-471b-ac43-13500a2d7e3b req-da425fc5-5f93-463e-be71-9d2e0d5a21ad tempest-AttachVolumeTestJSON-265770916 None] attachment_update completed successfully. Sep 10 16:45:42 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f70dba4c-66bf-44b3-b4fb-ce1688fe09a4 tempest-VolumesListAdminTestJSON-864816612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c496fc6c-64f4-4bb0-9e60-2d68f5571ed7" returned: 0 in 0.528s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f70dba4c-66bf-44b3-b4fb-ce1688fe09a4 tempest-VolumesListAdminTestJSON-864816612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c496fc6c-64f4-4bb0-9e60-2d68f5571ed7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:42 devstack sudo[97186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c496fc6c-64f4-4bb0-9e60-2d68f5571ed7 Sep 10 16:45:42 devstack sudo[97186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:42 devstack sudo[97186]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f70dba4c-66bf-44b3-b4fb-ce1688fe09a4 tempest-VolumesListAdminTestJSON-864816612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c496fc6c-64f4-4bb0-9e60-2d68f5571ed7" returned: 0 in 0.282s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:42 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f70dba4c-66bf-44b3-b4fb-ce1688fe09a4 tempest-VolumesListAdminTestJSON-864816612 None] Lock "cinder-quobyte-c496fc6c-64f4-4bb0-9e60-2d68f5571ed7" released by "delete_volume" :: held 0.859s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:45:42 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-f70dba4c-66bf-44b3-b4fb-ce1688fe09a4 tempest-VolumesListAdminTestJSON-864816612 None] Created reservations ['10d55714-cf4d-4b2a-a0bf-9364f22a4fbc', '54bc8305-4612-43d0-96c0-821e30b84469', '350760a0-3fcc-4cdd-b648-e404b7c21f8a', 'dce47463-69ff-4c42-9a6b-793bbad9e4f5'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:45:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f70dba4c-66bf-44b3-b4fb-ce1688fe09a4 tempest-VolumesListAdminTestJSON-864816612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f70dba4c-66bf-44b3-b4fb-ce1688fe09a4 tempest-VolumesListAdminTestJSON-864816612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:42 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f70dba4c-66bf-44b3-b4fb-ce1688fe09a4 tempest-VolumesListAdminTestJSON-864816612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:45:42 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f70dba4c-66bf-44b3-b4fb-ce1688fe09a4 tempest-VolumesListAdminTestJSON-864816612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:45:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f70dba4c-66bf-44b3-b4fb-ce1688fe09a4 tempest-VolumesListAdminTestJSON-864816612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f70dba4c-66bf-44b3-b4fb-ce1688fe09a4 tempest-VolumesListAdminTestJSON-864816612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:42 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Acquiring lock "cinder-bf9686e8-639e-4c60-9cab-a0d45932e814-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:45:42 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:45:42 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:42 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Lock "cinder-bf9686e8-639e-4c60-9cab-a0d45932e814-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:45:42 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Performing cascade delete. {{(pid=88189) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 10 16:45:42 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Acquiring lock "cinder-957bc6ac-b403-40d4-8edb-3454600b6d4d-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:45:42 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Lock "cinder-957bc6ac-b403-40d4-8edb-3454600b6d4d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:45:42 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Acquiring lock "cinder-quobyte-bf9686e8-639e-4c60-9cab-a0d45932e814" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:45:42 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Lock "cinder-quobyte-bf9686e8-639e-4c60-9cab-a0d45932e814" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:45:42 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Acquiring lock "cinder-quobyte-957bc6ac-b403-40d4-8edb-3454600b6d4d" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:45:42 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Lock "cinder-quobyte-957bc6ac-b403-40d4-8edb-3454600b6d4d" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:45:42 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Deleting offline snapshot 957bc6ac-b403-40d4-8edb-3454600b6d4d of volume bf9686e8-639e-4c60-9cab-a0d45932e814 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:45:43 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] snapshot_file for this snap is: volume-bf9686e8-639e-4c60-9cab-a0d45932e814.957bc6ac-b403-40d4-8edb-3454600b6d4d {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:45:43 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b15714-296c-4823-af56-65bdf0ac660f]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:45:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814.957bc6ac-b403-40d4-8edb-3454600b6d4d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:43 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f70dba4c-66bf-44b3-b4fb-ce1688fe09a4 tempest-VolumesListAdminTestJSON-864816612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.450s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:43 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-f70dba4c-66bf-44b3-b4fb-ce1688fe09a4 tempest-VolumesListAdminTestJSON-864816612 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:45:43 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-f70dba4c-66bf-44b3-b4fb-ce1688fe09a4 tempest-VolumesListAdminTestJSON-864816612 None] Deleted volume successfully. Sep 10 16:45:43 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f70dba4c-66bf-44b3-b4fb-ce1688fe09a4 tempest-VolumesListAdminTestJSON-864816612 None] Lock "cinder-c496fc6c-64f4-4bb0-9e60-2d68f5571ed7-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:45:43 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814.957bc6ac-b403-40d4-8edb-3454600b6d4d Sep 10 16:45:43 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:43 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814.957bc6ac-b403-40d4-8edb-3454600b6d4d" returned: 0 in 0.544s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:43 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf9686e8-639e-4c60-9cab-a0d45932e814(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:45:43 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ac3060-fa66-4fe9-afdf-190204a2d3d7]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:45:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:43 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814 Sep 10 16:45:43 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:44 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814" returned: 0 in 0.822s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814.957bc6ac-b403-40d4-8edb-3454600b6d4d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:44 devstack sudo[97574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814.957bc6ac-b403-40d4-8edb-3454600b6d4d Sep 10 16:45:44 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:44 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814.957bc6ac-b403-40d4-8edb-3454600b6d4d" returned: 0 in 0.548s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814.957bc6ac-b403-40d4-8edb-3454600b6d4d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:45 devstack sudo[97587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814.957bc6ac-b403-40d4-8edb-3454600b6d4d Sep 10 16:45:45 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6afdd03-53d6-4396-9c53-1bf55020b91d tempest-AttachVolumeTestJSON-265770916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a6afdd03-53d6-4396-9c53-1bf55020b91d tempest-AttachVolumeTestJSON-265770916 None] Flow 'volume_create_manager' (8ef665ca-e5f4-48d0-9ddc-4600da74d42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a6afdd03-53d6-4396-9c53-1bf55020b91d tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8fb4558-ac92-4ae6-876c-37cc38ace64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a6afdd03-53d6-4396-9c53-1bf55020b91d tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8fb4558-ac92-4ae6-876c-37cc38ace64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1602535080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da86793-5ec2-4438-b2d5-9cecd4acd2e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45796b0a32f14262a3bd880e56ac6b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:45:45Z,use_quota=True,user_id='9e214a2542f344cca207ec605b9b45e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a6afdd03-53d6-4396-9c53-1bf55020b91d tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d21cbd4e-1214-4ca4-8bb6-a4601bb04e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a6afdd03-53d6-4396-9c53-1bf55020b91d tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d21cbd4e-1214-4ca4-8bb6-a4601bb04e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a6afdd03-53d6-4396-9c53-1bf55020b91d tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55ff457f-e747-4826-9f64-af49ca5a5d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a6afdd03-53d6-4396-9c53-1bf55020b91d tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55ff457f-e747-4826-9f64-af49ca5a5d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7da86793-5ec2-4438-b2d5-9cecd4acd2e5', 'volume_name': 'volume-7da86793-5ec2-4438-b2d5-9cecd4acd2e5', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a6afdd03-53d6-4396-9c53-1bf55020b91d tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d6a11a-8073-4841-ac5f-efdcde3d4c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a6afdd03-53d6-4396-9c53-1bf55020b91d tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d6a11a-8073-4841-ac5f-efdcde3d4c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a6afdd03-53d6-4396-9c53-1bf55020b91d tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c675c3a0-ab5d-421d-b230-34e2b6a046a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:45 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-a6afdd03-53d6-4396-9c53-1bf55020b91d tempest-AttachVolumeTestJSON-265770916 None] Volume 7da86793-5ec2-4438-b2d5-9cecd4acd2e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7da86793-5ec2-4438-b2d5-9cecd4acd2e5', 'volume_size': 1} Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a6afdd03-53d6-4396-9c53-1bf55020b91d tempest-AttachVolumeTestJSON-265770916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a6afdd03-53d6-4396-9c53-1bf55020b91d tempest-AttachVolumeTestJSON-265770916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-a6afdd03-53d6-4396-9c53-1bf55020b91d tempest-AttachVolumeTestJSON-265770916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1602535080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da86793-5ec2-4438-b2d5-9cecd4acd2e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45796b0a32f14262a3bd880e56ac6b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:45:45Z,use_quota=True,user_id='9e214a2542f344cca207ec605b9b45e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-a6afdd03-53d6-4396-9c53-1bf55020b91d tempest-AttachVolumeTestJSON-265770916 None] Creating volume 7da86793-5ec2-4438-b2d5-9cecd4acd2e5 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a6afdd03-53d6-4396-9c53-1bf55020b91d tempest-AttachVolumeTestJSON-265770916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a6afdd03-53d6-4396-9c53-1bf55020b91d tempest-AttachVolumeTestJSON-265770916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-a6afdd03-53d6-4396-9c53-1bf55020b91d tempest-AttachVolumeTestJSON-265770916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-a6afdd03-53d6-4396-9c53-1bf55020b91d tempest-AttachVolumeTestJSON-265770916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a6afdd03-53d6-4396-9c53-1bf55020b91d tempest-AttachVolumeTestJSON-265770916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-a6afdd03-53d6-4396-9c53-1bf55020b91d tempest-AttachVolumeTestJSON-265770916 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:45:45 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-a6afdd03-53d6-4396-9c53-1bf55020b91d tempest-AttachVolumeTestJSON-265770916 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a6afdd03-53d6-4396-9c53-1bf55020b91d tempest-AttachVolumeTestJSON-265770916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7da86793-5ec2-4438-b2d5-9cecd4acd2e5 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:45 devstack sudo[97589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7da86793-5ec2-4438-b2d5-9cecd4acd2e5 1073741824 Sep 10 16:45:45 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:45 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814.957bc6ac-b403-40d4-8edb-3454600b6d4d" returned: 0 in 0.441s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Lock "cinder-quobyte-957bc6ac-b403-40d4-8edb-3454600b6d4d" released by "_delete_snapshot" :: held 2.520s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Lock "cinder-quobyte-bf9686e8-639e-4c60-9cab-a0d45932e814" released by "delete_snapshot" :: held 2.562s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Created reservations ['39e28954-5379-4840-969c-d35b72605ec6', '247ccec1-8d8e-4733-9666-b075ed8f156e', '643d73ff-a887-4619-ae9e-43b8535d725a', '634f1b24-439e-4f9f-8950-c34c93225d9f'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:45:45 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Delete snapshot completed successfully. Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Lock "cinder-957bc6ac-b403-40d4-8edb-3454600b6d4d-delete_snapshot" released by "delete_snapshot" :: held 2.793s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Snapshots deleted, issuing volume delete {{(pid=88189) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Acquiring lock "cinder-quobyte-bf9686e8-639e-4c60-9cab-a0d45932e814" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Lock "cinder-quobyte-bf9686e8-639e-4c60-9cab-a0d45932e814" acquired by "delete_volume" :: waited 0.022s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[992ff878-8254-4dc2-a5f5-e52eec9799c2]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:45 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814 Sep 10 16:45:45 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:45 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a6afdd03-53d6-4396-9c53-1bf55020b91d tempest-AttachVolumeTestJSON-265770916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7da86793-5ec2-4438-b2d5-9cecd4acd2e5 1073741824" returned: 0 in 0.586s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a6afdd03-53d6-4396-9c53-1bf55020b91d tempest-AttachVolumeTestJSON-265770916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7da86793-5ec2-4438-b2d5-9cecd4acd2e5 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:46 devstack sudo[97598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7da86793-5ec2-4438-b2d5-9cecd4acd2e5 Sep 10 16:45:46 devstack sudo[97598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:46 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814" returned: 0 in 0.525s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:46 devstack sudo[97604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814 Sep 10 16:45:46 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:46 devstack sudo[97598]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a6afdd03-53d6-4396-9c53-1bf55020b91d tempest-AttachVolumeTestJSON-265770916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7da86793-5ec2-4438-b2d5-9cecd4acd2e5" returned: 0 in 0.384s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:46 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-a6afdd03-53d6-4396-9c53-1bf55020b91d tempest-AttachVolumeTestJSON-265770916 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:45:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a6afdd03-53d6-4396-9c53-1bf55020b91d tempest-AttachVolumeTestJSON-265770916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a6afdd03-53d6-4396-9c53-1bf55020b91d tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c675c3a0-ab5d-421d-b230-34e2b6a046a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7da86793-5ec2-4438-b2d5-9cecd4acd2e5', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a6afdd03-53d6-4396-9c53-1bf55020b91d tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4230d1be-c0bb-4e3e-85fa-e4610169459d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:46 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-a6afdd03-53d6-4396-9c53-1bf55020b91d tempest-AttachVolumeTestJSON-265770916 None] Volume volume-7da86793-5ec2-4438-b2d5-9cecd4acd2e5 (7da86793-5ec2-4438-b2d5-9cecd4acd2e5): created successfully Sep 10 16:45:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a6afdd03-53d6-4396-9c53-1bf55020b91d tempest-AttachVolumeTestJSON-265770916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4230d1be-c0bb-4e3e-85fa-e4610169459d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a6afdd03-53d6-4396-9c53-1bf55020b91d tempest-AttachVolumeTestJSON-265770916 None] Flow 'volume_create_manager' (8ef665ca-e5f4-48d0-9ddc-4600da74d42f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:45:46 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-a6afdd03-53d6-4396-9c53-1bf55020b91d tempest-AttachVolumeTestJSON-265770916 None] Created volume successfully. Sep 10 16:45:46 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bf9686e8-639e-4c60-9cab-a0d45932e814" returned: 0 in 0.385s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:46 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Lock "cinder-quobyte-bf9686e8-639e-4c60-9cab-a0d45932e814" released by "delete_volume" :: held 1.002s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:45:46 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Created reservations ['488c6671-c44b-44e6-81ff-7e95625a483d', '86f34e92-ff4a-4dc6-a8ad-24139d8ca53f', '6a37a3ea-83f2-4aac-b96a-b43dae4158c4', '7ad3dcd5-947c-46ac-907b-b9ef0befab99'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:45:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:46 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:45:46 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:45:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:46 devstack sudo[97616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:45:46 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:47 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.449s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:47 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:45:47 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Deleted volume successfully. Sep 10 16:45:47 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5ee1c819-bd49-4e5a-b4db-854c30e0260b tempest-VolumesDeleteCascade-1099800671 None] Lock "cinder-bf9686e8-639e-4c60-9cab-a0d45932e814-delete_volume" released by "delete_volume" :: held 4.593s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:45:47 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-3611f0df-6f63-4278-acae-e9f9fb71b301 tempest-VolumesDeleteCascade-1099800671 None] Acquiring lock "cinder-5c030f1a-e5d9-425b-9eab-2c81699ee73b-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:45:47 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-3611f0df-6f63-4278-acae-e9f9fb71b301 tempest-VolumesDeleteCascade-1099800671 None] Lock "cinder-5c030f1a-e5d9-425b-9eab-2c81699ee73b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:45:47 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-3611f0df-6f63-4278-acae-e9f9fb71b301 tempest-VolumesDeleteCascade-1099800671 None] Acquiring lock "cinder-quobyte-5c030f1a-e5d9-425b-9eab-2c81699ee73b" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:45:47 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-3611f0df-6f63-4278-acae-e9f9fb71b301 tempest-VolumesDeleteCascade-1099800671 None] Lock "cinder-quobyte-5c030f1a-e5d9-425b-9eab-2c81699ee73b" acquired by "delete_volume" :: waited 0.030s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:45:47 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[072f59dc-712a-4f5c-aa10-7460e03d459f]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:45:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3611f0df-6f63-4278-acae-e9f9fb71b301 tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5c030f1a-e5d9-425b-9eab-2c81699ee73b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:47 devstack sudo[97623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5c030f1a-e5d9-425b-9eab-2c81699ee73b Sep 10 16:45:47 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-293fbae6-1e37-4482-9e83-d45470f3c0f9 req-605c1055-054d-482d-8cbf-04c132e46932 tempest-AttachVolumeTestJSON-265770916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:48 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-293fbae6-1e37-4482-9e83-d45470f3c0f9 req-605c1055-054d-482d-8cbf-04c132e46932 tempest-AttachVolumeTestJSON-265770916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3611f0df-6f63-4278-acae-e9f9fb71b301 tempest-VolumesDeleteCascade-1099800671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5c030f1a-e5d9-425b-9eab-2c81699ee73b" returned: 0 in 0.834s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3611f0df-6f63-4278-acae-e9f9fb71b301 tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5c030f1a-e5d9-425b-9eab-2c81699ee73b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-293fbae6-1e37-4482-9e83-d45470f3c0f9 req-605c1055-054d-482d-8cbf-04c132e46932 tempest-AttachVolumeTestJSON-265770916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.079s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:48 devstack sudo[97677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5c030f1a-e5d9-425b-9eab-2c81699ee73b Sep 10 16:45:48 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:48 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-293fbae6-1e37-4482-9e83-d45470f3c0f9 req-605c1055-054d-482d-8cbf-04c132e46932 tempest-AttachVolumeTestJSON-265770916 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8', 'name': 'volume-7da86793-5ec2-4438-b2d5-9cecd4acd2e5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd301889c-a5bd-4379-af23-f0c1b6c112be', 'enforce_multipath': True} {{(pid=88189) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 16:45:48 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-293fbae6-1e37-4482-9e83-d45470f3c0f9 req-605c1055-054d-482d-8cbf-04c132e46932 tempest-AttachVolumeTestJSON-265770916 None] attachment_update completed successfully. Sep 10 16:45:49 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3611f0df-6f63-4278-acae-e9f9fb71b301 tempest-VolumesDeleteCascade-1099800671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5c030f1a-e5d9-425b-9eab-2c81699ee73b" returned: 0 in 0.503s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:49 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-3611f0df-6f63-4278-acae-e9f9fb71b301 tempest-VolumesDeleteCascade-1099800671 None] Lock "cinder-quobyte-5c030f1a-e5d9-425b-9eab-2c81699ee73b" released by "delete_volume" :: held 1.407s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:45:49 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-3611f0df-6f63-4278-acae-e9f9fb71b301 tempest-VolumesDeleteCascade-1099800671 None] Created reservations ['dc9c897b-4b54-463f-9ac4-d24eb0d6dd45', '6856ab90-3295-4f85-b108-253058f6c762', '4edc29b7-ca69-4688-bc14-c8dd7b4ae04b', '9b015ad8-8dca-45ca-aad1-65a76b8cb436'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:45:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:45:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:45:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:45:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:49 devstack sudo[97707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:45:49 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3611f0df-6f63-4278-acae-e9f9fb71b301 tempest-VolumesDeleteCascade-1099800671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3611f0df-6f63-4278-acae-e9f9fb71b301 tempest-VolumesDeleteCascade-1099800671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3611f0df-6f63-4278-acae-e9f9fb71b301 tempest-VolumesDeleteCascade-1099800671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:45:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3611f0df-6f63-4278-acae-e9f9fb71b301 tempest-VolumesDeleteCascade-1099800671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:45:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3611f0df-6f63-4278-acae-e9f9fb71b301 tempest-VolumesDeleteCascade-1099800671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3611f0df-6f63-4278-acae-e9f9fb71b301 tempest-VolumesDeleteCascade-1099800671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:49 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:45:49 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:49 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.383s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:49 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:45:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager._thread_info {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:45:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread count: 28 {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 16:45:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread info: [<_MainThread(MainThread, started 125792070905984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 16:45:50 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3611f0df-6f63-4278-acae-e9f9fb71b301 tempest-VolumesDeleteCascade-1099800671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.424s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:50 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-3611f0df-6f63-4278-acae-e9f9fb71b301 tempest-VolumesDeleteCascade-1099800671 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:45:50 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-3611f0df-6f63-4278-acae-e9f9fb71b301 tempest-VolumesDeleteCascade-1099800671 None] Deleted volume successfully. Sep 10 16:45:50 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-3611f0df-6f63-4278-acae-e9f9fb71b301 tempest-VolumesDeleteCascade-1099800671 None] Lock "cinder-5c030f1a-e5d9-425b-9eab-2c81699ee73b-delete_volume" released by "delete_volume" :: held 2.456s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:45:51 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-b113b6df-9d60-47b2-bdeb-a5a2c591026f req-b2d0edd2-941f-4d70-8d11-2a484b6061ad tempest-AttachVolumeTestJSON-265770916 None] Terminate volume connection completed successfully. Sep 10 16:45:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-b113b6df-9d60-47b2-bdeb-a5a2c591026f req-b2d0edd2-941f-4d70-8d11-2a484b6061ad tempest-AttachVolumeTestJSON-265770916 None] Deleting attachment 6f865d86-1d34-42d8-a460-7e249c512b12. {{(pid=88189) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 16:45:53 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-b4cf078f-559a-4c7c-8edf-4b961cbc5bbc req-7d72faea-8318-40fa-9c6f-71d4e41b482a tempest-AttachVolumeTestJSON-265770916 None] Terminate volume connection completed successfully. Sep 10 16:45:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-b4cf078f-559a-4c7c-8edf-4b961cbc5bbc req-7d72faea-8318-40fa-9c6f-71d4e41b482a tempest-AttachVolumeTestJSON-265770916 None] Deleting attachment d301889c-a5bd-4379-af23-f0c1b6c112be. {{(pid=88189) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 16:45:57 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-c93c1f9c-37be-42a1-ab5d-4bf9919d80b8 tempest-SnapshotMetadataTestJSON-1558203328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:45:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c93c1f9c-37be-42a1-ab5d-4bf9919d80b8 tempest-SnapshotMetadataTestJSON-1558203328 None] Flow 'volume_create_manager' (0e00f7d2-787e-4e30-91f5-81a087e9cfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:45:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c93c1f9c-37be-42a1-ab5d-4bf9919d80b8 tempest-SnapshotMetadataTestJSON-1558203328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f061b9b7-531f-4eee-96b8-82e3d7dd4c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c93c1f9c-37be-42a1-ab5d-4bf9919d80b8 tempest-SnapshotMetadataTestJSON-1558203328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f061b9b7-531f-4eee-96b8-82e3d7dd4c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-912119581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c76a57188f4c4e3e843b5ce153d54853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:45:58Z,use_quota=True,user_id='2f7d62ffd13c4039a7637f5dff37a92e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c93c1f9c-37be-42a1-ab5d-4bf9919d80b8 tempest-SnapshotMetadataTestJSON-1558203328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08433d66-65ae-4ef3-b999-5d39fba309cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c93c1f9c-37be-42a1-ab5d-4bf9919d80b8 tempest-SnapshotMetadataTestJSON-1558203328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08433d66-65ae-4ef3-b999-5d39fba309cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c93c1f9c-37be-42a1-ab5d-4bf9919d80b8 tempest-SnapshotMetadataTestJSON-1558203328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4492cd7-ef55-455f-8684-734ca6354d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c93c1f9c-37be-42a1-ab5d-4bf9919d80b8 tempest-SnapshotMetadataTestJSON-1558203328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4492cd7-ef55-455f-8684-734ca6354d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c', 'volume_name': 'volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c93c1f9c-37be-42a1-ab5d-4bf9919d80b8 tempest-SnapshotMetadataTestJSON-1558203328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14af4bb-1ffd-4a5a-880e-38d0d4e6f75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c93c1f9c-37be-42a1-ab5d-4bf9919d80b8 tempest-SnapshotMetadataTestJSON-1558203328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14af4bb-1ffd-4a5a-880e-38d0d4e6f75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c93c1f9c-37be-42a1-ab5d-4bf9919d80b8 tempest-SnapshotMetadataTestJSON-1558203328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d0968c1-0cf4-42f3-8346-54ea0a46e979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:57 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-c93c1f9c-37be-42a1-ab5d-4bf9919d80b8 tempest-SnapshotMetadataTestJSON-1558203328 None] Volume e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c', 'volume_size': 1} Sep 10 16:45:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c93c1f9c-37be-42a1-ab5d-4bf9919d80b8 tempest-SnapshotMetadataTestJSON-1558203328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c93c1f9c-37be-42a1-ab5d-4bf9919d80b8 tempest-SnapshotMetadataTestJSON-1558203328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:57 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c93c1f9c-37be-42a1-ab5d-4bf9919d80b8 tempest-SnapshotMetadataTestJSON-1558203328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-912119581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c76a57188f4c4e3e843b5ce153d54853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:45:58Z,use_quota=True,user_id='2f7d62ffd13c4039a7637f5dff37a92e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:45:57 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-c93c1f9c-37be-42a1-ab5d-4bf9919d80b8 tempest-SnapshotMetadataTestJSON-1558203328 None] Creating volume e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:45:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c93c1f9c-37be-42a1-ab5d-4bf9919d80b8 tempest-SnapshotMetadataTestJSON-1558203328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c93c1f9c-37be-42a1-ab5d-4bf9919d80b8 tempest-SnapshotMetadataTestJSON-1558203328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:57 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c93c1f9c-37be-42a1-ab5d-4bf9919d80b8 tempest-SnapshotMetadataTestJSON-1558203328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:45:57 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c93c1f9c-37be-42a1-ab5d-4bf9919d80b8 tempest-SnapshotMetadataTestJSON-1558203328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:45:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c93c1f9c-37be-42a1-ab5d-4bf9919d80b8 tempest-SnapshotMetadataTestJSON-1558203328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:57 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c93c1f9c-37be-42a1-ab5d-4bf9919d80b8 tempest-SnapshotMetadataTestJSON-1558203328 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:45:57 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-c93c1f9c-37be-42a1-ab5d-4bf9919d80b8 tempest-SnapshotMetadataTestJSON-1558203328 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:45:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c93c1f9c-37be-42a1-ab5d-4bf9919d80b8 tempest-SnapshotMetadataTestJSON-1558203328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:57 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c 1073741824 Sep 10 16:45:57 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:58 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c93c1f9c-37be-42a1-ab5d-4bf9919d80b8 tempest-SnapshotMetadataTestJSON-1558203328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c 1073741824" returned: 0 in 0.695s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c93c1f9c-37be-42a1-ab5d-4bf9919d80b8 tempest-SnapshotMetadataTestJSON-1558203328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:58 devstack sudo[97783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c Sep 10 16:45:58 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:45:58 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root Sep 10 16:45:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c93c1f9c-37be-42a1-ab5d-4bf9919d80b8 tempest-SnapshotMetadataTestJSON-1558203328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c" returned: 0 in 0.266s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:45:58 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c93c1f9c-37be-42a1-ab5d-4bf9919d80b8 tempest-SnapshotMetadataTestJSON-1558203328 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:45:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c93c1f9c-37be-42a1-ab5d-4bf9919d80b8 tempest-SnapshotMetadataTestJSON-1558203328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c93c1f9c-37be-42a1-ab5d-4bf9919d80b8 tempest-SnapshotMetadataTestJSON-1558203328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d0968c1-0cf4-42f3-8346-54ea0a46e979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c93c1f9c-37be-42a1-ab5d-4bf9919d80b8 tempest-SnapshotMetadataTestJSON-1558203328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73451f9b-d7d7-4e66-91a0-b09c797c1be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:58 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-c93c1f9c-37be-42a1-ab5d-4bf9919d80b8 tempest-SnapshotMetadataTestJSON-1558203328 None] Volume volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c (e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c): created successfully Sep 10 16:45:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c93c1f9c-37be-42a1-ab5d-4bf9919d80b8 tempest-SnapshotMetadataTestJSON-1558203328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73451f9b-d7d7-4e66-91a0-b09c797c1be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c93c1f9c-37be-42a1-ab5d-4bf9919d80b8 tempest-SnapshotMetadataTestJSON-1558203328 None] Flow 'volume_create_manager' (0e00f7d2-787e-4e30-91f5-81a087e9cfb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:45:58 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-c93c1f9c-37be-42a1-ab5d-4bf9919d80b8 tempest-SnapshotMetadataTestJSON-1558203328 None] Created volume successfully. Sep 10 16:45:59 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c337105-b8be-459d-b07b-b008e79aaa31 tempest-VolumesTransfersV355Test-2138077738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:45:59 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2c337105-b8be-459d-b07b-b008e79aaa31 tempest-VolumesTransfersV355Test-2138077738 None] Flow 'volume_create_manager' (59e7e97f-0d83-468b-8e5d-7df15ce7e925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:45:59 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2c337105-b8be-459d-b07b-b008e79aaa31 tempest-VolumesTransfersV355Test-2138077738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e0a9e9-4583-4438-938d-845cb284e2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:59 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2c337105-b8be-459d-b07b-b008e79aaa31 tempest-VolumesTransfersV355Test-2138077738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e0a9e9-4583-4438-938d-845cb284e2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-609833051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4700073-c291-43c2-a292-ccf1e13bd0b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3799b52ed6454602a09d93e298908212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:45:59Z,use_quota=True,user_id='3a7ea39753144be79d7f82708beeada4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:59 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2c337105-b8be-459d-b07b-b008e79aaa31 tempest-VolumesTransfersV355Test-2138077738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4464ebd-9c34-4860-b7a2-a129388bb286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:59 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2c337105-b8be-459d-b07b-b008e79aaa31 tempest-VolumesTransfersV355Test-2138077738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4464ebd-9c34-4860-b7a2-a129388bb286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:59 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2c337105-b8be-459d-b07b-b008e79aaa31 tempest-VolumesTransfersV355Test-2138077738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dcfdeb9-7747-4a3d-b0bd-743020d7bf56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:59 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2c337105-b8be-459d-b07b-b008e79aaa31 tempest-VolumesTransfersV355Test-2138077738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dcfdeb9-7747-4a3d-b0bd-743020d7bf56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4700073-c291-43c2-a292-ccf1e13bd0b6', 'volume_name': 'volume-f4700073-c291-43c2-a292-ccf1e13bd0b6', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:59 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2c337105-b8be-459d-b07b-b008e79aaa31 tempest-VolumesTransfersV355Test-2138077738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aac04016-cbfe-46b4-869c-b405678beb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:59 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2c337105-b8be-459d-b07b-b008e79aaa31 tempest-VolumesTransfersV355Test-2138077738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aac04016-cbfe-46b4-869c-b405678beb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:45:59 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2c337105-b8be-459d-b07b-b008e79aaa31 tempest-VolumesTransfersV355Test-2138077738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7081a70d-9ed9-4498-9b97-edff0449a7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:45:59 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-2c337105-b8be-459d-b07b-b008e79aaa31 tempest-VolumesTransfersV355Test-2138077738 None] Volume f4700073-c291-43c2-a292-ccf1e13bd0b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4700073-c291-43c2-a292-ccf1e13bd0b6', 'volume_size': 1} Sep 10 16:45:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2c337105-b8be-459d-b07b-b008e79aaa31 tempest-VolumesTransfersV355Test-2138077738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2c337105-b8be-459d-b07b-b008e79aaa31 tempest-VolumesTransfersV355Test-2138077738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:59 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-2c337105-b8be-459d-b07b-b008e79aaa31 tempest-VolumesTransfersV355Test-2138077738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-609833051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4700073-c291-43c2-a292-ccf1e13bd0b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3799b52ed6454602a09d93e298908212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:45:59Z,use_quota=True,user_id='3a7ea39753144be79d7f82708beeada4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:45:59 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-2c337105-b8be-459d-b07b-b008e79aaa31 tempest-VolumesTransfersV355Test-2138077738 None] Creating volume f4700073-c291-43c2-a292-ccf1e13bd0b6 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:45:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2c337105-b8be-459d-b07b-b008e79aaa31 tempest-VolumesTransfersV355Test-2138077738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:45:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2c337105-b8be-459d-b07b-b008e79aaa31 tempest-VolumesTransfersV355Test-2138077738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:45:59 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-2c337105-b8be-459d-b07b-b008e79aaa31 tempest-VolumesTransfersV355Test-2138077738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:45:59 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-2c337105-b8be-459d-b07b-b008e79aaa31 tempest-VolumesTransfersV355Test-2138077738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:45:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2c337105-b8be-459d-b07b-b008e79aaa31 tempest-VolumesTransfersV355Test-2138077738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:45:59 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-2c337105-b8be-459d-b07b-b008e79aaa31 tempest-VolumesTransfersV355Test-2138077738 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:45:59 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-2c337105-b8be-459d-b07b-b008e79aaa31 tempest-VolumesTransfersV355Test-2138077738 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:45:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2c337105-b8be-459d-b07b-b008e79aaa31 tempest-VolumesTransfersV355Test-2138077738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f4700073-c291-43c2-a292-ccf1e13bd0b6 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:45:59 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f4700073-c291-43c2-a292-ccf1e13bd0b6 1073741824 Sep 10 16:45:59 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9edb1c88-3dff-486e-a9b7-ed90e01e8a09 tempest-SnapshotMetadataTestJSON-1558203328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:46:00 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2c337105-b8be-459d-b07b-b008e79aaa31 tempest-VolumesTransfersV355Test-2138077738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f4700073-c291-43c2-a292-ccf1e13bd0b6 1073741824" returned: 0 in 0.675s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2c337105-b8be-459d-b07b-b008e79aaa31 tempest-VolumesTransfersV355Test-2138077738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f4700073-c291-43c2-a292-ccf1e13bd0b6 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:00 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f4700073-c291-43c2-a292-ccf1e13bd0b6 Sep 10 16:46:00 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:00 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2c337105-b8be-459d-b07b-b008e79aaa31 tempest-VolumesTransfersV355Test-2138077738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f4700073-c291-43c2-a292-ccf1e13bd0b6" returned: 0 in 0.295s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:00 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-2c337105-b8be-459d-b07b-b008e79aaa31 tempest-VolumesTransfersV355Test-2138077738 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:46:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2c337105-b8be-459d-b07b-b008e79aaa31 tempest-VolumesTransfersV355Test-2138077738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:46:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9edb1c88-3dff-486e-a9b7-ed90e01e8a09 tempest-SnapshotMetadataTestJSON-1558203328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.407s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:46:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2c337105-b8be-459d-b07b-b008e79aaa31 tempest-VolumesTransfersV355Test-2138077738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7081a70d-9ed9-4498-9b97-edff0449a7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4700073-c291-43c2-a292-ccf1e13bd0b6', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2c337105-b8be-459d-b07b-b008e79aaa31 tempest-VolumesTransfersV355Test-2138077738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15729012-77d9-479a-b2e0-d2791b431e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:00 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-9edb1c88-3dff-486e-a9b7-ed90e01e8a09 tempest-SnapshotMetadataTestJSON-1558203328 None] Creating offline snapshot 7acac2f5-86c1-48e1-9369-d00349281726 of volume e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:46:00 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-2c337105-b8be-459d-b07b-b008e79aaa31 tempest-VolumesTransfersV355Test-2138077738 None] Volume volume-f4700073-c291-43c2-a292-ccf1e13bd0b6 (f4700073-c291-43c2-a292-ccf1e13bd0b6): created successfully Sep 10 16:46:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2c337105-b8be-459d-b07b-b008e79aaa31 tempest-VolumesTransfersV355Test-2138077738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15729012-77d9-479a-b2e0-d2791b431e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2c337105-b8be-459d-b07b-b008e79aaa31 tempest-VolumesTransfersV355Test-2138077738 None] Flow 'volume_create_manager' (59e7e97f-0d83-468b-8e5d-7df15ce7e925) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:46:00 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdaf60c-d296-4f57-9ef0-799f8b3cc124]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:46:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9edb1c88-3dff-486e-a9b7-ed90e01e8a09 tempest-SnapshotMetadataTestJSON-1558203328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:00 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-2c337105-b8be-459d-b07b-b008e79aaa31 tempest-VolumesTransfersV355Test-2138077738 None] Created volume successfully. Sep 10 16:46:00 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-77af1d4b-49a6-4dbc-bdd1-f8522b28f577 tempest-AttachVolumeTestJSON-265770916 None] Acquiring lock "cinder-7da86793-5ec2-4438-b2d5-9cecd4acd2e5-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:46:00 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-77af1d4b-49a6-4dbc-bdd1-f8522b28f577 tempest-AttachVolumeTestJSON-265770916 None] Lock "cinder-7da86793-5ec2-4438-b2d5-9cecd4acd2e5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:46:00 devstack sudo[97799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c Sep 10 16:46:00 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:00 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-77af1d4b-49a6-4dbc-bdd1-f8522b28f577 tempest-AttachVolumeTestJSON-265770916 None] Acquiring lock "cinder-quobyte-7da86793-5ec2-4438-b2d5-9cecd4acd2e5" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:46:00 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-77af1d4b-49a6-4dbc-bdd1-f8522b28f577 tempest-AttachVolumeTestJSON-265770916 None] Lock "cinder-quobyte-7da86793-5ec2-4438-b2d5-9cecd4acd2e5" acquired by "delete_volume" :: waited 0.020s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:46:00 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb4309a-f461-4fc4-bda8-188d0a8211be]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:46:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-77af1d4b-49a6-4dbc-bdd1-f8522b28f577 tempest-AttachVolumeTestJSON-265770916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7da86793-5ec2-4438-b2d5-9cecd4acd2e5 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:01 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7da86793-5ec2-4438-b2d5-9cecd4acd2e5 Sep 10 16:46:01 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:01 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9edb1c88-3dff-486e-a9b7-ed90e01e8a09 tempest-SnapshotMetadataTestJSON-1558203328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c" returned: 0 in 0.449s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9edb1c88-3dff-486e-a9b7-ed90e01e8a09 tempest-SnapshotMetadataTestJSON-1558203328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c.7acac2f5-86c1-48e1-9369-d00349281726 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:01 devstack sudo[97807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c.7acac2f5-86c1-48e1-9369-d00349281726 1G Sep 10 16:46:01 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:01 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-77af1d4b-49a6-4dbc-bdd1-f8522b28f577 tempest-AttachVolumeTestJSON-265770916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7da86793-5ec2-4438-b2d5-9cecd4acd2e5" returned: 0 in 0.416s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-77af1d4b-49a6-4dbc-bdd1-f8522b28f577 tempest-AttachVolumeTestJSON-265770916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7da86793-5ec2-4438-b2d5-9cecd4acd2e5 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:01 devstack sudo[97814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7da86793-5ec2-4438-b2d5-9cecd4acd2e5 Sep 10 16:46:01 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:01 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-77af1d4b-49a6-4dbc-bdd1-f8522b28f577 tempest-AttachVolumeTestJSON-265770916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7da86793-5ec2-4438-b2d5-9cecd4acd2e5" returned: 0 in 0.274s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:01 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9edb1c88-3dff-486e-a9b7-ed90e01e8a09 tempest-SnapshotMetadataTestJSON-1558203328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c.7acac2f5-86c1-48e1-9369-d00349281726 1G" returned: 0 in 0.483s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9edb1c88-3dff-486e-a9b7-ed90e01e8a09 tempest-SnapshotMetadataTestJSON-1558203328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c.7acac2f5-86c1-48e1-9369-d00349281726 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:01 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-77af1d4b-49a6-4dbc-bdd1-f8522b28f577 tempest-AttachVolumeTestJSON-265770916 None] Lock "cinder-quobyte-7da86793-5ec2-4438-b2d5-9cecd4acd2e5" released by "delete_volume" :: held 0.748s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:46:01 devstack sudo[97821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c.7acac2f5-86c1-48e1-9369-d00349281726 Sep 10 16:46:01 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:01 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-77af1d4b-49a6-4dbc-bdd1-f8522b28f577 tempest-AttachVolumeTestJSON-265770916 None] Created reservations ['279cb035-a565-4e45-9e25-94b657c9a20e', '70d9a5a4-cf26-49d5-8dc8-5415bc3351b0', '1cf0e0f1-401a-4ddd-90e9-d78aa4a0e946', 'b7f4aa1f-3fe6-4992-a5c0-9b7049bd0ffd'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:46:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-77af1d4b-49a6-4dbc-bdd1-f8522b28f577 tempest-AttachVolumeTestJSON-265770916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:46:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-77af1d4b-49a6-4dbc-bdd1-f8522b28f577 tempest-AttachVolumeTestJSON-265770916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:46:01 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-77af1d4b-49a6-4dbc-bdd1-f8522b28f577 tempest-AttachVolumeTestJSON-265770916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:46:01 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-77af1d4b-49a6-4dbc-bdd1-f8522b28f577 tempest-AttachVolumeTestJSON-265770916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:46:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-77af1d4b-49a6-4dbc-bdd1-f8522b28f577 tempest-AttachVolumeTestJSON-265770916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:46:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-77af1d4b-49a6-4dbc-bdd1-f8522b28f577 tempest-AttachVolumeTestJSON-265770916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:01 devstack sudo[97823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:46:01 devstack sudo[97823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:02 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d333a5b4-b6a6-4f36-bc31-a996756016ea tempest-AttachVolumeTestJSON-265770916 None] Acquiring lock "cinder-532bc876-ef4c-4fb0-8e7c-3b594c03f881-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:46:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9edb1c88-3dff-486e-a9b7-ed90e01e8a09 tempest-SnapshotMetadataTestJSON-1558203328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c.7acac2f5-86c1-48e1-9369-d00349281726" returned: 0 in 0.439s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:02 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-9edb1c88-3dff-486e-a9b7-ed90e01e8a09 tempest-SnapshotMetadataTestJSON-1558203328 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c.7acac2f5-86c1-48e1-9369-d00349281726 is being set with open permissions: ugo+rw Sep 10 16:46:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9edb1c88-3dff-486e-a9b7-ed90e01e8a09 tempest-SnapshotMetadataTestJSON-1558203328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c.7acac2f5-86c1-48e1-9369-d00349281726 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:02 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c.7acac2f5-86c1-48e1-9369-d00349281726 Sep 10 16:46:02 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d333a5b4-b6a6-4f36-bc31-a996756016ea tempest-AttachVolumeTestJSON-265770916 None] Lock "cinder-532bc876-ef4c-4fb0-8e7c-3b594c03f881-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:46:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d333a5b4-b6a6-4f36-bc31-a996756016ea tempest-AttachVolumeTestJSON-265770916 None] Acquiring lock "cinder-quobyte-532bc876-ef4c-4fb0-8e7c-3b594c03f881" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:46:02 devstack sudo[97823]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-77af1d4b-49a6-4dbc-bdd1-f8522b28f577 tempest-AttachVolumeTestJSON-265770916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.391s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:02 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-77af1d4b-49a6-4dbc-bdd1-f8522b28f577 tempest-AttachVolumeTestJSON-265770916 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:46:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d333a5b4-b6a6-4f36-bc31-a996756016ea tempest-AttachVolumeTestJSON-265770916 None] Lock "cinder-quobyte-532bc876-ef4c-4fb0-8e7c-3b594c03f881" acquired by "delete_volume" :: waited 0.043s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:46:02 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-77af1d4b-49a6-4dbc-bdd1-f8522b28f577 tempest-AttachVolumeTestJSON-265770916 None] Deleted volume successfully. Sep 10 16:46:02 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[480f53cd-c417-4486-ac8a-b81361c471c9]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:46:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d333a5b4-b6a6-4f36-bc31-a996756016ea tempest-AttachVolumeTestJSON-265770916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-532bc876-ef4c-4fb0-8e7c-3b594c03f881 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-77af1d4b-49a6-4dbc-bdd1-f8522b28f577 tempest-AttachVolumeTestJSON-265770916 None] Lock "cinder-7da86793-5ec2-4438-b2d5-9cecd4acd2e5-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:46:02 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9edb1c88-3dff-486e-a9b7-ed90e01e8a09 tempest-SnapshotMetadataTestJSON-1558203328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c.7acac2f5-86c1-48e1-9369-d00349281726" returned: 0 in 0.350s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9edb1c88-3dff-486e-a9b7-ed90e01e8a09 tempest-SnapshotMetadataTestJSON-1558203328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:02 devstack sudo[97831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-532bc876-ef4c-4fb0-8e7c-3b594c03f881 Sep 10 16:46:02 devstack sudo[97831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:02 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c.info Sep 10 16:46:02 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:02 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-84cd20fc-c010-45c9-ad17-debaf89c95d9 tempest-VolumesTransfersV355Test-1847733077 None] Transfer volume completed successfully. Sep 10 16:46:02 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9edb1c88-3dff-486e-a9b7-ed90e01e8a09 tempest-SnapshotMetadataTestJSON-1558203328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c.info" returned: 0 in 0.339s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:02 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-9edb1c88-3dff-486e-a9b7-ed90e01e8a09 tempest-SnapshotMetadataTestJSON-1558203328 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c.info is being set with open permissions: ugo+rw Sep 10 16:46:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9edb1c88-3dff-486e-a9b7-ed90e01e8a09 tempest-SnapshotMetadataTestJSON-1558203328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:02 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c.info Sep 10 16:46:02 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:02 devstack sudo[97831]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d333a5b4-b6a6-4f36-bc31-a996756016ea tempest-AttachVolumeTestJSON-265770916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-532bc876-ef4c-4fb0-8e7c-3b594c03f881" returned: 0 in 0.540s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d333a5b4-b6a6-4f36-bc31-a996756016ea tempest-AttachVolumeTestJSON-265770916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-532bc876-ef4c-4fb0-8e7c-3b594c03f881 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:02 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-532bc876-ef4c-4fb0-8e7c-3b594c03f881 Sep 10 16:46:02 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:03 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9edb1c88-3dff-486e-a9b7-ed90e01e8a09 tempest-SnapshotMetadataTestJSON-1558203328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c.info" returned: 0 in 0.277s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9edb1c88-3dff-486e-a9b7-ed90e01e8a09 tempest-SnapshotMetadataTestJSON-1558203328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.504s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:46:03 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-9edb1c88-3dff-486e-a9b7-ed90e01e8a09 tempest-SnapshotMetadataTestJSON-1558203328 None] Create snapshot completed successfully Sep 10 16:46:03 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d333a5b4-b6a6-4f36-bc31-a996756016ea tempest-AttachVolumeTestJSON-265770916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-532bc876-ef4c-4fb0-8e7c-3b594c03f881" returned: 0 in 0.358s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d333a5b4-b6a6-4f36-bc31-a996756016ea tempest-AttachVolumeTestJSON-265770916 None] Lock "cinder-quobyte-532bc876-ef4c-4fb0-8e7c-3b594c03f881" released by "delete_volume" :: held 0.972s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:46:03 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-d333a5b4-b6a6-4f36-bc31-a996756016ea tempest-AttachVolumeTestJSON-265770916 None] Created reservations ['2feda6c9-c736-4075-9d0a-fbe1f3bf4679', '4edfbbac-8da3-4c67-99e5-29bd08575e8e', 'd68ed9fe-80bb-4ee7-8e0f-36a4ef30e1e8', 'edeca3c3-be9f-4680-a4bf-c9aa1a54919e'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:46:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d333a5b4-b6a6-4f36-bc31-a996756016ea tempest-AttachVolumeTestJSON-265770916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:46:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d333a5b4-b6a6-4f36-bc31-a996756016ea tempest-AttachVolumeTestJSON-265770916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:46:03 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d333a5b4-b6a6-4f36-bc31-a996756016ea tempest-AttachVolumeTestJSON-265770916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:46:03 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d333a5b4-b6a6-4f36-bc31-a996756016ea tempest-AttachVolumeTestJSON-265770916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:46:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d333a5b4-b6a6-4f36-bc31-a996756016ea tempest-AttachVolumeTestJSON-265770916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:46:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d333a5b4-b6a6-4f36-bc31-a996756016ea tempest-AttachVolumeTestJSON-265770916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:03 devstack sudo[97876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:46:03 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-3b9039bb-87a6-4c8b-9d09-d01034af86a9 tempest-VolumesTransfersV355Test-717976653 None] Acquiring lock "cinder-f4700073-c291-43c2-a292-ccf1e13bd0b6-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:46:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-3b9039bb-87a6-4c8b-9d09-d01034af86a9 tempest-VolumesTransfersV355Test-717976653 None] Lock "cinder-f4700073-c291-43c2-a292-ccf1e13bd0b6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:46:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-3b9039bb-87a6-4c8b-9d09-d01034af86a9 tempest-VolumesTransfersV355Test-717976653 None] Acquiring lock "cinder-quobyte-f4700073-c291-43c2-a292-ccf1e13bd0b6" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:46:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-3b9039bb-87a6-4c8b-9d09-d01034af86a9 tempest-VolumesTransfersV355Test-717976653 None] Lock "cinder-quobyte-f4700073-c291-43c2-a292-ccf1e13bd0b6" acquired by "delete_volume" :: waited 0.019s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:46:03 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a5f8ed-1ace-45b8-a1ca-b6779d07f6bd]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:46:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3b9039bb-87a6-4c8b-9d09-d01034af86a9 tempest-VolumesTransfersV355Test-717976653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f4700073-c291-43c2-a292-ccf1e13bd0b6 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:03 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f4700073-c291-43c2-a292-ccf1e13bd0b6 Sep 10 16:46:03 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:03 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d333a5b4-b6a6-4f36-bc31-a996756016ea tempest-AttachVolumeTestJSON-265770916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.278s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:03 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-d333a5b4-b6a6-4f36-bc31-a996756016ea tempest-AttachVolumeTestJSON-265770916 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:46:03 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-d333a5b4-b6a6-4f36-bc31-a996756016ea tempest-AttachVolumeTestJSON-265770916 None] Deleted volume successfully. Sep 10 16:46:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d333a5b4-b6a6-4f36-bc31-a996756016ea tempest-AttachVolumeTestJSON-265770916 None] Lock "cinder-532bc876-ef4c-4fb0-8e7c-3b594c03f881-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:46:03 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3b9039bb-87a6-4c8b-9d09-d01034af86a9 tempest-VolumesTransfersV355Test-717976653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f4700073-c291-43c2-a292-ccf1e13bd0b6" returned: 0 in 0.412s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3b9039bb-87a6-4c8b-9d09-d01034af86a9 tempest-VolumesTransfersV355Test-717976653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f4700073-c291-43c2-a292-ccf1e13bd0b6 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:03 devstack sudo[97884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f4700073-c291-43c2-a292-ccf1e13bd0b6 Sep 10 16:46:03 devstack sudo[97884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:04 devstack sudo[97884]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:04 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4903300a-de99-4897-80b5-55f75e9a604a tempest-SnapshotMetadataTestJSON-1558203328 None] Acquiring lock "cinder-7acac2f5-86c1-48e1-9369-d00349281726-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:46:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3b9039bb-87a6-4c8b-9d09-d01034af86a9 tempest-VolumesTransfersV355Test-717976653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f4700073-c291-43c2-a292-ccf1e13bd0b6" returned: 0 in 0.273s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:04 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4903300a-de99-4897-80b5-55f75e9a604a tempest-SnapshotMetadataTestJSON-1558203328 None] Lock "cinder-7acac2f5-86c1-48e1-9369-d00349281726-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:46:04 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4903300a-de99-4897-80b5-55f75e9a604a tempest-SnapshotMetadataTestJSON-1558203328 None] Acquiring lock "cinder-quobyte-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:46:04 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-3b9039bb-87a6-4c8b-9d09-d01034af86a9 tempest-VolumesTransfersV355Test-717976653 None] Lock "cinder-quobyte-f4700073-c291-43c2-a292-ccf1e13bd0b6" released by "delete_volume" :: held 0.739s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:46:04 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4903300a-de99-4897-80b5-55f75e9a604a tempest-SnapshotMetadataTestJSON-1558203328 None] Lock "cinder-quobyte-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:46:04 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4903300a-de99-4897-80b5-55f75e9a604a tempest-SnapshotMetadataTestJSON-1558203328 None] Acquiring lock "cinder-quobyte-7acac2f5-86c1-48e1-9369-d00349281726" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:46:04 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4903300a-de99-4897-80b5-55f75e9a604a tempest-SnapshotMetadataTestJSON-1558203328 None] Lock "cinder-quobyte-7acac2f5-86c1-48e1-9369-d00349281726" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:46:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-4903300a-de99-4897-80b5-55f75e9a604a tempest-SnapshotMetadataTestJSON-1558203328 None] Deleting offline snapshot 7acac2f5-86c1-48e1-9369-d00349281726 of volume e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:46:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-4903300a-de99-4897-80b5-55f75e9a604a tempest-SnapshotMetadataTestJSON-1558203328 None] snapshot_file for this snap is: volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c.7acac2f5-86c1-48e1-9369-d00349281726 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:46:04 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[900ac9cc-da7c-4913-b6cf-9f1d45e6f960]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:46:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4903300a-de99-4897-80b5-55f75e9a604a tempest-SnapshotMetadataTestJSON-1558203328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c.7acac2f5-86c1-48e1-9369-d00349281726 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:04 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-3b9039bb-87a6-4c8b-9d09-d01034af86a9 tempest-VolumesTransfersV355Test-717976653 None] Created reservations ['00844abc-dcf7-4fef-a5ce-829161e56ab0', '4a3da760-ec66-4846-a3c2-8ceeac8e1310', '68b11b99-5058-4c91-88c9-661f529a00e5', '7512de06-527c-40d7-8a12-d76ece9bd375'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:46:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3b9039bb-87a6-4c8b-9d09-d01034af86a9 tempest-VolumesTransfersV355Test-717976653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:46:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3b9039bb-87a6-4c8b-9d09-d01034af86a9 tempest-VolumesTransfersV355Test-717976653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:46:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3b9039bb-87a6-4c8b-9d09-d01034af86a9 tempest-VolumesTransfersV355Test-717976653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:46:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3b9039bb-87a6-4c8b-9d09-d01034af86a9 tempest-VolumesTransfersV355Test-717976653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:46:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3b9039bb-87a6-4c8b-9d09-d01034af86a9 tempest-VolumesTransfersV355Test-717976653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:46:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3b9039bb-87a6-4c8b-9d09-d01034af86a9 tempest-VolumesTransfersV355Test-717976653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:04 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c.7acac2f5-86c1-48e1-9369-d00349281726 Sep 10 16:46:04 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:04 devstack sudo[97888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:46:04 devstack sudo[97888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:04 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2a2a5be6-3fd1-4cd9-9022-7a894fb744e8 tempest-AttachVolumeTestJSON-265770916 None] Acquiring lock "cinder-e67749ef-db7f-48c4-b683-338eab95fb96-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:46:04 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2a2a5be6-3fd1-4cd9-9022-7a894fb744e8 tempest-AttachVolumeTestJSON-265770916 None] Lock "cinder-e67749ef-db7f-48c4-b683-338eab95fb96-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:46:04 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2a2a5be6-3fd1-4cd9-9022-7a894fb744e8 tempest-AttachVolumeTestJSON-265770916 None] Acquiring lock "cinder-quobyte-e67749ef-db7f-48c4-b683-338eab95fb96" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:46:04 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2a2a5be6-3fd1-4cd9-9022-7a894fb744e8 tempest-AttachVolumeTestJSON-265770916 None] Lock "cinder-quobyte-e67749ef-db7f-48c4-b683-338eab95fb96" acquired by "delete_volume" :: waited 0.034s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:46:04 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[992f4c61-e3ac-43ac-bea0-d80d7beffe8e]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:46:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2a2a5be6-3fd1-4cd9-9022-7a894fb744e8 tempest-AttachVolumeTestJSON-265770916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e67749ef-db7f-48c4-b683-338eab95fb96 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:04 devstack sudo[97891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e67749ef-db7f-48c4-b683-338eab95fb96 Sep 10 16:46:04 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:04 devstack sudo[97888]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3b9039bb-87a6-4c8b-9d09-d01034af86a9 tempest-VolumesTransfersV355Test-717976653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.335s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:04 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-3b9039bb-87a6-4c8b-9d09-d01034af86a9 tempest-VolumesTransfersV355Test-717976653 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:46:04 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:04 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-3b9039bb-87a6-4c8b-9d09-d01034af86a9 tempest-VolumesTransfersV355Test-717976653 None] Deleted volume successfully. Sep 10 16:46:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4903300a-de99-4897-80b5-55f75e9a604a tempest-SnapshotMetadataTestJSON-1558203328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c.7acac2f5-86c1-48e1-9369-d00349281726" returned: 0 in 0.454s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-4903300a-de99-4897-80b5-55f75e9a604a tempest-SnapshotMetadataTestJSON-1558203328 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:46:04 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c115c6e8-557c-443d-b474-1629186fa52d]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:46:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4903300a-de99-4897-80b5-55f75e9a604a tempest-SnapshotMetadataTestJSON-1558203328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:04 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-3b9039bb-87a6-4c8b-9d09-d01034af86a9 tempest-VolumesTransfersV355Test-717976653 None] Lock "cinder-f4700073-c291-43c2-a292-ccf1e13bd0b6-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:46:04 devstack sudo[97898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c Sep 10 16:46:04 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:05 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2a2a5be6-3fd1-4cd9-9022-7a894fb744e8 tempest-AttachVolumeTestJSON-265770916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e67749ef-db7f-48c4-b683-338eab95fb96" returned: 0 in 0.419s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2a2a5be6-3fd1-4cd9-9022-7a894fb744e8 tempest-AttachVolumeTestJSON-265770916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e67749ef-db7f-48c4-b683-338eab95fb96 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:05 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e67749ef-db7f-48c4-b683-338eab95fb96 Sep 10 16:46:05 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffced267-3ff5-46ae-997a-389b2caec315 tempest-VolumesTransfersV355Test-2138077738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ffced267-3ff5-46ae-997a-389b2caec315 tempest-VolumesTransfersV355Test-2138077738 None] Flow 'volume_create_manager' (a5f84bea-ed54-467a-9b5c-45840d6c96f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:46:05 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ffced267-3ff5-46ae-997a-389b2caec315 tempest-VolumesTransfersV355Test-2138077738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d894b764-837d-44c0-b45e-fee594d6759b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4903300a-de99-4897-80b5-55f75e9a604a tempest-SnapshotMetadataTestJSON-1558203328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c" returned: 0 in 0.429s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4903300a-de99-4897-80b5-55f75e9a604a tempest-SnapshotMetadataTestJSON-1558203328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c.7acac2f5-86c1-48e1-9369-d00349281726 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ffced267-3ff5-46ae-997a-389b2caec315 tempest-VolumesTransfersV355Test-2138077738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d894b764-837d-44c0-b45e-fee594d6759b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-760232718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5727d06-e36d-4f20-8562-50c9214c1cf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3799b52ed6454602a09d93e298908212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:46:05Z,use_quota=True,user_id='3a7ea39753144be79d7f82708beeada4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:05 devstack sudo[97908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c.7acac2f5-86c1-48e1-9369-d00349281726 Sep 10 16:46:05 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ffced267-3ff5-46ae-997a-389b2caec315 tempest-VolumesTransfersV355Test-2138077738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f63458a5-9740-4e52-a319-8b4a084ab653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ffced267-3ff5-46ae-997a-389b2caec315 tempest-VolumesTransfersV355Test-2138077738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f63458a5-9740-4e52-a319-8b4a084ab653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ffced267-3ff5-46ae-997a-389b2caec315 tempest-VolumesTransfersV355Test-2138077738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b594ed00-e44f-4bea-9c78-4b769195a005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ffced267-3ff5-46ae-997a-389b2caec315 tempest-VolumesTransfersV355Test-2138077738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b594ed00-e44f-4bea-9c78-4b769195a005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5727d06-e36d-4f20-8562-50c9214c1cf0', 'volume_name': 'volume-f5727d06-e36d-4f20-8562-50c9214c1cf0', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ffced267-3ff5-46ae-997a-389b2caec315 tempest-VolumesTransfersV355Test-2138077738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d4c974c-6e7a-43ab-a8a6-106971dc9c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ffced267-3ff5-46ae-997a-389b2caec315 tempest-VolumesTransfersV355Test-2138077738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d4c974c-6e7a-43ab-a8a6-106971dc9c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ffced267-3ff5-46ae-997a-389b2caec315 tempest-VolumesTransfersV355Test-2138077738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c579051c-5cac-4c7e-8023-83560add5b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:05 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-ffced267-3ff5-46ae-997a-389b2caec315 tempest-VolumesTransfersV355Test-2138077738 None] Volume f5727d06-e36d-4f20-8562-50c9214c1cf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5727d06-e36d-4f20-8562-50c9214c1cf0', 'volume_size': 1} Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ffced267-3ff5-46ae-997a-389b2caec315 tempest-VolumesTransfersV355Test-2138077738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:46:05 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ffced267-3ff5-46ae-997a-389b2caec315 tempest-VolumesTransfersV355Test-2138077738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ffced267-3ff5-46ae-997a-389b2caec315 tempest-VolumesTransfersV355Test-2138077738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-760232718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5727d06-e36d-4f20-8562-50c9214c1cf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3799b52ed6454602a09d93e298908212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:46:05Z,use_quota=True,user_id='3a7ea39753144be79d7f82708beeada4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-ffced267-3ff5-46ae-997a-389b2caec315 tempest-VolumesTransfersV355Test-2138077738 None] Creating volume f5727d06-e36d-4f20-8562-50c9214c1cf0 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ffced267-3ff5-46ae-997a-389b2caec315 tempest-VolumesTransfersV355Test-2138077738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ffced267-3ff5-46ae-997a-389b2caec315 tempest-VolumesTransfersV355Test-2138077738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ffced267-3ff5-46ae-997a-389b2caec315 tempest-VolumesTransfersV355Test-2138077738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ffced267-3ff5-46ae-997a-389b2caec315 tempest-VolumesTransfersV355Test-2138077738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ffced267-3ff5-46ae-997a-389b2caec315 tempest-VolumesTransfersV355Test-2138077738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ffced267-3ff5-46ae-997a-389b2caec315 tempest-VolumesTransfersV355Test-2138077738 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:46:05 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-ffced267-3ff5-46ae-997a-389b2caec315 tempest-VolumesTransfersV355Test-2138077738 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ffced267-3ff5-46ae-997a-389b2caec315 tempest-VolumesTransfersV355Test-2138077738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f5727d06-e36d-4f20-8562-50c9214c1cf0 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2a2a5be6-3fd1-4cd9-9022-7a894fb744e8 tempest-AttachVolumeTestJSON-265770916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e67749ef-db7f-48c4-b683-338eab95fb96" returned: 0 in 0.305s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2a2a5be6-3fd1-4cd9-9022-7a894fb744e8 tempest-AttachVolumeTestJSON-265770916 None] Lock "cinder-quobyte-e67749ef-db7f-48c4-b683-338eab95fb96" released by "delete_volume" :: held 0.786s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:46:05 devstack sudo[97911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f5727d06-e36d-4f20-8562-50c9214c1cf0 1073741824 Sep 10 16:46:05 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-2a2a5be6-3fd1-4cd9-9022-7a894fb744e8 tempest-AttachVolumeTestJSON-265770916 None] Created reservations ['0de0faa8-d00e-4b8c-a0e7-c7dd454ec29f', '33ed048d-ddf8-4533-a599-24771d383848', '7d5754ad-0f64-462e-a044-1b72e4073964', '99d5547f-936d-4561-a145-c9fcc95c4f02'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2a2a5be6-3fd1-4cd9-9022-7a894fb744e8 tempest-AttachVolumeTestJSON-265770916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2a2a5be6-3fd1-4cd9-9022-7a894fb744e8 tempest-AttachVolumeTestJSON-265770916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-2a2a5be6-3fd1-4cd9-9022-7a894fb744e8 tempest-AttachVolumeTestJSON-265770916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-2a2a5be6-3fd1-4cd9-9022-7a894fb744e8 tempest-AttachVolumeTestJSON-265770916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2a2a5be6-3fd1-4cd9-9022-7a894fb744e8 tempest-AttachVolumeTestJSON-265770916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2a2a5be6-3fd1-4cd9-9022-7a894fb744e8 tempest-AttachVolumeTestJSON-265770916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:05 devstack sudo[97913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:46:05 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:05 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4903300a-de99-4897-80b5-55f75e9a604a tempest-SnapshotMetadataTestJSON-1558203328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c.7acac2f5-86c1-48e1-9369-d00349281726" returned: 0 in 0.402s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4903300a-de99-4897-80b5-55f75e9a604a tempest-SnapshotMetadataTestJSON-1558203328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c.7acac2f5-86c1-48e1-9369-d00349281726 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:05 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c.7acac2f5-86c1-48e1-9369-d00349281726 Sep 10 16:46:05 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:05 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2a2a5be6-3fd1-4cd9-9022-7a894fb744e8 tempest-AttachVolumeTestJSON-265770916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.288s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-2a2a5be6-3fd1-4cd9-9022-7a894fb744e8 tempest-AttachVolumeTestJSON-265770916 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:46:05 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-2a2a5be6-3fd1-4cd9-9022-7a894fb744e8 tempest-AttachVolumeTestJSON-265770916 None] Deleted volume successfully. Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2a2a5be6-3fd1-4cd9-9022-7a894fb744e8 tempest-AttachVolumeTestJSON-265770916 None] Lock "cinder-e67749ef-db7f-48c4-b683-338eab95fb96-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:46:05 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ffced267-3ff5-46ae-997a-389b2caec315 tempest-VolumesTransfersV355Test-2138077738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f5727d06-e36d-4f20-8562-50c9214c1cf0 1073741824" returned: 0 in 0.534s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ffced267-3ff5-46ae-997a-389b2caec315 tempest-VolumesTransfersV355Test-2138077738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f5727d06-e36d-4f20-8562-50c9214c1cf0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:05 devstack sudo[97926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f5727d06-e36d-4f20-8562-50c9214c1cf0 Sep 10 16:46:05 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:05 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4903300a-de99-4897-80b5-55f75e9a604a tempest-SnapshotMetadataTestJSON-1558203328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c.7acac2f5-86c1-48e1-9369-d00349281726" returned: 0 in 0.311s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:05 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4903300a-de99-4897-80b5-55f75e9a604a tempest-SnapshotMetadataTestJSON-1558203328 None] Lock "cinder-quobyte-7acac2f5-86c1-48e1-9369-d00349281726" released by "_delete_snapshot" :: held 1.727s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:46:06 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4903300a-de99-4897-80b5-55f75e9a604a tempest-SnapshotMetadataTestJSON-1558203328 None] Lock "cinder-quobyte-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c" released by "delete_snapshot" :: held 1.755s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:46:06 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-4903300a-de99-4897-80b5-55f75e9a604a tempest-SnapshotMetadataTestJSON-1558203328 None] Created reservations ['23bf69a2-c888-4901-89c2-20e23e9d2c5d', 'edbd3d84-46ea-40fb-8bcc-a92f9a1c633c', '5279f171-bddc-4a99-84a1-61e25e5915ee', '10d0fa2e-7df0-4712-8bca-3ba5ce71bd58'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:46:06 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-4903300a-de99-4897-80b5-55f75e9a604a tempest-SnapshotMetadataTestJSON-1558203328 None] Delete snapshot completed successfully. Sep 10 16:46:06 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4903300a-de99-4897-80b5-55f75e9a604a tempest-SnapshotMetadataTestJSON-1558203328 None] Lock "cinder-7acac2f5-86c1-48e1-9369-d00349281726-delete_snapshot" released by "delete_snapshot" :: held 1.934s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:46:06 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ffced267-3ff5-46ae-997a-389b2caec315 tempest-VolumesTransfersV355Test-2138077738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f5727d06-e36d-4f20-8562-50c9214c1cf0" returned: 0 in 0.303s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:06 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ffced267-3ff5-46ae-997a-389b2caec315 tempest-VolumesTransfersV355Test-2138077738 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:46:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ffced267-3ff5-46ae-997a-389b2caec315 tempest-VolumesTransfersV355Test-2138077738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:46:06 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ffced267-3ff5-46ae-997a-389b2caec315 tempest-VolumesTransfersV355Test-2138077738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c579051c-5cac-4c7e-8023-83560add5b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5727d06-e36d-4f20-8562-50c9214c1cf0', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:06 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ffced267-3ff5-46ae-997a-389b2caec315 tempest-VolumesTransfersV355Test-2138077738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35ceb0b7-5588-4a1a-9457-d77baecdebfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:06 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-ffced267-3ff5-46ae-997a-389b2caec315 tempest-VolumesTransfersV355Test-2138077738 None] Volume volume-f5727d06-e36d-4f20-8562-50c9214c1cf0 (f5727d06-e36d-4f20-8562-50c9214c1cf0): created successfully Sep 10 16:46:06 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ffced267-3ff5-46ae-997a-389b2caec315 tempest-VolumesTransfersV355Test-2138077738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35ceb0b7-5588-4a1a-9457-d77baecdebfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:06 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ffced267-3ff5-46ae-997a-389b2caec315 tempest-VolumesTransfersV355Test-2138077738 None] Flow 'volume_create_manager' (a5f84bea-ed54-467a-9b5c-45840d6c96f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:46:06 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-ffced267-3ff5-46ae-997a-389b2caec315 tempest-VolumesTransfersV355Test-2138077738 None] Created volume successfully. Sep 10 16:46:06 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c6262c5d-bf23-4b73-b4e5-76420649f012 tempest-SnapshotMetadataTestJSON-1558203328 None] Acquiring lock "cinder-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:46:06 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c6262c5d-bf23-4b73-b4e5-76420649f012 tempest-SnapshotMetadataTestJSON-1558203328 None] Lock "cinder-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:46:06 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c6262c5d-bf23-4b73-b4e5-76420649f012 tempest-SnapshotMetadataTestJSON-1558203328 None] Acquiring lock "cinder-quobyte-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:46:06 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c6262c5d-bf23-4b73-b4e5-76420649f012 tempest-SnapshotMetadataTestJSON-1558203328 None] Lock "cinder-quobyte-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c" acquired by "delete_volume" :: waited 0.015s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:46:06 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0946d8c4-c013-4f4e-93d4-aa9159165ff3]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:46:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c6262c5d-bf23-4b73-b4e5-76420649f012 tempest-SnapshotMetadataTestJSON-1558203328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:06 devstack sudo[97930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c Sep 10 16:46:06 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:06 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c6262c5d-bf23-4b73-b4e5-76420649f012 tempest-SnapshotMetadataTestJSON-1558203328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c" returned: 0 in 0.365s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c6262c5d-bf23-4b73-b4e5-76420649f012 tempest-SnapshotMetadataTestJSON-1558203328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:06 devstack sudo[97935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c Sep 10 16:46:06 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:07 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c6262c5d-bf23-4b73-b4e5-76420649f012 tempest-SnapshotMetadataTestJSON-1558203328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c" returned: 0 in 0.255s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:07 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c6262c5d-bf23-4b73-b4e5-76420649f012 tempest-SnapshotMetadataTestJSON-1558203328 None] Lock "cinder-quobyte-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c" released by "delete_volume" :: held 0.686s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:46:07 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-c6262c5d-bf23-4b73-b4e5-76420649f012 tempest-SnapshotMetadataTestJSON-1558203328 None] Created reservations ['f54625dc-65f7-41b4-af28-19f1b82f215d', 'b13c30e0-7087-474e-9d11-4ab4f1f1dd73', '5ec11de6-969c-485d-92b9-bb071a497954', '933afbad-69cc-4c50-9167-77b7f55ecab7'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:46:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c6262c5d-bf23-4b73-b4e5-76420649f012 tempest-SnapshotMetadataTestJSON-1558203328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:46:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c6262c5d-bf23-4b73-b4e5-76420649f012 tempest-SnapshotMetadataTestJSON-1558203328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:46:07 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c6262c5d-bf23-4b73-b4e5-76420649f012 tempest-SnapshotMetadataTestJSON-1558203328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:46:07 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c6262c5d-bf23-4b73-b4e5-76420649f012 tempest-SnapshotMetadataTestJSON-1558203328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:46:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c6262c5d-bf23-4b73-b4e5-76420649f012 tempest-SnapshotMetadataTestJSON-1558203328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:46:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c6262c5d-bf23-4b73-b4e5-76420649f012 tempest-SnapshotMetadataTestJSON-1558203328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:07 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:46:07 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:07 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c6262c5d-bf23-4b73-b4e5-76420649f012 tempest-SnapshotMetadataTestJSON-1558203328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.273s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:07 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-c6262c5d-bf23-4b73-b4e5-76420649f012 tempest-SnapshotMetadataTestJSON-1558203328 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:46:07 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-c6262c5d-bf23-4b73-b4e5-76420649f012 tempest-SnapshotMetadataTestJSON-1558203328 None] Deleted volume successfully. Sep 10 16:46:07 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c6262c5d-bf23-4b73-b4e5-76420649f012 tempest-SnapshotMetadataTestJSON-1558203328 None] Lock "cinder-e1f7a640-cc59-4d1b-8c5a-e5d2fa51915c-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:46:07 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-661b6a04-6ea2-4a23-b883-8668c48506c5 tempest-VolumesTransfersV355Test-717976653 None] Acquiring lock "cinder-f5727d06-e36d-4f20-8562-50c9214c1cf0-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:46:07 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-661b6a04-6ea2-4a23-b883-8668c48506c5 tempest-VolumesTransfersV355Test-717976653 None] Lock "cinder-f5727d06-e36d-4f20-8562-50c9214c1cf0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:46:07 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-661b6a04-6ea2-4a23-b883-8668c48506c5 tempest-VolumesTransfersV355Test-717976653 None] Acquiring lock "cinder-quobyte-f5727d06-e36d-4f20-8562-50c9214c1cf0" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:46:07 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-661b6a04-6ea2-4a23-b883-8668c48506c5 tempest-VolumesTransfersV355Test-717976653 None] Lock "cinder-quobyte-f5727d06-e36d-4f20-8562-50c9214c1cf0" acquired by "delete_volume" :: waited 0.017s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:46:07 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cab268-8e2c-43b8-9175-5058a0e48a5b]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:46:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-661b6a04-6ea2-4a23-b883-8668c48506c5 tempest-VolumesTransfersV355Test-717976653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f5727d06-e36d-4f20-8562-50c9214c1cf0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:07 devstack sudo[97942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f5727d06-e36d-4f20-8562-50c9214c1cf0 Sep 10 16:46:07 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:08 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-661b6a04-6ea2-4a23-b883-8668c48506c5 tempest-VolumesTransfersV355Test-717976653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f5727d06-e36d-4f20-8562-50c9214c1cf0" returned: 0 in 0.430s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-661b6a04-6ea2-4a23-b883-8668c48506c5 tempest-VolumesTransfersV355Test-717976653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f5727d06-e36d-4f20-8562-50c9214c1cf0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:08 devstack sudo[97947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f5727d06-e36d-4f20-8562-50c9214c1cf0 Sep 10 16:46:08 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:08 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-661b6a04-6ea2-4a23-b883-8668c48506c5 tempest-VolumesTransfersV355Test-717976653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f5727d06-e36d-4f20-8562-50c9214c1cf0" returned: 0 in 0.296s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:08 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-661b6a04-6ea2-4a23-b883-8668c48506c5 tempest-VolumesTransfersV355Test-717976653 None] Lock "cinder-quobyte-f5727d06-e36d-4f20-8562-50c9214c1cf0" released by "delete_volume" :: held 0.772s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:46:08 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-661b6a04-6ea2-4a23-b883-8668c48506c5 tempest-VolumesTransfersV355Test-717976653 None] Created reservations ['709d5a6f-0a2c-47a8-a0ba-6f88a9e46118', '3780f585-9cc8-4a19-b85c-0569e0a22fbd', '54324396-ed24-40b0-a6f9-abd26f664269', 'b8b8a179-aab4-4ef4-8c04-a564961dfda2'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:46:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-661b6a04-6ea2-4a23-b883-8668c48506c5 tempest-VolumesTransfersV355Test-717976653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:46:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-661b6a04-6ea2-4a23-b883-8668c48506c5 tempest-VolumesTransfersV355Test-717976653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:46:08 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-661b6a04-6ea2-4a23-b883-8668c48506c5 tempest-VolumesTransfersV355Test-717976653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:46:08 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-661b6a04-6ea2-4a23-b883-8668c48506c5 tempest-VolumesTransfersV355Test-717976653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:46:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-661b6a04-6ea2-4a23-b883-8668c48506c5 tempest-VolumesTransfersV355Test-717976653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:46:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-661b6a04-6ea2-4a23-b883-8668c48506c5 tempest-VolumesTransfersV355Test-717976653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:08 devstack sudo[97950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:46:08 devstack sudo[97950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:08 devstack sudo[97950]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-661b6a04-6ea2-4a23-b883-8668c48506c5 tempest-VolumesTransfersV355Test-717976653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.259s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:08 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-661b6a04-6ea2-4a23-b883-8668c48506c5 tempest-VolumesTransfersV355Test-717976653 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:46:08 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-661b6a04-6ea2-4a23-b883-8668c48506c5 tempest-VolumesTransfersV355Test-717976653 None] Deleted volume successfully. Sep 10 16:46:08 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-661b6a04-6ea2-4a23-b883-8668c48506c5 tempest-VolumesTransfersV355Test-717976653 None] Lock "cinder-f5727d06-e36d-4f20-8562-50c9214c1cf0-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:46:13 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-50bf2d84-0c14-426c-a106-5f329b8f57a2 tempest-AbsoluteLimitsTests-813074444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:46:14 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-50bf2d84-0c14-426c-a106-5f329b8f57a2 tempest-AbsoluteLimitsTests-813074444 None] Flow 'volume_create_manager' (678aded0-2eb0-4ca4-9876-aef140f16821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:46:14 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-50bf2d84-0c14-426c-a106-5f329b8f57a2 tempest-AbsoluteLimitsTests-813074444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (118ede1b-1bec-4376-a462-6d5eb751530f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:14 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-50bf2d84-0c14-426c-a106-5f329b8f57a2 tempest-AbsoluteLimitsTests-813074444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (118ede1b-1bec-4376-a462-6d5eb751530f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1218645722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d2960bd-6e36-4477-8109-c391511258e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a69b725ba80340ae8cd2208afb7ce09f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:46:14Z,use_quota=True,user_id='3de10bb0a8324d10a5f8708be2e8d444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:14 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-50bf2d84-0c14-426c-a106-5f329b8f57a2 tempest-AbsoluteLimitsTests-813074444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (125bb026-2a0f-4432-ae01-1481284a7a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:14 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-50bf2d84-0c14-426c-a106-5f329b8f57a2 tempest-AbsoluteLimitsTests-813074444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (125bb026-2a0f-4432-ae01-1481284a7a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:14 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-50bf2d84-0c14-426c-a106-5f329b8f57a2 tempest-AbsoluteLimitsTests-813074444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae8ead2-eacb-443a-aabc-1668b7b6cd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:14 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-50bf2d84-0c14-426c-a106-5f329b8f57a2 tempest-AbsoluteLimitsTests-813074444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae8ead2-eacb-443a-aabc-1668b7b6cd72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d2960bd-6e36-4477-8109-c391511258e4', 'volume_name': 'volume-1d2960bd-6e36-4477-8109-c391511258e4', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:14 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-50bf2d84-0c14-426c-a106-5f329b8f57a2 tempest-AbsoluteLimitsTests-813074444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4406df8-7688-464c-9d35-709d3f915c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:14 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-50bf2d84-0c14-426c-a106-5f329b8f57a2 tempest-AbsoluteLimitsTests-813074444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4406df8-7688-464c-9d35-709d3f915c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:14 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-50bf2d84-0c14-426c-a106-5f329b8f57a2 tempest-AbsoluteLimitsTests-813074444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096885c4-d6b3-43d0-8429-28f9e7c363ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:14 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-50bf2d84-0c14-426c-a106-5f329b8f57a2 tempest-AbsoluteLimitsTests-813074444 None] Volume 1d2960bd-6e36-4477-8109-c391511258e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d2960bd-6e36-4477-8109-c391511258e4', 'volume_size': 1} Sep 10 16:46:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-50bf2d84-0c14-426c-a106-5f329b8f57a2 tempest-AbsoluteLimitsTests-813074444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:46:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-50bf2d84-0c14-426c-a106-5f329b8f57a2 tempest-AbsoluteLimitsTests-813074444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:46:14 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-50bf2d84-0c14-426c-a106-5f329b8f57a2 tempest-AbsoluteLimitsTests-813074444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1218645722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d2960bd-6e36-4477-8109-c391511258e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a69b725ba80340ae8cd2208afb7ce09f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:46:14Z,use_quota=True,user_id='3de10bb0a8324d10a5f8708be2e8d444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:46:14 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-50bf2d84-0c14-426c-a106-5f329b8f57a2 tempest-AbsoluteLimitsTests-813074444 None] Creating volume 1d2960bd-6e36-4477-8109-c391511258e4 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:46:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-50bf2d84-0c14-426c-a106-5f329b8f57a2 tempest-AbsoluteLimitsTests-813074444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:46:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-50bf2d84-0c14-426c-a106-5f329b8f57a2 tempest-AbsoluteLimitsTests-813074444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:46:14 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-50bf2d84-0c14-426c-a106-5f329b8f57a2 tempest-AbsoluteLimitsTests-813074444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:46:14 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-50bf2d84-0c14-426c-a106-5f329b8f57a2 tempest-AbsoluteLimitsTests-813074444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:46:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-50bf2d84-0c14-426c-a106-5f329b8f57a2 tempest-AbsoluteLimitsTests-813074444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:46:14 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-50bf2d84-0c14-426c-a106-5f329b8f57a2 tempest-AbsoluteLimitsTests-813074444 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:46:14 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-50bf2d84-0c14-426c-a106-5f329b8f57a2 tempest-AbsoluteLimitsTests-813074444 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:46:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-50bf2d84-0c14-426c-a106-5f329b8f57a2 tempest-AbsoluteLimitsTests-813074444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1d2960bd-6e36-4477-8109-c391511258e4 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:14 devstack sudo[97991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1d2960bd-6e36-4477-8109-c391511258e4 1073741824 Sep 10 16:46:14 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:14 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-50bf2d84-0c14-426c-a106-5f329b8f57a2 tempest-AbsoluteLimitsTests-813074444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1d2960bd-6e36-4477-8109-c391511258e4 1073741824" returned: 0 in 0.483s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-50bf2d84-0c14-426c-a106-5f329b8f57a2 tempest-AbsoluteLimitsTests-813074444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1d2960bd-6e36-4477-8109-c391511258e4 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:14 devstack sudo[97997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1d2960bd-6e36-4477-8109-c391511258e4 Sep 10 16:46:14 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:15 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-50bf2d84-0c14-426c-a106-5f329b8f57a2 tempest-AbsoluteLimitsTests-813074444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1d2960bd-6e36-4477-8109-c391511258e4" returned: 0 in 0.378s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-50bf2d84-0c14-426c-a106-5f329b8f57a2 tempest-AbsoluteLimitsTests-813074444 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:46:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-50bf2d84-0c14-426c-a106-5f329b8f57a2 tempest-AbsoluteLimitsTests-813074444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:46:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-50bf2d84-0c14-426c-a106-5f329b8f57a2 tempest-AbsoluteLimitsTests-813074444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096885c4-d6b3-43d0-8429-28f9e7c363ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d2960bd-6e36-4477-8109-c391511258e4', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-50bf2d84-0c14-426c-a106-5f329b8f57a2 tempest-AbsoluteLimitsTests-813074444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a001e209-f331-4193-93c4-61ba135df448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:15 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-50bf2d84-0c14-426c-a106-5f329b8f57a2 tempest-AbsoluteLimitsTests-813074444 None] Volume volume-1d2960bd-6e36-4477-8109-c391511258e4 (1d2960bd-6e36-4477-8109-c391511258e4): created successfully Sep 10 16:46:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-50bf2d84-0c14-426c-a106-5f329b8f57a2 tempest-AbsoluteLimitsTests-813074444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a001e209-f331-4193-93c4-61ba135df448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-50bf2d84-0c14-426c-a106-5f329b8f57a2 tempest-AbsoluteLimitsTests-813074444 None] Flow 'volume_create_manager' (678aded0-2eb0-4ca4-9876-aef140f16821) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:46:15 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-50bf2d84-0c14-426c-a106-5f329b8f57a2 tempest-AbsoluteLimitsTests-813074444 None] Created volume successfully. Sep 10 16:46:15 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-36dce3d7-1a78-415d-a5cc-e49e887c8a13 tempest-AttachVolumeNegativeTest-74284645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:46:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-36dce3d7-1a78-415d-a5cc-e49e887c8a13 tempest-AttachVolumeNegativeTest-74284645 None] Flow 'volume_create_manager' (7f0f4b12-d7c0-417a-a1fd-0ef11862eb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:46:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-36dce3d7-1a78-415d-a5cc-e49e887c8a13 tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49a1fa10-0c49-4fa3-873d-526f89724e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-36dce3d7-1a78-415d-a5cc-e49e887c8a13 tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49a1fa10-0c49-4fa3-873d-526f89724e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-918678413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69795769-1c29-4f4b-9db8-82cfdeb53b11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e484ed10f924a7692981c4942bab1ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:46:15Z,use_quota=True,user_id='5cd571733ed54e5bb97da86075b3900b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-36dce3d7-1a78-415d-a5cc-e49e887c8a13 tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (363b9cc5-0a76-4b96-8a63-6a34bb6213c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-36dce3d7-1a78-415d-a5cc-e49e887c8a13 tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (363b9cc5-0a76-4b96-8a63-6a34bb6213c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-36dce3d7-1a78-415d-a5cc-e49e887c8a13 tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5be0dcd-ad5a-4096-96ca-a47b07bd04ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-36dce3d7-1a78-415d-a5cc-e49e887c8a13 tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5be0dcd-ad5a-4096-96ca-a47b07bd04ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69795769-1c29-4f4b-9db8-82cfdeb53b11', 'volume_name': 'volume-69795769-1c29-4f4b-9db8-82cfdeb53b11', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-36dce3d7-1a78-415d-a5cc-e49e887c8a13 tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52dbad73-4479-43b3-a5d5-a2f50dd3099c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-36dce3d7-1a78-415d-a5cc-e49e887c8a13 tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52dbad73-4479-43b3-a5d5-a2f50dd3099c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-36dce3d7-1a78-415d-a5cc-e49e887c8a13 tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba256f3-2001-4d46-9efd-36203a22845f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:15 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-36dce3d7-1a78-415d-a5cc-e49e887c8a13 tempest-AttachVolumeNegativeTest-74284645 None] Volume 69795769-1c29-4f4b-9db8-82cfdeb53b11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69795769-1c29-4f4b-9db8-82cfdeb53b11', 'volume_size': 1} Sep 10 16:46:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-36dce3d7-1a78-415d-a5cc-e49e887c8a13 tempest-AttachVolumeNegativeTest-74284645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:46:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-36dce3d7-1a78-415d-a5cc-e49e887c8a13 tempest-AttachVolumeNegativeTest-74284645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:46:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-36dce3d7-1a78-415d-a5cc-e49e887c8a13 tempest-AttachVolumeNegativeTest-74284645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-918678413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69795769-1c29-4f4b-9db8-82cfdeb53b11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e484ed10f924a7692981c4942bab1ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:46:15Z,use_quota=True,user_id='5cd571733ed54e5bb97da86075b3900b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:46:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-36dce3d7-1a78-415d-a5cc-e49e887c8a13 tempest-AttachVolumeNegativeTest-74284645 None] Creating volume 69795769-1c29-4f4b-9db8-82cfdeb53b11 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:46:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-36dce3d7-1a78-415d-a5cc-e49e887c8a13 tempest-AttachVolumeNegativeTest-74284645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:46:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-36dce3d7-1a78-415d-a5cc-e49e887c8a13 tempest-AttachVolumeNegativeTest-74284645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:46:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-36dce3d7-1a78-415d-a5cc-e49e887c8a13 tempest-AttachVolumeNegativeTest-74284645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:46:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-36dce3d7-1a78-415d-a5cc-e49e887c8a13 tempest-AttachVolumeNegativeTest-74284645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:46:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-36dce3d7-1a78-415d-a5cc-e49e887c8a13 tempest-AttachVolumeNegativeTest-74284645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:46:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-36dce3d7-1a78-415d-a5cc-e49e887c8a13 tempest-AttachVolumeNegativeTest-74284645 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:46:15 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-36dce3d7-1a78-415d-a5cc-e49e887c8a13 tempest-AttachVolumeNegativeTest-74284645 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:46:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-36dce3d7-1a78-415d-a5cc-e49e887c8a13 tempest-AttachVolumeNegativeTest-74284645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-69795769-1c29-4f4b-9db8-82cfdeb53b11 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:15 devstack sudo[98002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-69795769-1c29-4f4b-9db8-82cfdeb53b11 1073741824 Sep 10 16:46:15 devstack sudo[98002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ea060ad3-21bf-47be-8101-a09644e67ade tempest-BackendsCapabilitiesAdminTestsJSON-2099155018 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1032371520996, 'free_capacity_gb': 1773.1032371520996, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88189) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 10 16:46:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-383b1974-cce6-4409-8130-da334778102c tempest-BackendsCapabilitiesAdminTestsJSON-2099155018 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1032371520996, 'free_capacity_gb': 1773.1032371520996, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88189) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 10 16:46:16 devstack sudo[98002]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-36dce3d7-1a78-415d-a5cc-e49e887c8a13 tempest-AttachVolumeNegativeTest-74284645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-69795769-1c29-4f4b-9db8-82cfdeb53b11 1073741824" returned: 0 in 0.550s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-36dce3d7-1a78-415d-a5cc-e49e887c8a13 tempest-AttachVolumeNegativeTest-74284645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-69795769-1c29-4f4b-9db8-82cfdeb53b11 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:16 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-69795769-1c29-4f4b-9db8-82cfdeb53b11 Sep 10 16:46:16 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:16 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-36dce3d7-1a78-415d-a5cc-e49e887c8a13 tempest-AttachVolumeNegativeTest-74284645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-69795769-1c29-4f4b-9db8-82cfdeb53b11" returned: 0 in 0.324s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-36dce3d7-1a78-415d-a5cc-e49e887c8a13 tempest-AttachVolumeNegativeTest-74284645 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:46:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-36dce3d7-1a78-415d-a5cc-e49e887c8a13 tempest-AttachVolumeNegativeTest-74284645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:46:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-36dce3d7-1a78-415d-a5cc-e49e887c8a13 tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba256f3-2001-4d46-9efd-36203a22845f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69795769-1c29-4f4b-9db8-82cfdeb53b11', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-36dce3d7-1a78-415d-a5cc-e49e887c8a13 tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c38bd76-8a71-47e6-9f14-ab07f8e038e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:16 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-36dce3d7-1a78-415d-a5cc-e49e887c8a13 tempest-AttachVolumeNegativeTest-74284645 None] Volume volume-69795769-1c29-4f4b-9db8-82cfdeb53b11 (69795769-1c29-4f4b-9db8-82cfdeb53b11): created successfully Sep 10 16:46:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-36dce3d7-1a78-415d-a5cc-e49e887c8a13 tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c38bd76-8a71-47e6-9f14-ab07f8e038e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-36dce3d7-1a78-415d-a5cc-e49e887c8a13 tempest-AttachVolumeNegativeTest-74284645 None] Flow 'volume_create_manager' (7f0f4b12-d7c0-417a-a1fd-0ef11862eb62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:46:16 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-36dce3d7-1a78-415d-a5cc-e49e887c8a13 tempest-AttachVolumeNegativeTest-74284645 None] Created volume successfully. Sep 10 16:46:16 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-629ea11c-afae-43c7-ba9e-0b0d0fc02a0f tempest-AbsoluteLimitsTests-813074444 None] Acquiring lock "cinder-1d2960bd-6e36-4477-8109-c391511258e4-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:46:16 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-629ea11c-afae-43c7-ba9e-0b0d0fc02a0f tempest-AbsoluteLimitsTests-813074444 None] Lock "cinder-1d2960bd-6e36-4477-8109-c391511258e4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:46:16 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c7cd2a4-7b74-4205-af7d-cf1b8272c336 tempest-VolumesCloneTest-778544114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:46:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5c7cd2a4-7b74-4205-af7d-cf1b8272c336 tempest-VolumesCloneTest-778544114 None] Flow 'volume_create_manager' (c96a7707-3ae3-4b5c-acfa-0651bbc5628d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:46:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5c7cd2a4-7b74-4205-af7d-cf1b8272c336 tempest-VolumesCloneTest-778544114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd06aae-0955-420c-880f-1b5366a531d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:16 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-629ea11c-afae-43c7-ba9e-0b0d0fc02a0f tempest-AbsoluteLimitsTests-813074444 None] Acquiring lock "cinder-quobyte-1d2960bd-6e36-4477-8109-c391511258e4" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:46:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5c7cd2a4-7b74-4205-af7d-cf1b8272c336 tempest-VolumesCloneTest-778544114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd06aae-0955-420c-880f-1b5366a531d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1901647397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08f5395-06c4-41ec-8ab1-d3760cd38d33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212aade5d1644dad96dbde354138647c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:46:17Z,use_quota=True,user_id='06ed636715174726911dc23e89e78258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5c7cd2a4-7b74-4205-af7d-cf1b8272c336 tempest-VolumesCloneTest-778544114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f01c64-1981-415d-bcaa-1487af8624a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5c7cd2a4-7b74-4205-af7d-cf1b8272c336 tempest-VolumesCloneTest-778544114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f01c64-1981-415d-bcaa-1487af8624a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5c7cd2a4-7b74-4205-af7d-cf1b8272c336 tempest-VolumesCloneTest-778544114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c89bc1b-b0df-400d-8631-ba1c4416fbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5c7cd2a4-7b74-4205-af7d-cf1b8272c336 tempest-VolumesCloneTest-778544114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c89bc1b-b0df-400d-8631-ba1c4416fbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd08f5395-06c4-41ec-8ab1-d3760cd38d33', 'volume_name': 'volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5c7cd2a4-7b74-4205-af7d-cf1b8272c336 tempest-VolumesCloneTest-778544114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fac45d2a-5dbb-405a-9b74-576fd9eb88d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5c7cd2a4-7b74-4205-af7d-cf1b8272c336 tempest-VolumesCloneTest-778544114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fac45d2a-5dbb-405a-9b74-576fd9eb88d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5c7cd2a4-7b74-4205-af7d-cf1b8272c336 tempest-VolumesCloneTest-778544114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ac4031b-f29f-47d5-9d3c-6cde5a147729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:16 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-5c7cd2a4-7b74-4205-af7d-cf1b8272c336 tempest-VolumesCloneTest-778544114 None] Volume d08f5395-06c4-41ec-8ab1-d3760cd38d33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33', 'volume_size': 1} Sep 10 16:46:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5c7cd2a4-7b74-4205-af7d-cf1b8272c336 tempest-VolumesCloneTest-778544114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:46:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5c7cd2a4-7b74-4205-af7d-cf1b8272c336 tempest-VolumesCloneTest-778544114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:46:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-5c7cd2a4-7b74-4205-af7d-cf1b8272c336 tempest-VolumesCloneTest-778544114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1901647397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08f5395-06c4-41ec-8ab1-d3760cd38d33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212aade5d1644dad96dbde354138647c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:46:17Z,use_quota=True,user_id='06ed636715174726911dc23e89e78258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:46:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-5c7cd2a4-7b74-4205-af7d-cf1b8272c336 tempest-VolumesCloneTest-778544114 None] Creating volume d08f5395-06c4-41ec-8ab1-d3760cd38d33 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:46:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5c7cd2a4-7b74-4205-af7d-cf1b8272c336 tempest-VolumesCloneTest-778544114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:46:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5c7cd2a4-7b74-4205-af7d-cf1b8272c336 tempest-VolumesCloneTest-778544114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:46:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-5c7cd2a4-7b74-4205-af7d-cf1b8272c336 tempest-VolumesCloneTest-778544114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:46:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-5c7cd2a4-7b74-4205-af7d-cf1b8272c336 tempest-VolumesCloneTest-778544114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:46:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5c7cd2a4-7b74-4205-af7d-cf1b8272c336 tempest-VolumesCloneTest-778544114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:46:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-5c7cd2a4-7b74-4205-af7d-cf1b8272c336 tempest-VolumesCloneTest-778544114 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:46:16 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-5c7cd2a4-7b74-4205-af7d-cf1b8272c336 tempest-VolumesCloneTest-778544114 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:46:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5c7cd2a4-7b74-4205-af7d-cf1b8272c336 tempest-VolumesCloneTest-778544114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:16 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-629ea11c-afae-43c7-ba9e-0b0d0fc02a0f tempest-AbsoluteLimitsTests-813074444 None] Lock "cinder-quobyte-1d2960bd-6e36-4477-8109-c391511258e4" acquired by "delete_volume" :: waited 0.084s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:46:16 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33 1073741824 Sep 10 16:46:16 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:17 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[39da6a06-8745-4064-af23-7dd7f7a03a0b]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:46:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-629ea11c-afae-43c7-ba9e-0b0d0fc02a0f tempest-AbsoluteLimitsTests-813074444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1d2960bd-6e36-4477-8109-c391511258e4 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:17 devstack sudo[98012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1d2960bd-6e36-4477-8109-c391511258e4 Sep 10 16:46:17 devstack sudo[98012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:17 devstack sudo[98012]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-629ea11c-afae-43c7-ba9e-0b0d0fc02a0f tempest-AbsoluteLimitsTests-813074444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1d2960bd-6e36-4477-8109-c391511258e4" returned: 0 in 0.407s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-629ea11c-afae-43c7-ba9e-0b0d0fc02a0f tempest-AbsoluteLimitsTests-813074444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1d2960bd-6e36-4477-8109-c391511258e4 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:17 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5c7cd2a4-7b74-4205-af7d-cf1b8272c336 tempest-VolumesCloneTest-778544114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33 1073741824" returned: 0 in 0.481s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:17 devstack sudo[98021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1d2960bd-6e36-4477-8109-c391511258e4 Sep 10 16:46:17 devstack sudo[98021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:17 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=132,cinder:UPDATE=188,cinder:DELETE=15,cinder:INSERT=41 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:46:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5c7cd2a4-7b74-4205-af7d-cf1b8272c336 tempest-VolumesCloneTest-778544114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:17 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33 Sep 10 16:46:17 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:17 devstack sudo[98021]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-629ea11c-afae-43c7-ba9e-0b0d0fc02a0f tempest-AbsoluteLimitsTests-813074444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1d2960bd-6e36-4477-8109-c391511258e4" returned: 0 in 0.282s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:17 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-629ea11c-afae-43c7-ba9e-0b0d0fc02a0f tempest-AbsoluteLimitsTests-813074444 None] Lock "cinder-quobyte-1d2960bd-6e36-4477-8109-c391511258e4" released by "delete_volume" :: held 0.738s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:46:17 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=152,cinder:INSERT=43,cinder:UPDATE=160,cinder:DELETE=14 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:46:17 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5c7cd2a4-7b74-4205-af7d-cf1b8272c336 tempest-VolumesCloneTest-778544114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33" returned: 0 in 0.292s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-5c7cd2a4-7b74-4205-af7d-cf1b8272c336 tempest-VolumesCloneTest-778544114 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:46:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5c7cd2a4-7b74-4205-af7d-cf1b8272c336 tempest-VolumesCloneTest-778544114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:46:17 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-629ea11c-afae-43c7-ba9e-0b0d0fc02a0f tempest-AbsoluteLimitsTests-813074444 None] Created reservations ['9d0a7c2d-1ee8-46b9-9e7e-815346e0db5a', '80639ff8-4bde-4163-8578-65345688c08d', 'fd98e9bb-1cb3-4b3f-b54f-96fd841bf9c0', 'dc5e89c1-fc1c-4368-993c-c6f14a4c30c2'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:46:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5c7cd2a4-7b74-4205-af7d-cf1b8272c336 tempest-VolumesCloneTest-778544114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ac4031b-f29f-47d5-9d3c-6cde5a147729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5c7cd2a4-7b74-4205-af7d-cf1b8272c336 tempest-VolumesCloneTest-778544114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d2592b7-9fdd-4656-a853-7d49c8594e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:17 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-5c7cd2a4-7b74-4205-af7d-cf1b8272c336 tempest-VolumesCloneTest-778544114 None] Volume volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33 (d08f5395-06c4-41ec-8ab1-d3760cd38d33): created successfully Sep 10 16:46:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5c7cd2a4-7b74-4205-af7d-cf1b8272c336 tempest-VolumesCloneTest-778544114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d2592b7-9fdd-4656-a853-7d49c8594e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5c7cd2a4-7b74-4205-af7d-cf1b8272c336 tempest-VolumesCloneTest-778544114 None] Flow 'volume_create_manager' (c96a7707-3ae3-4b5c-acfa-0651bbc5628d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:46:17 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-5c7cd2a4-7b74-4205-af7d-cf1b8272c336 tempest-VolumesCloneTest-778544114 None] Created volume successfully. Sep 10 16:46:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-629ea11c-afae-43c7-ba9e-0b0d0fc02a0f tempest-AbsoluteLimitsTests-813074444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:46:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-629ea11c-afae-43c7-ba9e-0b0d0fc02a0f tempest-AbsoluteLimitsTests-813074444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:46:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-629ea11c-afae-43c7-ba9e-0b0d0fc02a0f tempest-AbsoluteLimitsTests-813074444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:46:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-629ea11c-afae-43c7-ba9e-0b0d0fc02a0f tempest-AbsoluteLimitsTests-813074444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:46:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-629ea11c-afae-43c7-ba9e-0b0d0fc02a0f tempest-AbsoluteLimitsTests-813074444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:46:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-629ea11c-afae-43c7-ba9e-0b0d0fc02a0f tempest-AbsoluteLimitsTests-813074444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:17 devstack sudo[98027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:46:17 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:18 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-629ea11c-afae-43c7-ba9e-0b0d0fc02a0f tempest-AbsoluteLimitsTests-813074444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.401s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:18 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-629ea11c-afae-43c7-ba9e-0b0d0fc02a0f tempest-AbsoluteLimitsTests-813074444 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:46:18 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-629ea11c-afae-43c7-ba9e-0b0d0fc02a0f tempest-AbsoluteLimitsTests-813074444 None] Deleted volume successfully. Sep 10 16:46:18 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-629ea11c-afae-43c7-ba9e-0b0d0fc02a0f tempest-AbsoluteLimitsTests-813074444 None] Lock "cinder-1d2960bd-6e36-4477-8109-c391511258e4-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:46:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-e5da7670-0737-4fc8-be60-e8ee7d5ce3e8 req-cd1ce35c-75cf-439c-b7fb-8c9d5520e1ea tempest-AttachVolumeNegativeTest-74284645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:46:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-e5da7670-0737-4fc8-be60-e8ee7d5ce3e8 req-cd1ce35c-75cf-439c-b7fb-8c9d5520e1ea tempest-AttachVolumeNegativeTest-74284645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:46:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-e5da7670-0737-4fc8-be60-e8ee7d5ce3e8 req-cd1ce35c-75cf-439c-b7fb-8c9d5520e1ea tempest-AttachVolumeNegativeTest-74284645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:46:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-e5da7670-0737-4fc8-be60-e8ee7d5ce3e8 req-cd1ce35c-75cf-439c-b7fb-8c9d5520e1ea tempest-AttachVolumeNegativeTest-74284645 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8', 'name': 'volume-69795769-1c29-4f4b-9db8-82cfdeb53b11', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '520e6eab-cc66-4c8b-8953-228b6acf4332', 'enforce_multipath': True} {{(pid=88189) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 16:46:18 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-e5da7670-0737-4fc8-be60-e8ee7d5ce3e8 req-cd1ce35c-75cf-439c-b7fb-8c9d5520e1ea tempest-AttachVolumeNegativeTest-74284645 None] attachment_update completed successfully. Sep 10 16:46:19 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:46:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Flow 'volume_create_manager' (642124a0-a3b7-4b0f-b7a6-a1f9dbcd98b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:46:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d515f41c-4d76-4d55-81cc-df239144a816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d515f41c-4d76-4d55-81cc-df239144a816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1669459498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8154de20-dce1-4421-9a22-a5d36b03e477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212aade5d1644dad96dbde354138647c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:46:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=d08f5395-06c4-41ec-8ab1-d3760cd38d33,status='creating',terminated_at=None,updated_at=2026-09-10T14:46:20Z,use_quota=True,user_id='06ed636715174726911dc23e89e78258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a02f9d6-8f0a-40e7-af0a-03c10b957ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a02f9d6-8f0a-40e7-af0a-03c10b957ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca25cdd9-f643-48b8-8828-7c37f39c3357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca25cdd9-f643-48b8-8828-7c37f39c3357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8154de20-dce1-4421-9a22-a5d36b03e477', 'volume_name': 'volume-8154de20-dce1-4421-9a22-a5d36b03e477', 'volume_size': 2, 'source_volid': 'd08f5395-06c4-41ec-8ab1-d3760cd38d33', 'source_volstatus': 'available'}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a406ba23-e9d5-49da-a575-26b18f71c1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a406ba23-e9d5-49da-a575-26b18f71c1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc36ece4-eb48-40d7-b17b-8bbb5f3775cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:19 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Volume 8154de20-dce1-4421-9a22-a5d36b03e477: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8154de20-dce1-4421-9a22-a5d36b03e477', 'volume_size': 2, 'source_volid': 'd08f5395-06c4-41ec-8ab1-d3760cd38d33', 'source_volstatus': 'available'} Sep 10 16:46:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:46:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:46:19 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Cloning volume d08f5395-06c4-41ec-8ab1-d3760cd38d33 to volume 8154de20-dce1-4421-9a22-a5d36b03e477 Sep 10 16:46:20 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Creating offline snapshot 0f389991-ed72-4671-bbd4-44180d3e82f1 of volume d08f5395-06c4-41ec-8ab1-d3760cd38d33 {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:46:20 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[10048b98-2a91-44c2-861e-a69ed3e41f6c]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:46:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:20 devstack sudo[98424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33 Sep 10 16:46:20 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:20 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33" returned: 0 in 0.431s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33.0f389991-ed72-4671-bbd4-44180d3e82f1 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:20 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33.0f389991-ed72-4671-bbd4-44180d3e82f1 1G Sep 10 16:46:20 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:21 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33.0f389991-ed72-4671-bbd4-44180d3e82f1 1G" returned: 0 in 0.572s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33.0f389991-ed72-4671-bbd4-44180d3e82f1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:21 devstack sudo[98435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33.0f389991-ed72-4671-bbd4-44180d3e82f1 Sep 10 16:46:21 devstack sudo[98435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:21 devstack sudo[98435]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33.0f389991-ed72-4671-bbd4-44180d3e82f1" returned: 0 in 0.399s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:21 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33.0f389991-ed72-4671-bbd4-44180d3e82f1 is being set with open permissions: ugo+rw Sep 10 16:46:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33.0f389991-ed72-4671-bbd4-44180d3e82f1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:21 devstack sudo[98440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33.0f389991-ed72-4671-bbd4-44180d3e82f1 Sep 10 16:46:21 devstack sudo[98440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:21 devstack sudo[98440]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33.0f389991-ed72-4671-bbd4-44180d3e82f1" returned: 0 in 0.368s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:21 devstack sudo[98443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33.info Sep 10 16:46:21 devstack sudo[98443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:22 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-bc053c81-9091-48f9-9b1c-c66047a43740 req-854f4345-9e4d-4680-85cf-e776119cb280 tempest-AttachVolumeNegativeTest-74284645 None] Terminate volume connection completed successfully. Sep 10 16:46:22 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-bc053c81-9091-48f9-9b1c-c66047a43740 req-854f4345-9e4d-4680-85cf-e776119cb280 tempest-AttachVolumeNegativeTest-74284645 None] Deleting attachment 520e6eab-cc66-4c8b-8953-228b6acf4332. {{(pid=88189) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 16:46:22 devstack sudo[98443]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33.info" returned: 0 in 0.341s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:22 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33.info is being set with open permissions: ugo+rw Sep 10 16:46:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:22 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33.info Sep 10 16:46:22 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:22 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33.info" returned: 0 in 0.314s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:22 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Acquiring lock "cinder-quobyte-8154de20-dce1-4421-9a22-a5d36b03e477" by "_copy_volume_from_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:46:22 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Lock "cinder-quobyte-8154de20-dce1-4421-9a22-a5d36b03e477" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:46:22 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] snapshot: 0f389991-ed72-4671-bbd4-44180d3e82f1, volume: 8154de20-dce1-4421-9a22-a5d36b03e477, {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 16:46:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:46:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:46:22 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:46:22 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:46:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:46:22 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[84369996-afcc-4b3c-8b48-98548686df20]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:46:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33.0f389991-ed72-4671-bbd4-44180d3e82f1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:22 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33.0f389991-ed72-4671-bbd4-44180d3e82f1 Sep 10 16:46:22 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:23 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33.0f389991-ed72-4671-bbd4-44180d3e82f1" returned: 0 in 0.455s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:23 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:46:23 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bbe460-4cea-4519-a3a7-4d3144265ff4]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:46:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:23 devstack sudo[98480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33 Sep 10 16:46:23 devstack sudo[98480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:23 devstack sudo[98480]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33" returned: 0 in 0.676s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:23 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] will copy from snapshot at /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33 {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 16:46:23 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Creating direct copy from snapshot {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 16:46:23 devstack cinder-volume[88189]: DEBUG cinder.utils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Path /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8154de20-dce1-4421-9a22-a5d36b03e477 not found in is_blk_device check {{(pid=88189) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 16:46:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8154de20-dce1-4421-9a22-a5d36b03e477 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:23 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8154de20-dce1-4421-9a22-a5d36b03e477 Sep 10 16:46:23 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:24 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-87a34391-3150-4a0f-9518-fea0f8ffb5bf tempest-GroupSnapshotsV319Test-1646034878 None] Group tempest-GroupSnapshotsV319Test-Group-379311219: creating Sep 10 16:46:24 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-87a34391-3150-4a0f-9518-fea0f8ffb5bf tempest-GroupSnapshotsV319Test-1646034878 None] Group tempest-GroupSnapshotsV319Test-Group-379311219: created successfully Sep 10 16:46:24 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-87a34391-3150-4a0f-9518-fea0f8ffb5bf tempest-GroupSnapshotsV319Test-1646034878 None] Create group completed successfully. Sep 10 16:46:26 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0c96a7e-274e-41b7-bd1c-7ff1885d7e5d tempest-GroupSnapshotsV319Test-1646034878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:46:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d0c96a7e-274e-41b7-bd1c-7ff1885d7e5d tempest-GroupSnapshotsV319Test-1646034878 None] Flow 'volume_create_manager' (9011bf8f-da2c-4d98-8bcd-4907992a73c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:46:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d0c96a7e-274e-41b7-bd1c-7ff1885d7e5d tempest-GroupSnapshotsV319Test-1646034878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5b809bf-160b-4b34-8b67-af3e0438d4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d0c96a7e-274e-41b7-bd1c-7ff1885d7e5d tempest-GroupSnapshotsV319Test-1646034878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5b809bf-160b-4b34-8b67-af3e0438d4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-986186341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=84a6751d-25a4-458a-ba4e-b3492e3ae986,host='devstack@QuobyteHD#QuobyteHD',id=d928e000-0833-40a2-8954-31361e2ae7eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a10357f4519c4cff9c3fea96d72410ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:46:27Z,use_quota=True,user_id='df44553c15b747a6908e4b52d6af2dc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8851aa7-e6bb-4dd7-8799-c50489e221b2),volume_type_id=b8851aa7-e6bb-4dd7-8799-c50489e221b2)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d0c96a7e-274e-41b7-bd1c-7ff1885d7e5d tempest-GroupSnapshotsV319Test-1646034878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb01f6a-fbc1-4493-9a1a-f280962eb946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d0c96a7e-274e-41b7-bd1c-7ff1885d7e5d tempest-GroupSnapshotsV319Test-1646034878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb01f6a-fbc1-4493-9a1a-f280962eb946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d0c96a7e-274e-41b7-bd1c-7ff1885d7e5d tempest-GroupSnapshotsV319Test-1646034878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73daad38-e453-40c4-a6b2-b1777ec5e15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d0c96a7e-274e-41b7-bd1c-7ff1885d7e5d tempest-GroupSnapshotsV319Test-1646034878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73daad38-e453-40c4-a6b2-b1777ec5e15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd928e000-0833-40a2-8954-31361e2ae7eb', 'volume_name': 'volume-d928e000-0833-40a2-8954-31361e2ae7eb', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d0c96a7e-274e-41b7-bd1c-7ff1885d7e5d tempest-GroupSnapshotsV319Test-1646034878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e3a484e-6967-4d74-85d7-0dfadebfaa60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d0c96a7e-274e-41b7-bd1c-7ff1885d7e5d tempest-GroupSnapshotsV319Test-1646034878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e3a484e-6967-4d74-85d7-0dfadebfaa60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d0c96a7e-274e-41b7-bd1c-7ff1885d7e5d tempest-GroupSnapshotsV319Test-1646034878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (716bb7e2-a375-4c5d-a50a-ca792cd2ddb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:27 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-d0c96a7e-274e-41b7-bd1c-7ff1885d7e5d tempest-GroupSnapshotsV319Test-1646034878 None] Volume d928e000-0833-40a2-8954-31361e2ae7eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d928e000-0833-40a2-8954-31361e2ae7eb', 'volume_size': 1} Sep 10 16:46:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d0c96a7e-274e-41b7-bd1c-7ff1885d7e5d tempest-GroupSnapshotsV319Test-1646034878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:46:29 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8154de20-dce1-4421-9a22-a5d36b03e477" returned: 0 in 6.148s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:29 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Image conversion details: src /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33, size 1024.00 MB, duration 6.15 sec, destination /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8154de20-dce1-4421-9a22-a5d36b03e477 {{(pid=88189) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 16:46:29 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Converted 1024.00 MB image at 166.51 MB/s Sep 10 16:46:29 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8154de20-dce1-4421-9a22-a5d36b03e477 is being set with open permissions: ugo+rw Sep 10 16:46:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8154de20-dce1-4421-9a22-a5d36b03e477 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:29 devstack sudo[98529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8154de20-dce1-4421-9a22-a5d36b03e477 Sep 10 16:46:29 devstack sudo[98529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:30 devstack sudo[98529]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8154de20-dce1-4421-9a22-a5d36b03e477" returned: 0 in 0.286s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:30 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Lock "cinder-quobyte-8154de20-dce1-4421-9a22-a5d36b03e477" released by "_copy_volume_from_snapshot" :: held 7.662s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:46:30 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Acquiring lock "cinder-quobyte-0f389991-ed72-4671-bbd4-44180d3e82f1" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:46:30 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Lock "cinder-quobyte-0f389991-ed72-4671-bbd4-44180d3e82f1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:46:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Deleting offline snapshot 0f389991-ed72-4671-bbd4-44180d3e82f1 of volume d08f5395-06c4-41ec-8ab1-d3760cd38d33 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:46:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] snapshot_file for this snap is: volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33.0f389991-ed72-4671-bbd4-44180d3e82f1 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:46:30 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfe616f-ddb6-4afb-b48e-12bb0eb4fab1]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:46:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33.0f389991-ed72-4671-bbd4-44180d3e82f1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:30 devstack sudo[98533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33.0f389991-ed72-4671-bbd4-44180d3e82f1 Sep 10 16:46:30 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:30 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33.0f389991-ed72-4671-bbd4-44180d3e82f1" returned: 0 in 0.423s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:46:30 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ce7ad1-64c0-40c4-bbfb-ba4280262254]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:46:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:30 devstack sudo[98538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33 Sep 10 16:46:30 devstack sudo[98538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:31 devstack sudo[98538]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33" returned: 0 in 0.637s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33.0f389991-ed72-4671-bbd4-44180d3e82f1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:31 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33.0f389991-ed72-4671-bbd4-44180d3e82f1 Sep 10 16:46:31 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:31 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33.0f389991-ed72-4671-bbd4-44180d3e82f1" returned: 0 in 0.373s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33.0f389991-ed72-4671-bbd4-44180d3e82f1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:31 devstack sudo[98548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33.0f389991-ed72-4671-bbd4-44180d3e82f1 Sep 10 16:46:31 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:32 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33.0f389991-ed72-4671-bbd4-44180d3e82f1" returned: 0 in 0.299s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:32 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Lock "cinder-quobyte-0f389991-ed72-4671-bbd4-44180d3e82f1" released by "_delete_snapshot" :: held 1.845s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:46:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.199s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:46:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d0c96a7e-274e-41b7-bd1c-7ff1885d7e5d tempest-GroupSnapshotsV319Test-1646034878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.878s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:46:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d0c96a7e-274e-41b7-bd1c-7ff1885d7e5d tempest-GroupSnapshotsV319Test-1646034878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=84a6751d-25a4-458a-ba4e-b3492e3ae986,created_at=2026-09-10T14:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-986186341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=84a6751d-25a4-458a-ba4e-b3492e3ae986,host='devstack@QuobyteHD#QuobyteHD',id=d928e000-0833-40a2-8954-31361e2ae7eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a10357f4519c4cff9c3fea96d72410ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:46:27Z,use_quota=True,user_id='df44553c15b747a6908e4b52d6af2dc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8851aa7-e6bb-4dd7-8799-c50489e221b2),volume_type_id=b8851aa7-e6bb-4dd7-8799-c50489e221b2)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:46:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-d0c96a7e-274e-41b7-bd1c-7ff1885d7e5d tempest-GroupSnapshotsV319Test-1646034878 None] Creating volume d928e000-0833-40a2-8954-31361e2ae7eb {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:46:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d0c96a7e-274e-41b7-bd1c-7ff1885d7e5d tempest-GroupSnapshotsV319Test-1646034878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:46:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d0c96a7e-274e-41b7-bd1c-7ff1885d7e5d tempest-GroupSnapshotsV319Test-1646034878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:46:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d0c96a7e-274e-41b7-bd1c-7ff1885d7e5d tempest-GroupSnapshotsV319Test-1646034878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:46:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d0c96a7e-274e-41b7-bd1c-7ff1885d7e5d tempest-GroupSnapshotsV319Test-1646034878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:46:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d0c96a7e-274e-41b7-bd1c-7ff1885d7e5d tempest-GroupSnapshotsV319Test-1646034878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:46:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d0c96a7e-274e-41b7-bd1c-7ff1885d7e5d tempest-GroupSnapshotsV319Test-1646034878 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:46:32 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-d0c96a7e-274e-41b7-bd1c-7ff1885d7e5d tempest-GroupSnapshotsV319Test-1646034878 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:46:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d0c96a7e-274e-41b7-bd1c-7ff1885d7e5d tempest-GroupSnapshotsV319Test-1646034878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:32 devstack sudo[98551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb 1073741824 Sep 10 16:46:32 devstack sudo[98551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc36ece4-eb48-40d7-b17b-8bbb5f3775cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8154de20-dce1-4421-9a22-a5d36b03e477', 'volume_size': 2, 'source_volid': 'd08f5395-06c4-41ec-8ab1-d3760cd38d33', 'source_volstatus': 'available'}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da224e2a-1d35-4aa4-b1c1-f93c182fb240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:32 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Volume volume-8154de20-dce1-4421-9a22-a5d36b03e477 (8154de20-dce1-4421-9a22-a5d36b03e477): created successfully Sep 10 16:46:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da224e2a-1d35-4aa4-b1c1-f93c182fb240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Flow 'volume_create_manager' (642124a0-a3b7-4b0f-b7a6-a1f9dbcd98b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:46:32 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-fc4ab4ec-bdf1-4eb8-aab1-7d61e2799c60 tempest-VolumesCloneTest-778544114 None] Created volume successfully. Sep 10 16:46:32 devstack sudo[98551]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d0c96a7e-274e-41b7-bd1c-7ff1885d7e5d tempest-GroupSnapshotsV319Test-1646034878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb 1073741824" returned: 0 in 0.620s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d0c96a7e-274e-41b7-bd1c-7ff1885d7e5d tempest-GroupSnapshotsV319Test-1646034878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:32 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb Sep 10 16:46:32 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:33 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d0c96a7e-274e-41b7-bd1c-7ff1885d7e5d tempest-GroupSnapshotsV319Test-1646034878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb" returned: 0 in 0.360s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d0c96a7e-274e-41b7-bd1c-7ff1885d7e5d tempest-GroupSnapshotsV319Test-1646034878 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:46:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d0c96a7e-274e-41b7-bd1c-7ff1885d7e5d tempest-GroupSnapshotsV319Test-1646034878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:46:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d0c96a7e-274e-41b7-bd1c-7ff1885d7e5d tempest-GroupSnapshotsV319Test-1646034878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (716bb7e2-a375-4c5d-a50a-ca792cd2ddb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d928e000-0833-40a2-8954-31361e2ae7eb', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d0c96a7e-274e-41b7-bd1c-7ff1885d7e5d tempest-GroupSnapshotsV319Test-1646034878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b8c55c-2214-4593-be75-66d96d89ce20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:33 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-d0c96a7e-274e-41b7-bd1c-7ff1885d7e5d tempest-GroupSnapshotsV319Test-1646034878 None] Volume volume-d928e000-0833-40a2-8954-31361e2ae7eb (d928e000-0833-40a2-8954-31361e2ae7eb): created successfully Sep 10 16:46:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d0c96a7e-274e-41b7-bd1c-7ff1885d7e5d tempest-GroupSnapshotsV319Test-1646034878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b8c55c-2214-4593-be75-66d96d89ce20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d0c96a7e-274e-41b7-bd1c-7ff1885d7e5d tempest-GroupSnapshotsV319Test-1646034878 None] Flow 'volume_create_manager' (9011bf8f-da2c-4d98-8bcd-4907992a73c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:46:33 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-d0c96a7e-274e-41b7-bd1c-7ff1885d7e5d tempest-GroupSnapshotsV319Test-1646034878 None] Created volume successfully. Sep 10 16:46:33 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4fefe333-47a3-4767-b3b4-0ea944ec748a tempest-VolumesCloneTest-778544114 None] Acquiring lock "cinder-8154de20-dce1-4421-9a22-a5d36b03e477-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:46:33 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4fefe333-47a3-4767-b3b4-0ea944ec748a tempest-VolumesCloneTest-778544114 None] Lock "cinder-8154de20-dce1-4421-9a22-a5d36b03e477-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:46:33 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4fefe333-47a3-4767-b3b4-0ea944ec748a tempest-VolumesCloneTest-778544114 None] Acquiring lock "cinder-quobyte-8154de20-dce1-4421-9a22-a5d36b03e477" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:46:33 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4fefe333-47a3-4767-b3b4-0ea944ec748a tempest-VolumesCloneTest-778544114 None] Lock "cinder-quobyte-8154de20-dce1-4421-9a22-a5d36b03e477" acquired by "delete_volume" :: waited 0.025s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:46:33 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[addfe9c5-f41a-4939-bd5f-8c1f613b9678]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:46:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4fefe333-47a3-4767-b3b4-0ea944ec748a tempest-VolumesCloneTest-778544114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8154de20-dce1-4421-9a22-a5d36b03e477 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:33 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8154de20-dce1-4421-9a22-a5d36b03e477 Sep 10 16:46:33 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:34 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4fefe333-47a3-4767-b3b4-0ea944ec748a tempest-VolumesCloneTest-778544114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8154de20-dce1-4421-9a22-a5d36b03e477" returned: 0 in 0.584s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4fefe333-47a3-4767-b3b4-0ea944ec748a tempest-VolumesCloneTest-778544114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8154de20-dce1-4421-9a22-a5d36b03e477 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:34 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-e5a1fe29-f0b4-467a-864a-c06b4a30886e tempest-GroupSnapshotsV319Test-1646034878 None] GroupSnapshot 84779de1-cff8-40dd-ad35-c6cbdc70f1ba: creating. Sep 10 16:46:34 devstack sudo[98570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8154de20-dce1-4421-9a22-a5d36b03e477 Sep 10 16:46:34 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e5a1fe29-f0b4-467a-864a-c06b4a30886e tempest-GroupSnapshotsV319Test-1646034878 None] Group snapshot 84779de1-cff8-40dd-ad35-c6cbdc70f1ba: creating. {{(pid=88189) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 10 16:46:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e5a1fe29-f0b4-467a-864a-c06b4a30886e tempest-GroupSnapshotsV319Test-1646034878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:46:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e5a1fe29-f0b4-467a-864a-c06b4a30886e tempest-GroupSnapshotsV319Test-1646034878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:46:34 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-e5a1fe29-f0b4-467a-864a-c06b4a30886e tempest-GroupSnapshotsV319Test-1646034878 None] Creating offline snapshot 6ef53a46-dec7-4312-a649-b3df2539e710 of volume d928e000-0833-40a2-8954-31361e2ae7eb {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:46:34 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[453b7279-92f1-484e-945c-be033c25923a]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:46:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e5a1fe29-f0b4-467a-864a-c06b4a30886e tempest-GroupSnapshotsV319Test-1646034878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:34 devstack sudo[98572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb Sep 10 16:46:34 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:34 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4fefe333-47a3-4767-b3b4-0ea944ec748a tempest-VolumesCloneTest-778544114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8154de20-dce1-4421-9a22-a5d36b03e477" returned: 0 in 0.399s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:34 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4fefe333-47a3-4767-b3b4-0ea944ec748a tempest-VolumesCloneTest-778544114 None] Lock "cinder-quobyte-8154de20-dce1-4421-9a22-a5d36b03e477" released by "delete_volume" :: held 1.050s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:46:34 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-4fefe333-47a3-4767-b3b4-0ea944ec748a tempest-VolumesCloneTest-778544114 None] Created reservations ['a16f942d-67b0-4e7e-9b9c-eb58e14bdd81', '39ee1be6-3a7e-48ae-93e6-20cf4991241e', 'e999fff5-55b5-4cf7-9b78-3e24ba8f5861', '7b95097c-da6e-4a4f-91bf-8588b18f9272'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:46:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4fefe333-47a3-4767-b3b4-0ea944ec748a tempest-VolumesCloneTest-778544114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:46:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4fefe333-47a3-4767-b3b4-0ea944ec748a tempest-VolumesCloneTest-778544114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:46:34 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-4fefe333-47a3-4767-b3b4-0ea944ec748a tempest-VolumesCloneTest-778544114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:46:34 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-4fefe333-47a3-4767-b3b4-0ea944ec748a tempest-VolumesCloneTest-778544114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:46:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4fefe333-47a3-4767-b3b4-0ea944ec748a tempest-VolumesCloneTest-778544114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:46:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4fefe333-47a3-4767-b3b4-0ea944ec748a tempest-VolumesCloneTest-778544114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:34 devstack sudo[98577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:46:34 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:35 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e5a1fe29-f0b4-467a-864a-c06b4a30886e tempest-GroupSnapshotsV319Test-1646034878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb" returned: 0 in 0.583s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e5a1fe29-f0b4-467a-864a-c06b4a30886e tempest-GroupSnapshotsV319Test-1646034878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb.6ef53a46-dec7-4312-a649-b3df2539e710 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:35 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb.6ef53a46-dec7-4312-a649-b3df2539e710 1G Sep 10 16:46:35 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:35 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4fefe333-47a3-4767-b3b4-0ea944ec748a tempest-VolumesCloneTest-778544114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.423s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:35 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-4fefe333-47a3-4767-b3b4-0ea944ec748a tempest-VolumesCloneTest-778544114 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:46:35 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-4fefe333-47a3-4767-b3b4-0ea944ec748a tempest-VolumesCloneTest-778544114 None] Deleted volume successfully. Sep 10 16:46:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4fefe333-47a3-4767-b3b4-0ea944ec748a tempest-VolumesCloneTest-778544114 None] Lock "cinder-8154de20-dce1-4421-9a22-a5d36b03e477-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:46:35 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e5a1fe29-f0b4-467a-864a-c06b4a30886e tempest-GroupSnapshotsV319Test-1646034878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb.6ef53a46-dec7-4312-a649-b3df2539e710 1G" returned: 0 in 0.642s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e5a1fe29-f0b4-467a-864a-c06b4a30886e tempest-GroupSnapshotsV319Test-1646034878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d928e000-0833-40a2-8954-31361e2ae7eb -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb.6ef53a46-dec7-4312-a649-b3df2539e710 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:35 devstack sudo[98587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d928e000-0833-40a2-8954-31361e2ae7eb -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb.6ef53a46-dec7-4312-a649-b3df2539e710 Sep 10 16:46:35 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8e84747e-44d3-4478-b8d1-970ffeb2f8de tempest-VolumesCloneTest-778544114 None] Acquiring lock "cinder-d08f5395-06c4-41ec-8ab1-d3760cd38d33-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:46:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8e84747e-44d3-4478-b8d1-970ffeb2f8de tempest-VolumesCloneTest-778544114 None] Lock "cinder-d08f5395-06c4-41ec-8ab1-d3760cd38d33-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:46:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8e84747e-44d3-4478-b8d1-970ffeb2f8de tempest-VolumesCloneTest-778544114 None] Acquiring lock "cinder-quobyte-d08f5395-06c4-41ec-8ab1-d3760cd38d33" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:46:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8e84747e-44d3-4478-b8d1-970ffeb2f8de tempest-VolumesCloneTest-778544114 None] Lock "cinder-quobyte-d08f5395-06c4-41ec-8ab1-d3760cd38d33" acquired by "delete_volume" :: waited 0.023s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:46:36 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e5a1fe29-f0b4-467a-864a-c06b4a30886e tempest-GroupSnapshotsV319Test-1646034878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d928e000-0833-40a2-8954-31361e2ae7eb -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb.6ef53a46-dec7-4312-a649-b3df2539e710" returned: 0 in 0.519s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:36 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-e5a1fe29-f0b4-467a-864a-c06b4a30886e tempest-GroupSnapshotsV319Test-1646034878 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb.6ef53a46-dec7-4312-a649-b3df2539e710 is being set with open permissions: ugo+rw: NotImplementedError Sep 10 16:46:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e5a1fe29-f0b4-467a-864a-c06b4a30886e tempest-GroupSnapshotsV319Test-1646034878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb.6ef53a46-dec7-4312-a649-b3df2539e710 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:36 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29a0576-5295-458a-877f-b2ba4eb07442]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:46:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8e84747e-44d3-4478-b8d1-970ffeb2f8de tempest-VolumesCloneTest-778544114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:36 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb.6ef53a46-dec7-4312-a649-b3df2539e710 Sep 10 16:46:36 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:36 devstack sudo[98595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33 Sep 10 16:46:36 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:36 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e5a1fe29-f0b4-467a-864a-c06b4a30886e tempest-GroupSnapshotsV319Test-1646034878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb.6ef53a46-dec7-4312-a649-b3df2539e710" returned: 0 in 0.567s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e5a1fe29-f0b4-467a-864a-c06b4a30886e tempest-GroupSnapshotsV319Test-1646034878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:36 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8e84747e-44d3-4478-b8d1-970ffeb2f8de tempest-VolumesCloneTest-778544114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33" returned: 0 in 0.633s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8e84747e-44d3-4478-b8d1-970ffeb2f8de tempest-VolumesCloneTest-778544114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:36 devstack sudo[98615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb.info Sep 10 16:46:36 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:36 devstack sudo[98616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33 Sep 10 16:46:36 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:37 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8e84747e-44d3-4478-b8d1-970ffeb2f8de tempest-VolumesCloneTest-778544114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d08f5395-06c4-41ec-8ab1-d3760cd38d33" returned: 0 in 0.308s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:37 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8e84747e-44d3-4478-b8d1-970ffeb2f8de tempest-VolumesCloneTest-778544114 None] Lock "cinder-quobyte-d08f5395-06c4-41ec-8ab1-d3760cd38d33" released by "delete_volume" :: held 1.049s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:46:37 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e5a1fe29-f0b4-467a-864a-c06b4a30886e tempest-GroupSnapshotsV319Test-1646034878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb.info" returned: 0 in 0.426s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:37 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-e5a1fe29-f0b4-467a-864a-c06b4a30886e tempest-GroupSnapshotsV319Test-1646034878 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb.info is being set with open permissions: ugo+rw: NotImplementedError Sep 10 16:46:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e5a1fe29-f0b4-467a-864a-c06b4a30886e tempest-GroupSnapshotsV319Test-1646034878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:37 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-8e84747e-44d3-4478-b8d1-970ffeb2f8de tempest-VolumesCloneTest-778544114 None] Created reservations ['ba5ec608-b7d3-4f45-897f-2334a70a6243', 'db495536-397f-46c2-9a85-82b772f2aa9f', 'dfe2afc2-ab77-4eff-b2df-3775ea0178ec', 'c395a00e-0072-4c49-b54e-d071dff2c7c0'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:46:37 devstack sudo[98625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb.info Sep 10 16:46:37 devstack sudo[98625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8e84747e-44d3-4478-b8d1-970ffeb2f8de tempest-VolumesCloneTest-778544114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:46:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8e84747e-44d3-4478-b8d1-970ffeb2f8de tempest-VolumesCloneTest-778544114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:46:37 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8e84747e-44d3-4478-b8d1-970ffeb2f8de tempest-VolumesCloneTest-778544114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:46:37 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8e84747e-44d3-4478-b8d1-970ffeb2f8de tempest-VolumesCloneTest-778544114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:46:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8e84747e-44d3-4478-b8d1-970ffeb2f8de tempest-VolumesCloneTest-778544114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:46:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8e84747e-44d3-4478-b8d1-970ffeb2f8de tempest-VolumesCloneTest-778544114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:37 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:46:37 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:37 devstack sudo[98625]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e5a1fe29-f0b4-467a-864a-c06b4a30886e tempest-GroupSnapshotsV319Test-1646034878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb.info" returned: 0 in 0.327s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e5a1fe29-f0b4-467a-864a-c06b4a30886e tempest-GroupSnapshotsV319Test-1646034878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.208s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:46:37 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8e84747e-44d3-4478-b8d1-970ffeb2f8de tempest-VolumesCloneTest-778544114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.335s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:37 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-8e84747e-44d3-4478-b8d1-970ffeb2f8de tempest-VolumesCloneTest-778544114 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:46:37 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-e5a1fe29-f0b4-467a-864a-c06b4a30886e tempest-GroupSnapshotsV319Test-1646034878 None] group_snapshot 84779de1-cff8-40dd-ad35-c6cbdc70f1ba: created successfully Sep 10 16:46:37 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-8e84747e-44d3-4478-b8d1-970ffeb2f8de tempest-VolumesCloneTest-778544114 None] Deleted volume successfully. Sep 10 16:46:37 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8e84747e-44d3-4478-b8d1-970ffeb2f8de tempest-VolumesCloneTest-778544114 None] Lock "cinder-d08f5395-06c4-41ec-8ab1-d3760cd38d33-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:46:39 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-7899db02-6a73-4ba5-a8b3-10aedce66986 tempest-GroupSnapshotsV319Test-1646034878 None] group_snapshot 84779de1-cff8-40dd-ad35-c6cbdc70f1ba: deleting Sep 10 16:46:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7899db02-6a73-4ba5-a8b3-10aedce66986 tempest-GroupSnapshotsV319Test-1646034878 None] group_snapshot 84779de1-cff8-40dd-ad35-c6cbdc70f1ba: deleting {{(pid=88189) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 10 16:46:39 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-7899db02-6a73-4ba5-a8b3-10aedce66986 tempest-GroupSnapshotsV319Test-1646034878 None] Acquiring lock "cinder-quobyte-d928e000-0833-40a2-8954-31361e2ae7eb" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:46:39 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-7899db02-6a73-4ba5-a8b3-10aedce66986 tempest-GroupSnapshotsV319Test-1646034878 None] Lock "cinder-quobyte-d928e000-0833-40a2-8954-31361e2ae7eb" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:46:39 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-7899db02-6a73-4ba5-a8b3-10aedce66986 tempest-GroupSnapshotsV319Test-1646034878 None] Acquiring lock "cinder-quobyte-6ef53a46-dec7-4312-a649-b3df2539e710" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:46:39 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-7899db02-6a73-4ba5-a8b3-10aedce66986 tempest-GroupSnapshotsV319Test-1646034878 None] Lock "cinder-quobyte-6ef53a46-dec7-4312-a649-b3df2539e710" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:46:39 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-7899db02-6a73-4ba5-a8b3-10aedce66986 tempest-GroupSnapshotsV319Test-1646034878 None] Deleting offline snapshot 6ef53a46-dec7-4312-a649-b3df2539e710 of volume d928e000-0833-40a2-8954-31361e2ae7eb {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:46:39 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-7899db02-6a73-4ba5-a8b3-10aedce66986 tempest-GroupSnapshotsV319Test-1646034878 None] snapshot_file for this snap is: volume-d928e000-0833-40a2-8954-31361e2ae7eb.6ef53a46-dec7-4312-a649-b3df2539e710 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:46:39 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70555d9-24f9-431e-b281-e22512d8921d]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:46:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7899db02-6a73-4ba5-a8b3-10aedce66986 tempest-GroupSnapshotsV319Test-1646034878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb.6ef53a46-dec7-4312-a649-b3df2539e710 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:40 devstack sudo[98688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb.6ef53a46-dec7-4312-a649-b3df2539e710 Sep 10 16:46:40 devstack sudo[98688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:40 devstack sudo[98688]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7899db02-6a73-4ba5-a8b3-10aedce66986 tempest-GroupSnapshotsV319Test-1646034878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb.6ef53a46-dec7-4312-a649-b3df2539e710" returned: 0 in 0.767s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:40 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-7899db02-6a73-4ba5-a8b3-10aedce66986 tempest-GroupSnapshotsV319Test-1646034878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d928e000-0833-40a2-8954-31361e2ae7eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:46:40 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[60434fd1-1d00-4c0a-9142-a6f1cf5c33a0]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:46:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7899db02-6a73-4ba5-a8b3-10aedce66986 tempest-GroupSnapshotsV319Test-1646034878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:40 devstack sudo[98702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb Sep 10 16:46:40 devstack sudo[98702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:41 devstack sudo[98702]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7899db02-6a73-4ba5-a8b3-10aedce66986 tempest-GroupSnapshotsV319Test-1646034878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb" returned: 0 in 0.599s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7899db02-6a73-4ba5-a8b3-10aedce66986 tempest-GroupSnapshotsV319Test-1646034878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb.6ef53a46-dec7-4312-a649-b3df2539e710 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:41 devstack sudo[98708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb.6ef53a46-dec7-4312-a649-b3df2539e710 Sep 10 16:46:41 devstack sudo[98708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:41 devstack sudo[98708]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7899db02-6a73-4ba5-a8b3-10aedce66986 tempest-GroupSnapshotsV319Test-1646034878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb.6ef53a46-dec7-4312-a649-b3df2539e710" returned: 0 in 0.481s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7899db02-6a73-4ba5-a8b3-10aedce66986 tempest-GroupSnapshotsV319Test-1646034878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb.6ef53a46-dec7-4312-a649-b3df2539e710 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:41 devstack sudo[98714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb.6ef53a46-dec7-4312-a649-b3df2539e710 Sep 10 16:46:41 devstack sudo[98714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:41 devstack sudo[98714]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7899db02-6a73-4ba5-a8b3-10aedce66986 tempest-GroupSnapshotsV319Test-1646034878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb.6ef53a46-dec7-4312-a649-b3df2539e710" returned: 0 in 0.399s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:42 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-7899db02-6a73-4ba5-a8b3-10aedce66986 tempest-GroupSnapshotsV319Test-1646034878 None] Lock "cinder-quobyte-6ef53a46-dec7-4312-a649-b3df2539e710" released by "_delete_snapshot" :: held 2.427s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:46:42 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-7899db02-6a73-4ba5-a8b3-10aedce66986 tempest-GroupSnapshotsV319Test-1646034878 None] Lock "cinder-quobyte-d928e000-0833-40a2-8954-31361e2ae7eb" released by "delete_snapshot" :: held 2.476s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:46:42 devstack cinder-volume[88189]: WARNING cinder.quota [None req-7899db02-6a73-4ba5-a8b3-10aedce66986 tempest-GroupSnapshotsV319Test-1646034878 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-321336672 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-321336672, it is now deprecated. Please use the default quota class for default quota. Sep 10 16:46:42 devstack cinder-volume[88189]: WARNING cinder.quota [None req-7899db02-6a73-4ba5-a8b3-10aedce66986 tempest-GroupSnapshotsV319Test-1646034878 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-321336672 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-321336672, it is now deprecated. Please use the default quota class for default quota. Sep 10 16:46:42 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-7899db02-6a73-4ba5-a8b3-10aedce66986 tempest-GroupSnapshotsV319Test-1646034878 None] Created reservations ['004e6e02-fd31-49f0-86db-07f0257a0844', '046a4182-2e83-43af-8a6d-615c1cd825b8', '29bfe016-f955-4a64-b8ff-eecda5a0c8e0', 'bcbd1242-4235-46fd-92c8-323c51d9a823'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:46:42 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-7899db02-6a73-4ba5-a8b3-10aedce66986 tempest-GroupSnapshotsV319Test-1646034878 None] group_snapshot 84779de1-cff8-40dd-ad35-c6cbdc70f1ba: deleted successfully Sep 10 16:46:43 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-29a0198f-c090-48b6-a6f9-4ab1a0bca96b tempest-GroupSnapshotsV319Test-1646034878 None] Acquiring lock "cinder-quobyte-d928e000-0833-40a2-8954-31361e2ae7eb" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:46:43 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-29a0198f-c090-48b6-a6f9-4ab1a0bca96b tempest-GroupSnapshotsV319Test-1646034878 None] Lock "cinder-quobyte-d928e000-0833-40a2-8954-31361e2ae7eb" acquired by "delete_volume" :: waited 0.044s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:46:43 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[516d33bf-fe3d-4c00-99c8-a12d4c9d9c78]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:46:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-29a0198f-c090-48b6-a6f9-4ab1a0bca96b tempest-GroupSnapshotsV319Test-1646034878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:44 devstack sudo[98720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb Sep 10 16:46:44 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:44 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-8831a7c0-b9cc-44a4-8a19-182227ae9b81 tempest-VolumesActionsTest-270422599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:46:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8831a7c0-b9cc-44a4-8a19-182227ae9b81 tempest-VolumesActionsTest-270422599 None] Flow 'volume_create_manager' (8647a41d-287f-430b-b744-1ac6c7061431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:46:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8831a7c0-b9cc-44a4-8a19-182227ae9b81 tempest-VolumesActionsTest-270422599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ad7d3c1-129e-4c17-b7f0-a794f53458d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8831a7c0-b9cc-44a4-8a19-182227ae9b81 tempest-VolumesActionsTest-270422599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ad7d3c1-129e-4c17-b7f0-a794f53458d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-252518696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8def1d0e-5a45-4fc8-8126-19bfd3057507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05493f9b55c249b3bbade563b2efeacb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:46:44Z,use_quota=True,user_id='9fd53ea5445c48bb891fda82e0b1a291',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8831a7c0-b9cc-44a4-8a19-182227ae9b81 tempest-VolumesActionsTest-270422599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d706603-6efc-4477-89c0-c27a97dd9114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8831a7c0-b9cc-44a4-8a19-182227ae9b81 tempest-VolumesActionsTest-270422599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d706603-6efc-4477-89c0-c27a97dd9114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8831a7c0-b9cc-44a4-8a19-182227ae9b81 tempest-VolumesActionsTest-270422599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26bd1bc3-5a49-4067-8d44-73377c5a77c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8831a7c0-b9cc-44a4-8a19-182227ae9b81 tempest-VolumesActionsTest-270422599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26bd1bc3-5a49-4067-8d44-73377c5a77c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8def1d0e-5a45-4fc8-8126-19bfd3057507', 'volume_name': 'volume-8def1d0e-5a45-4fc8-8126-19bfd3057507', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8831a7c0-b9cc-44a4-8a19-182227ae9b81 tempest-VolumesActionsTest-270422599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a10fb5f0-945a-406e-a5ee-b092662110b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8831a7c0-b9cc-44a4-8a19-182227ae9b81 tempest-VolumesActionsTest-270422599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a10fb5f0-945a-406e-a5ee-b092662110b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8831a7c0-b9cc-44a4-8a19-182227ae9b81 tempest-VolumesActionsTest-270422599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dc611d5-2991-4b12-9daf-1a46bf246001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:44 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-8831a7c0-b9cc-44a4-8a19-182227ae9b81 tempest-VolumesActionsTest-270422599 None] Volume 8def1d0e-5a45-4fc8-8126-19bfd3057507: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8def1d0e-5a45-4fc8-8126-19bfd3057507', 'volume_size': 1} Sep 10 16:46:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8831a7c0-b9cc-44a4-8a19-182227ae9b81 tempest-VolumesActionsTest-270422599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:46:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8831a7c0-b9cc-44a4-8a19-182227ae9b81 tempest-VolumesActionsTest-270422599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:46:44 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8831a7c0-b9cc-44a4-8a19-182227ae9b81 tempest-VolumesActionsTest-270422599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-252518696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8def1d0e-5a45-4fc8-8126-19bfd3057507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05493f9b55c249b3bbade563b2efeacb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:46:44Z,use_quota=True,user_id='9fd53ea5445c48bb891fda82e0b1a291',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:46:44 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-8831a7c0-b9cc-44a4-8a19-182227ae9b81 tempest-VolumesActionsTest-270422599 None] Creating volume 8def1d0e-5a45-4fc8-8126-19bfd3057507 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:46:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8831a7c0-b9cc-44a4-8a19-182227ae9b81 tempest-VolumesActionsTest-270422599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:46:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8831a7c0-b9cc-44a4-8a19-182227ae9b81 tempest-VolumesActionsTest-270422599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:46:44 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8831a7c0-b9cc-44a4-8a19-182227ae9b81 tempest-VolumesActionsTest-270422599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:46:44 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8831a7c0-b9cc-44a4-8a19-182227ae9b81 tempest-VolumesActionsTest-270422599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:46:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8831a7c0-b9cc-44a4-8a19-182227ae9b81 tempest-VolumesActionsTest-270422599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:46:44 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8831a7c0-b9cc-44a4-8a19-182227ae9b81 tempest-VolumesActionsTest-270422599 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:46:44 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-8831a7c0-b9cc-44a4-8a19-182227ae9b81 tempest-VolumesActionsTest-270422599 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:46:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8831a7c0-b9cc-44a4-8a19-182227ae9b81 tempest-VolumesActionsTest-270422599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:44 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-29a0198f-c090-48b6-a6f9-4ab1a0bca96b tempest-GroupSnapshotsV319Test-1646034878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb" returned: 0 in 0.826s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-29a0198f-c090-48b6-a6f9-4ab1a0bca96b tempest-GroupSnapshotsV319Test-1646034878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:44 devstack sudo[98726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507 1073741824 Sep 10 16:46:44 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:44 devstack sudo[98727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb Sep 10 16:46:44 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:45 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-29a0198f-c090-48b6-a6f9-4ab1a0bca96b tempest-GroupSnapshotsV319Test-1646034878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d928e000-0833-40a2-8954-31361e2ae7eb" returned: 0 in 0.460s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-29a0198f-c090-48b6-a6f9-4ab1a0bca96b tempest-GroupSnapshotsV319Test-1646034878 None] Lock "cinder-quobyte-d928e000-0833-40a2-8954-31361e2ae7eb" released by "delete_volume" :: held 1.428s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-29a0198f-c090-48b6-a6f9-4ab1a0bca96b tempest-GroupSnapshotsV319Test-1646034878 None] Created reservations ['646d16a1-2c07-49ff-a184-5c7924e02668'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:46:45 devstack cinder-volume[88189]: WARNING cinder.quota [None req-29a0198f-c090-48b6-a6f9-4ab1a0bca96b tempest-GroupSnapshotsV319Test-1646034878 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-321336672 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-321336672, it is now deprecated. Please use the default quota class for default quota. Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-29a0198f-c090-48b6-a6f9-4ab1a0bca96b tempest-GroupSnapshotsV319Test-1646034878 None] Created reservations ['72ab4237-1ab6-41d0-86de-6e668e63a60f', 'b51f7f27-313f-4e01-b6c9-70fa09a80c62', 'c94b457e-c8c2-49d3-8f54-180b23a3bbb6', '574d9ebe-2540-4bda-abea-25c290ec64d1'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:46:45 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8831a7c0-b9cc-44a4-8a19-182227ae9b81 tempest-VolumesActionsTest-270422599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507 1073741824" returned: 0 in 0.751s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8831a7c0-b9cc-44a4-8a19-182227ae9b81 tempest-VolumesActionsTest-270422599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:45 devstack sudo[98735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507 Sep 10 16:46:45 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab32a254-90b4-4d86-accd-5a78bb36b327 tempest-VolumesCloneNegativeTest-1828667110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ab32a254-90b4-4d86-accd-5a78bb36b327 tempest-VolumesCloneNegativeTest-1828667110 None] Flow 'volume_create_manager' (c9a0fa40-cda6-4be4-8556-87664e12dee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ab32a254-90b4-4d86-accd-5a78bb36b327 tempest-VolumesCloneNegativeTest-1828667110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ca80d1-d676-4f10-866f-1424862dff01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ab32a254-90b4-4d86-accd-5a78bb36b327 tempest-VolumesCloneNegativeTest-1828667110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ca80d1-d676-4f10-866f-1424862dff01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1170973980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=693e846f-8b0c-40db-afd7-b32127eacc08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='244a05b676a346fe95a5d4a6353ad970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:46:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:46:45Z,use_quota=True,user_id='1f32aaa70c48498db4ca9cbf20d76419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ab32a254-90b4-4d86-accd-5a78bb36b327 tempest-VolumesCloneNegativeTest-1828667110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (728c96ec-f97d-4c8a-95ce-516cc60247c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ab32a254-90b4-4d86-accd-5a78bb36b327 tempest-VolumesCloneNegativeTest-1828667110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (728c96ec-f97d-4c8a-95ce-516cc60247c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ab32a254-90b4-4d86-accd-5a78bb36b327 tempest-VolumesCloneNegativeTest-1828667110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0e1e1e0-5c05-4865-a9af-63c701c077b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ab32a254-90b4-4d86-accd-5a78bb36b327 tempest-VolumesCloneNegativeTest-1828667110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0e1e1e0-5c05-4865-a9af-63c701c077b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '693e846f-8b0c-40db-afd7-b32127eacc08', 'volume_name': 'volume-693e846f-8b0c-40db-afd7-b32127eacc08', 'volume_size': 2}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ab32a254-90b4-4d86-accd-5a78bb36b327 tempest-VolumesCloneNegativeTest-1828667110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ef287d-4a86-401e-b9d2-c5da67829ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ab32a254-90b4-4d86-accd-5a78bb36b327 tempest-VolumesCloneNegativeTest-1828667110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ef287d-4a86-401e-b9d2-c5da67829ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ab32a254-90b4-4d86-accd-5a78bb36b327 tempest-VolumesCloneNegativeTest-1828667110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ab2c15f-fb70-4778-a4eb-95112c7484d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:45 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-ab32a254-90b4-4d86-accd-5a78bb36b327 tempest-VolumesCloneNegativeTest-1828667110 None] Volume 693e846f-8b0c-40db-afd7-b32127eacc08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-693e846f-8b0c-40db-afd7-b32127eacc08', 'volume_size': 2} Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ab32a254-90b4-4d86-accd-5a78bb36b327 tempest-VolumesCloneNegativeTest-1828667110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-29a0198f-c090-48b6-a6f9-4ab1a0bca96b tempest-GroupSnapshotsV319Test-1646034878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-29a0198f-c090-48b6-a6f9-4ab1a0bca96b tempest-GroupSnapshotsV319Test-1646034878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-29a0198f-c090-48b6-a6f9-4ab1a0bca96b tempest-GroupSnapshotsV319Test-1646034878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-29a0198f-c090-48b6-a6f9-4ab1a0bca96b tempest-GroupSnapshotsV319Test-1646034878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-29a0198f-c090-48b6-a6f9-4ab1a0bca96b tempest-GroupSnapshotsV319Test-1646034878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-29a0198f-c090-48b6-a6f9-4ab1a0bca96b tempest-GroupSnapshotsV319Test-1646034878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:45 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:46:45 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:45 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8831a7c0-b9cc-44a4-8a19-182227ae9b81 tempest-VolumesActionsTest-270422599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507" returned: 0 in 0.278s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8831a7c0-b9cc-44a4-8a19-182227ae9b81 tempest-VolumesActionsTest-270422599 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8831a7c0-b9cc-44a4-8a19-182227ae9b81 tempest-VolumesActionsTest-270422599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ab32a254-90b4-4d86-accd-5a78bb36b327 tempest-VolumesCloneNegativeTest-1828667110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.152s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ab32a254-90b4-4d86-accd-5a78bb36b327 tempest-VolumesCloneNegativeTest-1828667110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1170973980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=693e846f-8b0c-40db-afd7-b32127eacc08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='244a05b676a346fe95a5d4a6353ad970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:46:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:46:45Z,use_quota=True,user_id='1f32aaa70c48498db4ca9cbf20d76419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-ab32a254-90b4-4d86-accd-5a78bb36b327 tempest-VolumesCloneNegativeTest-1828667110 None] Creating volume 693e846f-8b0c-40db-afd7-b32127eacc08 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ab32a254-90b4-4d86-accd-5a78bb36b327 tempest-VolumesCloneNegativeTest-1828667110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ab32a254-90b4-4d86-accd-5a78bb36b327 tempest-VolumesCloneNegativeTest-1828667110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ab32a254-90b4-4d86-accd-5a78bb36b327 tempest-VolumesCloneNegativeTest-1828667110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ab32a254-90b4-4d86-accd-5a78bb36b327 tempest-VolumesCloneNegativeTest-1828667110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ab32a254-90b4-4d86-accd-5a78bb36b327 tempest-VolumesCloneNegativeTest-1828667110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ab32a254-90b4-4d86-accd-5a78bb36b327 tempest-VolumesCloneNegativeTest-1828667110 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:46:45 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-ab32a254-90b4-4d86-accd-5a78bb36b327 tempest-VolumesCloneNegativeTest-1828667110 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ab32a254-90b4-4d86-accd-5a78bb36b327 tempest-VolumesCloneNegativeTest-1828667110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-693e846f-8b0c-40db-afd7-b32127eacc08 2147483648 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8831a7c0-b9cc-44a4-8a19-182227ae9b81 tempest-VolumesActionsTest-270422599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dc611d5-2991-4b12-9daf-1a46bf246001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8def1d0e-5a45-4fc8-8126-19bfd3057507', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:45 devstack sudo[98740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-693e846f-8b0c-40db-afd7-b32127eacc08 2147483648 Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8831a7c0-b9cc-44a4-8a19-182227ae9b81 tempest-VolumesActionsTest-270422599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (575296c0-3975-49af-80ec-21935f8eb523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:45 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:45 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-8831a7c0-b9cc-44a4-8a19-182227ae9b81 tempest-VolumesActionsTest-270422599 None] Volume volume-8def1d0e-5a45-4fc8-8126-19bfd3057507 (8def1d0e-5a45-4fc8-8126-19bfd3057507): created successfully Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8831a7c0-b9cc-44a4-8a19-182227ae9b81 tempest-VolumesActionsTest-270422599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (575296c0-3975-49af-80ec-21935f8eb523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8831a7c0-b9cc-44a4-8a19-182227ae9b81 tempest-VolumesActionsTest-270422599 None] Flow 'volume_create_manager' (8647a41d-287f-430b-b744-1ac6c7061431) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:46:45 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-8831a7c0-b9cc-44a4-8a19-182227ae9b81 tempest-VolumesActionsTest-270422599 None] Created volume successfully. Sep 10 16:46:45 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-29a0198f-c090-48b6-a6f9-4ab1a0bca96b tempest-GroupSnapshotsV319Test-1646034878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.295s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:45 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-29a0198f-c090-48b6-a6f9-4ab1a0bca96b tempest-GroupSnapshotsV319Test-1646034878 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:46:45 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-29a0198f-c090-48b6-a6f9-4ab1a0bca96b tempest-GroupSnapshotsV319Test-1646034878 None] Delete group completed successfully. Sep 10 16:46:46 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ab32a254-90b4-4d86-accd-5a78bb36b327 tempest-VolumesCloneNegativeTest-1828667110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-693e846f-8b0c-40db-afd7-b32127eacc08 2147483648" returned: 0 in 0.643s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ab32a254-90b4-4d86-accd-5a78bb36b327 tempest-VolumesCloneNegativeTest-1828667110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-693e846f-8b0c-40db-afd7-b32127eacc08 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:46 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-693e846f-8b0c-40db-afd7-b32127eacc08 Sep 10 16:46:46 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:46 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ab32a254-90b4-4d86-accd-5a78bb36b327 tempest-VolumesCloneNegativeTest-1828667110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-693e846f-8b0c-40db-afd7-b32127eacc08" returned: 0 in 0.413s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:46 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ab32a254-90b4-4d86-accd-5a78bb36b327 tempest-VolumesCloneNegativeTest-1828667110 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:46:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ab32a254-90b4-4d86-accd-5a78bb36b327 tempest-VolumesCloneNegativeTest-1828667110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:46:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ab32a254-90b4-4d86-accd-5a78bb36b327 tempest-VolumesCloneNegativeTest-1828667110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ab2c15f-fb70-4778-a4eb-95112c7484d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-693e846f-8b0c-40db-afd7-b32127eacc08', 'volume_size': 2}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ab32a254-90b4-4d86-accd-5a78bb36b327 tempest-VolumesCloneNegativeTest-1828667110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abdb5e51-5a01-4814-93db-a6c934acca6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:46:46 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-ab32a254-90b4-4d86-accd-5a78bb36b327 tempest-VolumesCloneNegativeTest-1828667110 None] Volume volume-693e846f-8b0c-40db-afd7-b32127eacc08 (693e846f-8b0c-40db-afd7-b32127eacc08): created successfully Sep 10 16:46:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ab32a254-90b4-4d86-accd-5a78bb36b327 tempest-VolumesCloneNegativeTest-1828667110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abdb5e51-5a01-4814-93db-a6c934acca6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:46:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ab32a254-90b4-4d86-accd-5a78bb36b327 tempest-VolumesCloneNegativeTest-1828667110 None] Flow 'volume_create_manager' (c9a0fa40-cda6-4be4-8556-87664e12dee2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:46:46 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-ab32a254-90b4-4d86-accd-5a78bb36b327 tempest-VolumesCloneNegativeTest-1828667110 None] Created volume successfully. Sep 10 16:46:47 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8620828a-49bd-4135-9be8-57a757088eb6 tempest-VolumesCloneNegativeTest-1828667110 None] Acquiring lock "cinder-693e846f-8b0c-40db-afd7-b32127eacc08-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:46:47 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8620828a-49bd-4135-9be8-57a757088eb6 tempest-VolumesCloneNegativeTest-1828667110 None] Lock "cinder-693e846f-8b0c-40db-afd7-b32127eacc08-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:46:47 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8620828a-49bd-4135-9be8-57a757088eb6 tempest-VolumesCloneNegativeTest-1828667110 None] Acquiring lock "cinder-quobyte-693e846f-8b0c-40db-afd7-b32127eacc08" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:46:47 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8620828a-49bd-4135-9be8-57a757088eb6 tempest-VolumesCloneNegativeTest-1828667110 None] Lock "cinder-quobyte-693e846f-8b0c-40db-afd7-b32127eacc08" acquired by "delete_volume" :: waited 0.032s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:46:47 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[29475541-84e8-4ffb-853e-253c828c9aa0]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:46:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8620828a-49bd-4135-9be8-57a757088eb6 tempest-VolumesCloneNegativeTest-1828667110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-693e846f-8b0c-40db-afd7-b32127eacc08 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:48 devstack sudo[98753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-693e846f-8b0c-40db-afd7-b32127eacc08 Sep 10 16:46:48 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:48 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8620828a-49bd-4135-9be8-57a757088eb6 tempest-VolumesCloneNegativeTest-1828667110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-693e846f-8b0c-40db-afd7-b32127eacc08" returned: 0 in 0.589s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8620828a-49bd-4135-9be8-57a757088eb6 tempest-VolumesCloneNegativeTest-1828667110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-693e846f-8b0c-40db-afd7-b32127eacc08 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:48 devstack sudo[98759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-693e846f-8b0c-40db-afd7-b32127eacc08 Sep 10 16:46:48 devstack sudo[98759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:48 devstack sudo[98759]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8620828a-49bd-4135-9be8-57a757088eb6 tempest-VolumesCloneNegativeTest-1828667110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-693e846f-8b0c-40db-afd7-b32127eacc08" returned: 0 in 0.388s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:48 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8620828a-49bd-4135-9be8-57a757088eb6 tempest-VolumesCloneNegativeTest-1828667110 None] Lock "cinder-quobyte-693e846f-8b0c-40db-afd7-b32127eacc08" released by "delete_volume" :: held 1.085s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:46:49 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-8620828a-49bd-4135-9be8-57a757088eb6 tempest-VolumesCloneNegativeTest-1828667110 None] Created reservations ['25a99f98-d767-4d23-8e61-23763cb49a43', '2037a293-05ad-492f-a73a-0f981fba5e03', 'fd2043b2-490e-46b9-9b7e-8e1f2f9b0289', '546b969a-87c4-4fc8-b887-ecc37c4e24dd'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:46:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8620828a-49bd-4135-9be8-57a757088eb6 tempest-VolumesCloneNegativeTest-1828667110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:46:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8620828a-49bd-4135-9be8-57a757088eb6 tempest-VolumesCloneNegativeTest-1828667110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:46:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8620828a-49bd-4135-9be8-57a757088eb6 tempest-VolumesCloneNegativeTest-1828667110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:46:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8620828a-49bd-4135-9be8-57a757088eb6 tempest-VolumesCloneNegativeTest-1828667110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:46:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8620828a-49bd-4135-9be8-57a757088eb6 tempest-VolumesCloneNegativeTest-1828667110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:46:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8620828a-49bd-4135-9be8-57a757088eb6 tempest-VolumesCloneNegativeTest-1828667110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:49 devstack sudo[98769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:46:49 devstack sudo[98769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:46:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:46:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:46:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:46:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:46:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:46:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:46:49 devstack sudo[98772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:46:49 devstack sudo[98772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:46:49 devstack sudo[98769]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8620828a-49bd-4135-9be8-57a757088eb6 tempest-VolumesCloneNegativeTest-1828667110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.386s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:49 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-8620828a-49bd-4135-9be8-57a757088eb6 tempest-VolumesCloneNegativeTest-1828667110 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:46:49 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-8620828a-49bd-4135-9be8-57a757088eb6 tempest-VolumesCloneNegativeTest-1828667110 None] Deleted volume successfully. Sep 10 16:46:49 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8620828a-49bd-4135-9be8-57a757088eb6 tempest-VolumesCloneNegativeTest-1828667110 None] Lock "cinder-693e846f-8b0c-40db-afd7-b32127eacc08-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:46:49 devstack sudo[98772]: pam_unix(sudo:session): session closed for user root Sep 10 16:46:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.391s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:46:49 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:46:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager._thread_info {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:46:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread count: 28 {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 16:46:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread info: [<_MainThread(MainThread, started 125792070905984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 16:46:56 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-c920f10f-f7dd-406a-b9f9-483bef6fc485 tempest-GroupsTest-929656509 None] Group tempest-Group1-1171277414: creating Sep 10 16:46:56 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-c920f10f-f7dd-406a-b9f9-483bef6fc485 tempest-GroupsTest-929656509 None] Group tempest-Group1-1171277414: created successfully Sep 10 16:46:56 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-c920f10f-f7dd-406a-b9f9-483bef6fc485 tempest-GroupsTest-929656509 None] Create group completed successfully. Sep 10 16:46:57 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a38c9f30-8ed3-4272-ba68-8452d88d3103 tempest-VolumesActionsTest-270422599 None] Acquiring lock "cinder-8def1d0e-5a45-4fc8-8126-19bfd3057507" by "attach_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:46:57 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a38c9f30-8ed3-4272-ba68-8452d88d3103 tempest-VolumesActionsTest-270422599 None] Lock "cinder-8def1d0e-5a45-4fc8-8126-19bfd3057507" acquired by "attach_volume" :: waited 0.027s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:46:57 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-a38c9f30-8ed3-4272-ba68-8452d88d3103 tempest-VolumesActionsTest-270422599 None] Attaching volume 8def1d0e-5a45-4fc8-8126-19bfd3057507 to instance 77087d89-3402-49ab-8846-0b8ddd626e05 at mountpoint /dev/vdb on host None. Sep 10 16:46:57 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-a38c9f30-8ed3-4272-ba68-8452d88d3103 tempest-VolumesActionsTest-270422599 None] Attach volume completed successfully. Sep 10 16:46:57 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a38c9f30-8ed3-4272-ba68-8452d88d3103 tempest-VolumesActionsTest-270422599 None] Lock "cinder-8def1d0e-5a45-4fc8-8126-19bfd3057507" released by "attach_volume" :: held 0.102s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:46:57 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-29f031c5-6270-4937-a752-085259473d0f tempest-VolumesActionsTest-270422599 None] Acquiring lock "cinder-8def1d0e-5a45-4fc8-8126-19bfd3057507-detach_volume" by "detach_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:46:57 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-29f031c5-6270-4937-a752-085259473d0f tempest-VolumesActionsTest-270422599 None] Lock "cinder-8def1d0e-5a45-4fc8-8126-19bfd3057507-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:46:57 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-29f031c5-6270-4937-a752-085259473d0f tempest-VolumesActionsTest-270422599 None] Detaching volume 8def1d0e-5a45-4fc8-8126-19bfd3057507 from instance 77087d89-3402-49ab-8846-0b8ddd626e05. Sep 10 16:46:57 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-29f031c5-6270-4937-a752-085259473d0f tempest-VolumesActionsTest-270422599 None] Detach volume completed successfully. Sep 10 16:46:57 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-29f031c5-6270-4937-a752-085259473d0f tempest-VolumesActionsTest-270422599 None] Lock "cinder-8def1d0e-5a45-4fc8-8126-19bfd3057507-detach_volume" released by "detach_volume" :: held 0.074s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:46:58 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-7d3ee6b3-14b0-4daa-b1bc-ad42ce7c11a4 tempest-GroupsTest-929656509 None] Group tempest-Group2-162302965: creating Sep 10 16:46:58 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-7d3ee6b3-14b0-4daa-b1bc-ad42ce7c11a4 tempest-GroupsTest-929656509 None] Group tempest-Group2-162302965: created successfully Sep 10 16:46:58 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-7d3ee6b3-14b0-4daa-b1bc-ad42ce7c11a4 tempest-GroupsTest-929656509 None] Create group completed successfully. Sep 10 16:47:00 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-6072180c-4fee-4a5d-9b3c-347cb4c1baff tempest-GroupsTest-929656509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:47:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6072180c-4fee-4a5d-9b3c-347cb4c1baff tempest-GroupsTest-929656509 None] Flow 'volume_create_manager' (70615e7e-5f88-484d-9b26-5a79de297c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:47:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6072180c-4fee-4a5d-9b3c-347cb4c1baff tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (037e72ff-3562-41ad-a385-af99ea9a0e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6072180c-4fee-4a5d-9b3c-347cb4c1baff tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (037e72ff-3562-41ad-a385-af99ea9a0e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1986761589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=edad94cd-42de-41bd-8e60-cfda2cb0d785,host='devstack@QuobyteHD#QuobyteHD',id=66afafa9-4524-4072-a563-e968b1e4eb85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c046d708044962b232104657e796a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:47:00Z,use_quota=True,user_id='d6f50da4e98b4fc2b8b673992677d765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ae38f16-8f68-4079-b4b8-f4d93e34cab6),volume_type_id=2ae38f16-8f68-4079-b4b8-f4d93e34cab6)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6072180c-4fee-4a5d-9b3c-347cb4c1baff tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d88cbb11-9936-44b3-945e-18678848d5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6072180c-4fee-4a5d-9b3c-347cb4c1baff tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d88cbb11-9936-44b3-945e-18678848d5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6072180c-4fee-4a5d-9b3c-347cb4c1baff tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1dde0bf-10d0-445f-9c8e-5c2d4e434c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6072180c-4fee-4a5d-9b3c-347cb4c1baff tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1dde0bf-10d0-445f-9c8e-5c2d4e434c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66afafa9-4524-4072-a563-e968b1e4eb85', 'volume_name': 'volume-66afafa9-4524-4072-a563-e968b1e4eb85', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6072180c-4fee-4a5d-9b3c-347cb4c1baff tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db6420bc-8ca8-49b5-a8cb-1c76778d1cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6072180c-4fee-4a5d-9b3c-347cb4c1baff tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db6420bc-8ca8-49b5-a8cb-1c76778d1cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6072180c-4fee-4a5d-9b3c-347cb4c1baff tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae4c36f1-e799-4c3e-a929-2c61e8c6a6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:00 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-6072180c-4fee-4a5d-9b3c-347cb4c1baff tempest-GroupsTest-929656509 None] Volume 66afafa9-4524-4072-a563-e968b1e4eb85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66afafa9-4524-4072-a563-e968b1e4eb85', 'volume_size': 1} Sep 10 16:47:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6072180c-4fee-4a5d-9b3c-347cb4c1baff tempest-GroupsTest-929656509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:47:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6072180c-4fee-4a5d-9b3c-347cb4c1baff tempest-GroupsTest-929656509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:47:00 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6072180c-4fee-4a5d-9b3c-347cb4c1baff tempest-GroupsTest-929656509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=edad94cd-42de-41bd-8e60-cfda2cb0d785,created_at=2026-09-10T14:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1986761589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=edad94cd-42de-41bd-8e60-cfda2cb0d785,host='devstack@QuobyteHD#QuobyteHD',id=66afafa9-4524-4072-a563-e968b1e4eb85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c046d708044962b232104657e796a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:47:00Z,use_quota=True,user_id='d6f50da4e98b4fc2b8b673992677d765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ae38f16-8f68-4079-b4b8-f4d93e34cab6),volume_type_id=2ae38f16-8f68-4079-b4b8-f4d93e34cab6)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:47:00 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-6072180c-4fee-4a5d-9b3c-347cb4c1baff tempest-GroupsTest-929656509 None] Creating volume 66afafa9-4524-4072-a563-e968b1e4eb85 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:47:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6072180c-4fee-4a5d-9b3c-347cb4c1baff tempest-GroupsTest-929656509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:47:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6072180c-4fee-4a5d-9b3c-347cb4c1baff tempest-GroupsTest-929656509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:47:00 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6072180c-4fee-4a5d-9b3c-347cb4c1baff tempest-GroupsTest-929656509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:47:00 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6072180c-4fee-4a5d-9b3c-347cb4c1baff tempest-GroupsTest-929656509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:47:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6072180c-4fee-4a5d-9b3c-347cb4c1baff tempest-GroupsTest-929656509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:47:00 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6072180c-4fee-4a5d-9b3c-347cb4c1baff tempest-GroupsTest-929656509 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:47:00 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-6072180c-4fee-4a5d-9b3c-347cb4c1baff tempest-GroupsTest-929656509 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:47:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6072180c-4fee-4a5d-9b3c-347cb4c1baff tempest-GroupsTest-929656509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-66afafa9-4524-4072-a563-e968b1e4eb85 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:00 devstack sudo[98901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-66afafa9-4524-4072-a563-e968b1e4eb85 1073741824 Sep 10 16:47:00 devstack sudo[98901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:00 devstack sudo[98901]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6072180c-4fee-4a5d-9b3c-347cb4c1baff tempest-GroupsTest-929656509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-66afafa9-4524-4072-a563-e968b1e4eb85 1073741824" returned: 0 in 0.459s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6072180c-4fee-4a5d-9b3c-347cb4c1baff tempest-GroupsTest-929656509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-66afafa9-4524-4072-a563-e968b1e4eb85 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:00 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-66afafa9-4524-4072-a563-e968b1e4eb85 Sep 10 16:47:00 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:00 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6072180c-4fee-4a5d-9b3c-347cb4c1baff tempest-GroupsTest-929656509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-66afafa9-4524-4072-a563-e968b1e4eb85" returned: 0 in 0.281s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:00 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6072180c-4fee-4a5d-9b3c-347cb4c1baff tempest-GroupsTest-929656509 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:47:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6072180c-4fee-4a5d-9b3c-347cb4c1baff tempest-GroupsTest-929656509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:47:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6072180c-4fee-4a5d-9b3c-347cb4c1baff tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae4c36f1-e799-4c3e-a929-2c61e8c6a6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66afafa9-4524-4072-a563-e968b1e4eb85', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6072180c-4fee-4a5d-9b3c-347cb4c1baff tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (986aaa8b-9552-496b-bac4-5c9d1f1c95f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:00 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-6072180c-4fee-4a5d-9b3c-347cb4c1baff tempest-GroupsTest-929656509 None] Volume volume-66afafa9-4524-4072-a563-e968b1e4eb85 (66afafa9-4524-4072-a563-e968b1e4eb85): created successfully Sep 10 16:47:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6072180c-4fee-4a5d-9b3c-347cb4c1baff tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (986aaa8b-9552-496b-bac4-5c9d1f1c95f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6072180c-4fee-4a5d-9b3c-347cb4c1baff tempest-GroupsTest-929656509 None] Flow 'volume_create_manager' (70615e7e-5f88-484d-9b26-5a79de297c50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:47:00 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-6072180c-4fee-4a5d-9b3c-347cb4c1baff tempest-GroupsTest-929656509 None] Created volume successfully. Sep 10 16:47:01 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f175dc0-2077-4b16-be17-b28f3752739c tempest-VolumesListTestJSON-690261169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:47:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2f175dc0-2077-4b16-be17-b28f3752739c tempest-VolumesListTestJSON-690261169 None] Flow 'volume_create_manager' (5da532af-595e-44e3-8258-43eed720e035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:47:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2f175dc0-2077-4b16-be17-b28f3752739c tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b14580f4-55bb-43cf-90bc-dd97606d13e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2f175dc0-2077-4b16-be17-b28f3752739c tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b14580f4-55bb-43cf-90bc-dd97606d13e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-479946589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60e431e8-c568-4694-9fa1-b9d5e047d80e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1fefd9831ea64f9f9b4b4ac157a1e3f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:47:01Z,use_quota=True,user_id='4763e0645a1343e0a575b152307dbb28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2f175dc0-2077-4b16-be17-b28f3752739c tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b316d25-ccf5-403d-ba8a-51313a1b61fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2f175dc0-2077-4b16-be17-b28f3752739c tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b316d25-ccf5-403d-ba8a-51313a1b61fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2f175dc0-2077-4b16-be17-b28f3752739c tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9672720d-a0dc-4afa-a154-1fe6cb4cd764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2f175dc0-2077-4b16-be17-b28f3752739c tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9672720d-a0dc-4afa-a154-1fe6cb4cd764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60e431e8-c568-4694-9fa1-b9d5e047d80e', 'volume_name': 'volume-60e431e8-c568-4694-9fa1-b9d5e047d80e', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2f175dc0-2077-4b16-be17-b28f3752739c tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad3aa4c1-2794-4c48-9f5a-45b5eec50660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2f175dc0-2077-4b16-be17-b28f3752739c tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad3aa4c1-2794-4c48-9f5a-45b5eec50660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2f175dc0-2077-4b16-be17-b28f3752739c tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f9813f1-c109-4a9d-89fd-e3c7f93673db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:01 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-2f175dc0-2077-4b16-be17-b28f3752739c tempest-VolumesListTestJSON-690261169 None] Volume 60e431e8-c568-4694-9fa1-b9d5e047d80e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60e431e8-c568-4694-9fa1-b9d5e047d80e', 'volume_size': 1} Sep 10 16:47:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2f175dc0-2077-4b16-be17-b28f3752739c tempest-VolumesListTestJSON-690261169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:47:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2f175dc0-2077-4b16-be17-b28f3752739c tempest-VolumesListTestJSON-690261169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:47:01 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-2f175dc0-2077-4b16-be17-b28f3752739c tempest-VolumesListTestJSON-690261169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-479946589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60e431e8-c568-4694-9fa1-b9d5e047d80e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1fefd9831ea64f9f9b4b4ac157a1e3f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:47:01Z,use_quota=True,user_id='4763e0645a1343e0a575b152307dbb28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:47:01 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-2f175dc0-2077-4b16-be17-b28f3752739c tempest-VolumesListTestJSON-690261169 None] Creating volume 60e431e8-c568-4694-9fa1-b9d5e047d80e {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:47:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2f175dc0-2077-4b16-be17-b28f3752739c tempest-VolumesListTestJSON-690261169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:47:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2f175dc0-2077-4b16-be17-b28f3752739c tempest-VolumesListTestJSON-690261169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:47:01 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-2f175dc0-2077-4b16-be17-b28f3752739c tempest-VolumesListTestJSON-690261169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:47:01 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-2f175dc0-2077-4b16-be17-b28f3752739c tempest-VolumesListTestJSON-690261169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:47:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2f175dc0-2077-4b16-be17-b28f3752739c tempest-VolumesListTestJSON-690261169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:47:01 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-2f175dc0-2077-4b16-be17-b28f3752739c tempest-VolumesListTestJSON-690261169 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:47:01 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-2f175dc0-2077-4b16-be17-b28f3752739c tempest-VolumesListTestJSON-690261169 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:47:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2f175dc0-2077-4b16-be17-b28f3752739c tempest-VolumesListTestJSON-690261169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-60e431e8-c568-4694-9fa1-b9d5e047d80e 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:01 devstack sudo[98911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-60e431e8-c568-4694-9fa1-b9d5e047d80e 1073741824 Sep 10 16:47:01 devstack sudo[98911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:02 devstack sudo[98911]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2f175dc0-2077-4b16-be17-b28f3752739c tempest-VolumesListTestJSON-690261169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-60e431e8-c568-4694-9fa1-b9d5e047d80e 1073741824" returned: 0 in 0.692s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d4e55c98-3bf6-482a-926a-92cf520530d3 tempest-GroupsTest-929656509 None] Acquiring lock "cinder-quobyte-66afafa9-4524-4072-a563-e968b1e4eb85" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:47:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2f175dc0-2077-4b16-be17-b28f3752739c tempest-VolumesListTestJSON-690261169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-60e431e8-c568-4694-9fa1-b9d5e047d80e {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d4e55c98-3bf6-482a-926a-92cf520530d3 tempest-GroupsTest-929656509 None] Lock "cinder-quobyte-66afafa9-4524-4072-a563-e968b1e4eb85" acquired by "delete_volume" :: waited 0.053s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:47:02 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-60e431e8-c568-4694-9fa1-b9d5e047d80e Sep 10 16:47:02 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:02 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[588f7f3e-0a8e-4007-8d1f-e4273c972ea0]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:47:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d4e55c98-3bf6-482a-926a-92cf520530d3 tempest-GroupsTest-929656509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-66afafa9-4524-4072-a563-e968b1e4eb85 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:02 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-66afafa9-4524-4072-a563-e968b1e4eb85 Sep 10 16:47:02 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:02 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2f175dc0-2077-4b16-be17-b28f3752739c tempest-VolumesListTestJSON-690261169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-60e431e8-c568-4694-9fa1-b9d5e047d80e" returned: 0 in 0.327s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:02 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-2f175dc0-2077-4b16-be17-b28f3752739c tempest-VolumesListTestJSON-690261169 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:47:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2f175dc0-2077-4b16-be17-b28f3752739c tempest-VolumesListTestJSON-690261169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:47:02 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2f175dc0-2077-4b16-be17-b28f3752739c tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f9813f1-c109-4a9d-89fd-e3c7f93673db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60e431e8-c568-4694-9fa1-b9d5e047d80e', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:02 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2f175dc0-2077-4b16-be17-b28f3752739c tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c0210f5-533f-4af3-b0c1-331e8aa811bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:02 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-2f175dc0-2077-4b16-be17-b28f3752739c tempest-VolumesListTestJSON-690261169 None] Volume volume-60e431e8-c568-4694-9fa1-b9d5e047d80e (60e431e8-c568-4694-9fa1-b9d5e047d80e): created successfully Sep 10 16:47:02 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2f175dc0-2077-4b16-be17-b28f3752739c tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c0210f5-533f-4af3-b0c1-331e8aa811bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:02 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2f175dc0-2077-4b16-be17-b28f3752739c tempest-VolumesListTestJSON-690261169 None] Flow 'volume_create_manager' (5da532af-595e-44e3-8258-43eed720e035) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:47:02 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-2f175dc0-2077-4b16-be17-b28f3752739c tempest-VolumesListTestJSON-690261169 None] Created volume successfully. Sep 10 16:47:02 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d4e55c98-3bf6-482a-926a-92cf520530d3 tempest-GroupsTest-929656509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-66afafa9-4524-4072-a563-e968b1e4eb85" returned: 0 in 0.486s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d4e55c98-3bf6-482a-926a-92cf520530d3 tempest-GroupsTest-929656509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-66afafa9-4524-4072-a563-e968b1e4eb85 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:02 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-66afafa9-4524-4072-a563-e968b1e4eb85 Sep 10 16:47:02 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:03 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d4e55c98-3bf6-482a-926a-92cf520530d3 tempest-GroupsTest-929656509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-66afafa9-4524-4072-a563-e968b1e4eb85" returned: 0 in 0.330s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d4e55c98-3bf6-482a-926a-92cf520530d3 tempest-GroupsTest-929656509 None] Lock "cinder-quobyte-66afafa9-4524-4072-a563-e968b1e4eb85" released by "delete_volume" :: held 0.940s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:47:03 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-d4e55c98-3bf6-482a-926a-92cf520530d3 tempest-GroupsTest-929656509 None] Created reservations ['98152cef-9be7-4341-909d-c16850c3bd35'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:47:03 devstack cinder-volume[88189]: WARNING cinder.quota [None req-d4e55c98-3bf6-482a-926a-92cf520530d3 tempest-GroupsTest-929656509 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-171915867 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-171915867, it is now deprecated. Please use the default quota class for default quota. Sep 10 16:47:03 devstack cinder-volume[88189]: WARNING cinder.quota [None req-d4e55c98-3bf6-482a-926a-92cf520530d3 tempest-GroupsTest-929656509 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-171915867 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-171915867, it is now deprecated. Please use the default quota class for default quota. Sep 10 16:47:03 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-d4e55c98-3bf6-482a-926a-92cf520530d3 tempest-GroupsTest-929656509 None] Created reservations ['f50fa917-995c-46a9-bc6d-cfc971fd786c', '0a55643c-15ea-4f09-940a-a54ed08bceb5', '2a4f1d71-79bc-4313-b01b-c3420966f94d', '0d14483f-4ea3-4571-a05c-bbea26e696cf'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:47:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d4e55c98-3bf6-482a-926a-92cf520530d3 tempest-GroupsTest-929656509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:47:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d4e55c98-3bf6-482a-926a-92cf520530d3 tempest-GroupsTest-929656509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:47:03 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d4e55c98-3bf6-482a-926a-92cf520530d3 tempest-GroupsTest-929656509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:47:03 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d4e55c98-3bf6-482a-926a-92cf520530d3 tempest-GroupsTest-929656509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:47:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d4e55c98-3bf6-482a-926a-92cf520530d3 tempest-GroupsTest-929656509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:47:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d4e55c98-3bf6-482a-926a-92cf520530d3 tempest-GroupsTest-929656509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:03 devstack sudo[98934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:47:03 devstack sudo[98934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:03 devstack sudo[98934]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d4e55c98-3bf6-482a-926a-92cf520530d3 tempest-GroupsTest-929656509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.346s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:03 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-d4e55c98-3bf6-482a-926a-92cf520530d3 tempest-GroupsTest-929656509 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:47:03 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-d4e55c98-3bf6-482a-926a-92cf520530d3 tempest-GroupsTest-929656509 None] Delete group completed successfully. Sep 10 16:47:04 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dfe1ac7-64f5-4106-a8ef-ad9dfed84fee tempest-VolumesListTestJSON-690261169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:47:04 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1dfe1ac7-64f5-4106-a8ef-ad9dfed84fee tempest-VolumesListTestJSON-690261169 None] Flow 'volume_create_manager' (c22a2575-6c05-4c89-bfb2-b73928f4967f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:47:04 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1dfe1ac7-64f5-4106-a8ef-ad9dfed84fee tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a61170d-7e00-4010-b722-08213233bbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:04 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1dfe1ac7-64f5-4106-a8ef-ad9dfed84fee tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a61170d-7e00-4010-b722-08213233bbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1448745493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eedae53-a499-46c5-9f63-d05d22da4747,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1fefd9831ea64f9f9b4b4ac157a1e3f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:47:04Z,use_quota=True,user_id='4763e0645a1343e0a575b152307dbb28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:04 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1dfe1ac7-64f5-4106-a8ef-ad9dfed84fee tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da2393d2-f7af-495e-a89f-8de039149703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:04 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1dfe1ac7-64f5-4106-a8ef-ad9dfed84fee tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da2393d2-f7af-495e-a89f-8de039149703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:04 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1dfe1ac7-64f5-4106-a8ef-ad9dfed84fee tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4264d847-f5f5-4971-ac1c-7740acced2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:04 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1dfe1ac7-64f5-4106-a8ef-ad9dfed84fee tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4264d847-f5f5-4971-ac1c-7740acced2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eedae53-a499-46c5-9f63-d05d22da4747', 'volume_name': 'volume-0eedae53-a499-46c5-9f63-d05d22da4747', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:04 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1dfe1ac7-64f5-4106-a8ef-ad9dfed84fee tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f81fd4b6-ba34-4da2-90dd-a70cd1fde009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:04 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1dfe1ac7-64f5-4106-a8ef-ad9dfed84fee tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f81fd4b6-ba34-4da2-90dd-a70cd1fde009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:04 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1dfe1ac7-64f5-4106-a8ef-ad9dfed84fee tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83fe689-ffd1-4606-a8b2-cebf3019e80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:04 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-1dfe1ac7-64f5-4106-a8ef-ad9dfed84fee tempest-VolumesListTestJSON-690261169 None] Volume 0eedae53-a499-46c5-9f63-d05d22da4747: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eedae53-a499-46c5-9f63-d05d22da4747', 'volume_size': 1} Sep 10 16:47:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-1dfe1ac7-64f5-4106-a8ef-ad9dfed84fee tempest-VolumesListTestJSON-690261169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:47:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-1dfe1ac7-64f5-4106-a8ef-ad9dfed84fee tempest-VolumesListTestJSON-690261169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:47:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-1dfe1ac7-64f5-4106-a8ef-ad9dfed84fee tempest-VolumesListTestJSON-690261169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1448745493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eedae53-a499-46c5-9f63-d05d22da4747,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1fefd9831ea64f9f9b4b4ac157a1e3f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:47:04Z,use_quota=True,user_id='4763e0645a1343e0a575b152307dbb28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:47:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-1dfe1ac7-64f5-4106-a8ef-ad9dfed84fee tempest-VolumesListTestJSON-690261169 None] Creating volume 0eedae53-a499-46c5-9f63-d05d22da4747 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:47:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-1dfe1ac7-64f5-4106-a8ef-ad9dfed84fee tempest-VolumesListTestJSON-690261169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:47:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-1dfe1ac7-64f5-4106-a8ef-ad9dfed84fee tempest-VolumesListTestJSON-690261169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:47:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-1dfe1ac7-64f5-4106-a8ef-ad9dfed84fee tempest-VolumesListTestJSON-690261169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:47:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-1dfe1ac7-64f5-4106-a8ef-ad9dfed84fee tempest-VolumesListTestJSON-690261169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:47:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-1dfe1ac7-64f5-4106-a8ef-ad9dfed84fee tempest-VolumesListTestJSON-690261169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:47:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-1dfe1ac7-64f5-4106-a8ef-ad9dfed84fee tempest-VolumesListTestJSON-690261169 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:47:04 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-1dfe1ac7-64f5-4106-a8ef-ad9dfed84fee tempest-VolumesListTestJSON-690261169 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:47:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1dfe1ac7-64f5-4106-a8ef-ad9dfed84fee tempest-VolumesListTestJSON-690261169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0eedae53-a499-46c5-9f63-d05d22da4747 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:04 devstack sudo[98950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0eedae53-a499-46c5-9f63-d05d22da4747 1073741824 Sep 10 16:47:04 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:04 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-6fdeaf11-d004-4e98-b91a-f2bcc92b07ed tempest-GroupsTest-929656509 None] Created reservations ['88750d73-0c23-42d9-a3d2-90d2d81eae20'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:47:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6fdeaf11-d004-4e98-b91a-f2bcc92b07ed tempest-GroupsTest-929656509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:47:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6fdeaf11-d004-4e98-b91a-f2bcc92b07ed tempest-GroupsTest-929656509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:47:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6fdeaf11-d004-4e98-b91a-f2bcc92b07ed tempest-GroupsTest-929656509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:47:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6fdeaf11-d004-4e98-b91a-f2bcc92b07ed tempest-GroupsTest-929656509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:47:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6fdeaf11-d004-4e98-b91a-f2bcc92b07ed tempest-GroupsTest-929656509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:47:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6fdeaf11-d004-4e98-b91a-f2bcc92b07ed tempest-GroupsTest-929656509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:04 devstack sudo[98956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:47:04 devstack sudo[98956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:04 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1dfe1ac7-64f5-4106-a8ef-ad9dfed84fee tempest-VolumesListTestJSON-690261169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0eedae53-a499-46c5-9f63-d05d22da4747 1073741824" returned: 0 in 0.542s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1dfe1ac7-64f5-4106-a8ef-ad9dfed84fee tempest-VolumesListTestJSON-690261169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0eedae53-a499-46c5-9f63-d05d22da4747 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:04 devstack sudo[98960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0eedae53-a499-46c5-9f63-d05d22da4747 Sep 10 16:47:04 devstack sudo[98960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:05 devstack sudo[98956]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6fdeaf11-d004-4e98-b91a-f2bcc92b07ed tempest-GroupsTest-929656509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.327s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:05 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-6fdeaf11-d004-4e98-b91a-f2bcc92b07ed tempest-GroupsTest-929656509 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:47:05 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-6fdeaf11-d004-4e98-b91a-f2bcc92b07ed tempest-GroupsTest-929656509 None] Delete group completed successfully. Sep 10 16:47:05 devstack sudo[98960]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1dfe1ac7-64f5-4106-a8ef-ad9dfed84fee tempest-VolumesListTestJSON-690261169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0eedae53-a499-46c5-9f63-d05d22da4747" returned: 0 in 0.330s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-1dfe1ac7-64f5-4106-a8ef-ad9dfed84fee tempest-VolumesListTestJSON-690261169 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:47:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-1dfe1ac7-64f5-4106-a8ef-ad9dfed84fee tempest-VolumesListTestJSON-690261169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:47:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1dfe1ac7-64f5-4106-a8ef-ad9dfed84fee tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83fe689-ffd1-4606-a8b2-cebf3019e80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eedae53-a499-46c5-9f63-d05d22da4747', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1dfe1ac7-64f5-4106-a8ef-ad9dfed84fee tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aacc76eb-4b4d-4153-90ba-9113b8f19243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:05 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-1dfe1ac7-64f5-4106-a8ef-ad9dfed84fee tempest-VolumesListTestJSON-690261169 None] Volume volume-0eedae53-a499-46c5-9f63-d05d22da4747 (0eedae53-a499-46c5-9f63-d05d22da4747): created successfully Sep 10 16:47:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1dfe1ac7-64f5-4106-a8ef-ad9dfed84fee tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aacc76eb-4b4d-4153-90ba-9113b8f19243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1dfe1ac7-64f5-4106-a8ef-ad9dfed84fee tempest-VolumesListTestJSON-690261169 None] Flow 'volume_create_manager' (c22a2575-6c05-4c89-bfb2-b73928f4967f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:47:05 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-1dfe1ac7-64f5-4106-a8ef-ad9dfed84fee tempest-VolumesListTestJSON-690261169 None] Created volume successfully. Sep 10 16:47:05 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-eae8dbb9-9e5d-44cb-b569-6694e47cf022 tempest-AttachVolumeNegativeTest-74284645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:47:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-eae8dbb9-9e5d-44cb-b569-6694e47cf022 tempest-AttachVolumeNegativeTest-74284645 None] Flow 'volume_create_manager' (2698b2e7-bd6e-4312-96d5-15daff74f7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:47:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-eae8dbb9-9e5d-44cb-b569-6694e47cf022 tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c61df2c6-9616-46e0-a2ae-3bb1cf05083b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-eae8dbb9-9e5d-44cb-b569-6694e47cf022 tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c61df2c6-9616-46e0-a2ae-3bb1cf05083b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1402575136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=249e6d26-0d9e-490f-99da-93584fc6eb0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e484ed10f924a7692981c4942bab1ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:47:06Z,use_quota=True,user_id='5cd571733ed54e5bb97da86075b3900b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-eae8dbb9-9e5d-44cb-b569-6694e47cf022 tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be48cca-480e-4c3e-86fd-79f1c3ffdb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-eae8dbb9-9e5d-44cb-b569-6694e47cf022 tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be48cca-480e-4c3e-86fd-79f1c3ffdb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-eae8dbb9-9e5d-44cb-b569-6694e47cf022 tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e47937c-abf7-4f00-85f3-97e3912ef384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-eae8dbb9-9e5d-44cb-b569-6694e47cf022 tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e47937c-abf7-4f00-85f3-97e3912ef384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '249e6d26-0d9e-490f-99da-93584fc6eb0a', 'volume_name': 'volume-249e6d26-0d9e-490f-99da-93584fc6eb0a', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-eae8dbb9-9e5d-44cb-b569-6694e47cf022 tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8fee41a-363a-4ea6-a43f-e8e06bc69db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-eae8dbb9-9e5d-44cb-b569-6694e47cf022 tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8fee41a-363a-4ea6-a43f-e8e06bc69db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-eae8dbb9-9e5d-44cb-b569-6694e47cf022 tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05916d8e-722f-417d-909b-6095a301131c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:05 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-eae8dbb9-9e5d-44cb-b569-6694e47cf022 tempest-AttachVolumeNegativeTest-74284645 None] Volume 249e6d26-0d9e-490f-99da-93584fc6eb0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-249e6d26-0d9e-490f-99da-93584fc6eb0a', 'volume_size': 1} Sep 10 16:47:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-eae8dbb9-9e5d-44cb-b569-6694e47cf022 tempest-AttachVolumeNegativeTest-74284645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:47:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-eae8dbb9-9e5d-44cb-b569-6694e47cf022 tempest-AttachVolumeNegativeTest-74284645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:47:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-eae8dbb9-9e5d-44cb-b569-6694e47cf022 tempest-AttachVolumeNegativeTest-74284645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1402575136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=249e6d26-0d9e-490f-99da-93584fc6eb0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e484ed10f924a7692981c4942bab1ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:47:06Z,use_quota=True,user_id='5cd571733ed54e5bb97da86075b3900b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:47:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-eae8dbb9-9e5d-44cb-b569-6694e47cf022 tempest-AttachVolumeNegativeTest-74284645 None] Creating volume 249e6d26-0d9e-490f-99da-93584fc6eb0a {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:47:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-eae8dbb9-9e5d-44cb-b569-6694e47cf022 tempest-AttachVolumeNegativeTest-74284645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:47:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-eae8dbb9-9e5d-44cb-b569-6694e47cf022 tempest-AttachVolumeNegativeTest-74284645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:47:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-eae8dbb9-9e5d-44cb-b569-6694e47cf022 tempest-AttachVolumeNegativeTest-74284645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:47:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-eae8dbb9-9e5d-44cb-b569-6694e47cf022 tempest-AttachVolumeNegativeTest-74284645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:47:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-eae8dbb9-9e5d-44cb-b569-6694e47cf022 tempest-AttachVolumeNegativeTest-74284645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:47:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-eae8dbb9-9e5d-44cb-b569-6694e47cf022 tempest-AttachVolumeNegativeTest-74284645 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:47:05 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-eae8dbb9-9e5d-44cb-b569-6694e47cf022 tempest-AttachVolumeNegativeTest-74284645 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:47:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-eae8dbb9-9e5d-44cb-b569-6694e47cf022 tempest-AttachVolumeNegativeTest-74284645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-249e6d26-0d9e-490f-99da-93584fc6eb0a 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:05 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-249e6d26-0d9e-490f-99da-93584fc6eb0a 1073741824 Sep 10 16:47:05 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:06 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-eae8dbb9-9e5d-44cb-b569-6694e47cf022 tempest-AttachVolumeNegativeTest-74284645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-249e6d26-0d9e-490f-99da-93584fc6eb0a 1073741824" returned: 0 in 0.883s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-eae8dbb9-9e5d-44cb-b569-6694e47cf022 tempest-AttachVolumeNegativeTest-74284645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-249e6d26-0d9e-490f-99da-93584fc6eb0a {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:06 devstack sudo[99022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-249e6d26-0d9e-490f-99da-93584fc6eb0a Sep 10 16:47:06 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:06 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-2c5bb257-eb07-4a5f-84fa-472bf3f28eb2 tempest-GroupsTest-929656509 None] Group tempest-GroupsTest-Group-1584761072: creating Sep 10 16:47:06 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-2c5bb257-eb07-4a5f-84fa-472bf3f28eb2 tempest-GroupsTest-929656509 None] Group tempest-GroupsTest-Group-1584761072: created successfully Sep 10 16:47:06 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-2c5bb257-eb07-4a5f-84fa-472bf3f28eb2 tempest-GroupsTest-929656509 None] Create group completed successfully. Sep 10 16:47:07 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-eae8dbb9-9e5d-44cb-b569-6694e47cf022 tempest-AttachVolumeNegativeTest-74284645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-249e6d26-0d9e-490f-99da-93584fc6eb0a" returned: 0 in 0.528s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:07 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-eae8dbb9-9e5d-44cb-b569-6694e47cf022 tempest-AttachVolumeNegativeTest-74284645 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:47:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-eae8dbb9-9e5d-44cb-b569-6694e47cf022 tempest-AttachVolumeNegativeTest-74284645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:47:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-eae8dbb9-9e5d-44cb-b569-6694e47cf022 tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05916d8e-722f-417d-909b-6095a301131c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-249e6d26-0d9e-490f-99da-93584fc6eb0a', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-eae8dbb9-9e5d-44cb-b569-6694e47cf022 tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (616f2c7a-03c3-45c4-9011-d88a6257b3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:07 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-eae8dbb9-9e5d-44cb-b569-6694e47cf022 tempest-AttachVolumeNegativeTest-74284645 None] Volume volume-249e6d26-0d9e-490f-99da-93584fc6eb0a (249e6d26-0d9e-490f-99da-93584fc6eb0a): created successfully Sep 10 16:47:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-eae8dbb9-9e5d-44cb-b569-6694e47cf022 tempest-AttachVolumeNegativeTest-74284645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (616f2c7a-03c3-45c4-9011-d88a6257b3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-eae8dbb9-9e5d-44cb-b569-6694e47cf022 tempest-AttachVolumeNegativeTest-74284645 None] Flow 'volume_create_manager' (2698b2e7-bd6e-4312-96d5-15daff74f7dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:47:07 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-eae8dbb9-9e5d-44cb-b569-6694e47cf022 tempest-AttachVolumeNegativeTest-74284645 None] Created volume successfully. Sep 10 16:47:07 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3688388-7534-419b-8d22-5fee5dcc81f1 tempest-VolumesListTestJSON-690261169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:47:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c3688388-7534-419b-8d22-5fee5dcc81f1 tempest-VolumesListTestJSON-690261169 None] Flow 'volume_create_manager' (002f095d-80a1-48a1-b1e3-d29cb757910c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:47:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c3688388-7534-419b-8d22-5fee5dcc81f1 tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10b9dea5-21f5-46d1-b19e-1cf9a9892b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c3688388-7534-419b-8d22-5fee5dcc81f1 tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10b9dea5-21f5-46d1-b19e-1cf9a9892b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-246727285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd44034-edb2-4398-a4d2-10df1bd99a41,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1fefd9831ea64f9f9b4b4ac157a1e3f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:47:08Z,use_quota=True,user_id='4763e0645a1343e0a575b152307dbb28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c3688388-7534-419b-8d22-5fee5dcc81f1 tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72134d33-ced3-4127-bb53-4340491f9fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c3688388-7534-419b-8d22-5fee5dcc81f1 tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72134d33-ced3-4127-bb53-4340491f9fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c3688388-7534-419b-8d22-5fee5dcc81f1 tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c3a06bc-29d7-4214-bbe5-0dfd374c1480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c3688388-7534-419b-8d22-5fee5dcc81f1 tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c3a06bc-29d7-4214-bbe5-0dfd374c1480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfd44034-edb2-4398-a4d2-10df1bd99a41', 'volume_name': 'volume-dfd44034-edb2-4398-a4d2-10df1bd99a41', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c3688388-7534-419b-8d22-5fee5dcc81f1 tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af35ed23-7a78-4706-9f06-04c6c953fd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c3688388-7534-419b-8d22-5fee5dcc81f1 tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af35ed23-7a78-4706-9f06-04c6c953fd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c3688388-7534-419b-8d22-5fee5dcc81f1 tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531465c3-0c8a-41cc-89ba-7066abf279ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:07 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-c3688388-7534-419b-8d22-5fee5dcc81f1 tempest-VolumesListTestJSON-690261169 None] Volume dfd44034-edb2-4398-a4d2-10df1bd99a41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfd44034-edb2-4398-a4d2-10df1bd99a41', 'volume_size': 1} Sep 10 16:47:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c3688388-7534-419b-8d22-5fee5dcc81f1 tempest-VolumesListTestJSON-690261169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:47:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c3688388-7534-419b-8d22-5fee5dcc81f1 tempest-VolumesListTestJSON-690261169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:47:07 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c3688388-7534-419b-8d22-5fee5dcc81f1 tempest-VolumesListTestJSON-690261169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-246727285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd44034-edb2-4398-a4d2-10df1bd99a41,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1fefd9831ea64f9f9b4b4ac157a1e3f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:47:08Z,use_quota=True,user_id='4763e0645a1343e0a575b152307dbb28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:47:07 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-c3688388-7534-419b-8d22-5fee5dcc81f1 tempest-VolumesListTestJSON-690261169 None] Creating volume dfd44034-edb2-4398-a4d2-10df1bd99a41 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:47:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c3688388-7534-419b-8d22-5fee5dcc81f1 tempest-VolumesListTestJSON-690261169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:47:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c3688388-7534-419b-8d22-5fee5dcc81f1 tempest-VolumesListTestJSON-690261169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:47:07 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c3688388-7534-419b-8d22-5fee5dcc81f1 tempest-VolumesListTestJSON-690261169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:47:07 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c3688388-7534-419b-8d22-5fee5dcc81f1 tempest-VolumesListTestJSON-690261169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:47:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c3688388-7534-419b-8d22-5fee5dcc81f1 tempest-VolumesListTestJSON-690261169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:47:07 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c3688388-7534-419b-8d22-5fee5dcc81f1 tempest-VolumesListTestJSON-690261169 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:47:07 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-c3688388-7534-419b-8d22-5fee5dcc81f1 tempest-VolumesListTestJSON-690261169 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:47:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c3688388-7534-419b-8d22-5fee5dcc81f1 tempest-VolumesListTestJSON-690261169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dfd44034-edb2-4398-a4d2-10df1bd99a41 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:07 devstack sudo[99042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dfd44034-edb2-4398-a4d2-10df1bd99a41 1073741824 Sep 10 16:47:07 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:08 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3d368d5-0b5a-46f4-9843-3c92c7753a10 tempest-GroupsTest-929656509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:47:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e3d368d5-0b5a-46f4-9843-3c92c7753a10 tempest-GroupsTest-929656509 None] Flow 'volume_create_manager' (ed2ae0d1-4f22-4df7-82d1-be50442cf3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:47:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e3d368d5-0b5a-46f4-9843-3c92c7753a10 tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b46fb0-095a-465b-81f2-e998ac19a53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e3d368d5-0b5a-46f4-9843-3c92c7753a10 tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b46fb0-095a-465b-81f2-e998ac19a53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1343349666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=55ba7520-0ae7-4406-93d0-ac9a1dfb0358,host='devstack@QuobyteHD#QuobyteHD',id=3ffb8560-39bb-4eed-9e6d-6868497ee6da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c046d708044962b232104657e796a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:47:08Z,use_quota=True,user_id='d6f50da4e98b4fc2b8b673992677d765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f840e645-05b9-4605-8480-2f2840439ad9),volume_type_id=f840e645-05b9-4605-8480-2f2840439ad9)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e3d368d5-0b5a-46f4-9843-3c92c7753a10 tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fef1625-ec4a-4817-8aa4-365798c15a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e3d368d5-0b5a-46f4-9843-3c92c7753a10 tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fef1625-ec4a-4817-8aa4-365798c15a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e3d368d5-0b5a-46f4-9843-3c92c7753a10 tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac994ff9-5f24-4f59-8b6b-40281e576a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e3d368d5-0b5a-46f4-9843-3c92c7753a10 tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac994ff9-5f24-4f59-8b6b-40281e576a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ffb8560-39bb-4eed-9e6d-6868497ee6da', 'volume_name': 'volume-3ffb8560-39bb-4eed-9e6d-6868497ee6da', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e3d368d5-0b5a-46f4-9843-3c92c7753a10 tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6b1fa3f-aeae-45a7-996a-4ddabeb4bd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e3d368d5-0b5a-46f4-9843-3c92c7753a10 tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6b1fa3f-aeae-45a7-996a-4ddabeb4bd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e3d368d5-0b5a-46f4-9843-3c92c7753a10 tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4670706a-96a0-47c5-b68a-c4bb4a87b300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:08 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-e3d368d5-0b5a-46f4-9843-3c92c7753a10 tempest-GroupsTest-929656509 None] Volume 3ffb8560-39bb-4eed-9e6d-6868497ee6da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ffb8560-39bb-4eed-9e6d-6868497ee6da', 'volume_size': 1} Sep 10 16:47:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e3d368d5-0b5a-46f4-9843-3c92c7753a10 tempest-GroupsTest-929656509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:47:08 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-05d1dc0d-5000-49bb-b596-58c6d20f46ea tempest-VolumesActionsTest-270422599 None] Acquiring lock "cinder-8def1d0e-5a45-4fc8-8126-19bfd3057507" by "attach_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:47:08 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-05d1dc0d-5000-49bb-b596-58c6d20f46ea tempest-VolumesActionsTest-270422599 None] Lock "cinder-8def1d0e-5a45-4fc8-8126-19bfd3057507" acquired by "attach_volume" :: waited 0.034s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:47:08 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-05d1dc0d-5000-49bb-b596-58c6d20f46ea tempest-VolumesActionsTest-270422599 None] Attaching volume 8def1d0e-5a45-4fc8-8126-19bfd3057507 to instance b94de56f-e7d8-4551-a9e8-27817a241940 at mountpoint /dev/vdb on host None. Sep 10 16:47:08 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-05d1dc0d-5000-49bb-b596-58c6d20f46ea tempest-VolumesActionsTest-270422599 None] Attach volume completed successfully. Sep 10 16:47:08 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c3688388-7534-419b-8d22-5fee5dcc81f1 tempest-VolumesListTestJSON-690261169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dfd44034-edb2-4398-a4d2-10df1bd99a41 1073741824" returned: 0 in 1.090s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:08 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-05d1dc0d-5000-49bb-b596-58c6d20f46ea tempest-VolumesActionsTest-270422599 None] Lock "cinder-8def1d0e-5a45-4fc8-8126-19bfd3057507" released by "attach_volume" :: held 0.186s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:47:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c3688388-7534-419b-8d22-5fee5dcc81f1 tempest-VolumesListTestJSON-690261169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dfd44034-edb2-4398-a4d2-10df1bd99a41 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:09 devstack sudo[99050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dfd44034-edb2-4398-a4d2-10df1bd99a41 Sep 10 16:47:09 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:09 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c3688388-7534-419b-8d22-5fee5dcc81f1 tempest-VolumesListTestJSON-690261169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dfd44034-edb2-4398-a4d2-10df1bd99a41" returned: 0 in 0.446s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:09 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c3688388-7534-419b-8d22-5fee5dcc81f1 tempest-VolumesListTestJSON-690261169 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:47:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c3688388-7534-419b-8d22-5fee5dcc81f1 tempest-VolumesListTestJSON-690261169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:47:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e3d368d5-0b5a-46f4-9843-3c92c7753a10 tempest-GroupsTest-929656509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.969s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:47:09 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-e3d368d5-0b5a-46f4-9843-3c92c7753a10 tempest-GroupsTest-929656509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=55ba7520-0ae7-4406-93d0-ac9a1dfb0358,created_at=2026-09-10T14:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1343349666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=55ba7520-0ae7-4406-93d0-ac9a1dfb0358,host='devstack@QuobyteHD#QuobyteHD',id=3ffb8560-39bb-4eed-9e6d-6868497ee6da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c046d708044962b232104657e796a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:47:08Z,use_quota=True,user_id='d6f50da4e98b4fc2b8b673992677d765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f840e645-05b9-4605-8480-2f2840439ad9),volume_type_id=f840e645-05b9-4605-8480-2f2840439ad9)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:47:09 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-e3d368d5-0b5a-46f4-9843-3c92c7753a10 tempest-GroupsTest-929656509 None] Creating volume 3ffb8560-39bb-4eed-9e6d-6868497ee6da {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:47:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e3d368d5-0b5a-46f4-9843-3c92c7753a10 tempest-GroupsTest-929656509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:47:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e3d368d5-0b5a-46f4-9843-3c92c7753a10 tempest-GroupsTest-929656509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:47:09 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-e3d368d5-0b5a-46f4-9843-3c92c7753a10 tempest-GroupsTest-929656509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:47:09 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-e3d368d5-0b5a-46f4-9843-3c92c7753a10 tempest-GroupsTest-929656509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:47:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e3d368d5-0b5a-46f4-9843-3c92c7753a10 tempest-GroupsTest-929656509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:47:09 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-e3d368d5-0b5a-46f4-9843-3c92c7753a10 tempest-GroupsTest-929656509 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:47:09 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-e3d368d5-0b5a-46f4-9843-3c92c7753a10 tempest-GroupsTest-929656509 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:47:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e3d368d5-0b5a-46f4-9843-3c92c7753a10 tempest-GroupsTest-929656509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3ffb8560-39bb-4eed-9e6d-6868497ee6da 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:09 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-7560ce98-0946-4ada-88fe-bb85a69cfe13 tempest-VolumesActionsTest-270422599 None] Acquiring lock "cinder-8def1d0e-5a45-4fc8-8126-19bfd3057507-detach_volume" by "detach_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:47:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-152a76df-a4a1-4a56-9951-66b9efe04059 req-3b6bb2c3-d41e-4008-bff1-69c0eaa828cf tempest-AttachVolumeNegativeTest-74284645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:47:09 devstack sudo[99061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3ffb8560-39bb-4eed-9e6d-6868497ee6da 1073741824 Sep 10 16:47:09 devstack sudo[99061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:09 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c3688388-7534-419b-8d22-5fee5dcc81f1 tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531465c3-0c8a-41cc-89ba-7066abf279ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfd44034-edb2-4398-a4d2-10df1bd99a41', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:09 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c3688388-7534-419b-8d22-5fee5dcc81f1 tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad7bd46f-5177-4921-abf8-eb5d51541669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:09 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-7560ce98-0946-4ada-88fe-bb85a69cfe13 tempest-VolumesActionsTest-270422599 None] Lock "cinder-8def1d0e-5a45-4fc8-8126-19bfd3057507-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:47:09 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-7560ce98-0946-4ada-88fe-bb85a69cfe13 tempest-VolumesActionsTest-270422599 None] Detaching volume 8def1d0e-5a45-4fc8-8126-19bfd3057507 from instance b94de56f-e7d8-4551-a9e8-27817a241940. Sep 10 16:47:09 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-c3688388-7534-419b-8d22-5fee5dcc81f1 tempest-VolumesListTestJSON-690261169 None] Volume volume-dfd44034-edb2-4398-a4d2-10df1bd99a41 (dfd44034-edb2-4398-a4d2-10df1bd99a41): created successfully Sep 10 16:47:09 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c3688388-7534-419b-8d22-5fee5dcc81f1 tempest-VolumesListTestJSON-690261169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad7bd46f-5177-4921-abf8-eb5d51541669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:09 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c3688388-7534-419b-8d22-5fee5dcc81f1 tempest-VolumesListTestJSON-690261169 None] Flow 'volume_create_manager' (002f095d-80a1-48a1-b1e3-d29cb757910c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:47:09 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-c3688388-7534-419b-8d22-5fee5dcc81f1 tempest-VolumesListTestJSON-690261169 None] Created volume successfully. Sep 10 16:47:09 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-7560ce98-0946-4ada-88fe-bb85a69cfe13 tempest-VolumesActionsTest-270422599 None] Detach volume completed successfully. Sep 10 16:47:09 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-7560ce98-0946-4ada-88fe-bb85a69cfe13 tempest-VolumesActionsTest-270422599 None] Lock "cinder-8def1d0e-5a45-4fc8-8126-19bfd3057507-detach_volume" released by "detach_volume" :: held 0.087s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:47:10 devstack sudo[99061]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e3d368d5-0b5a-46f4-9843-3c92c7753a10 tempest-GroupsTest-929656509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3ffb8560-39bb-4eed-9e6d-6868497ee6da 1073741824" returned: 0 in 0.684s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e3d368d5-0b5a-46f4-9843-3c92c7753a10 tempest-GroupsTest-929656509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3ffb8560-39bb-4eed-9e6d-6868497ee6da {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:10 devstack sudo[99102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3ffb8560-39bb-4eed-9e6d-6868497ee6da Sep 10 16:47:10 devstack sudo[99102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:10 devstack sudo[99102]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e3d368d5-0b5a-46f4-9843-3c92c7753a10 tempest-GroupsTest-929656509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3ffb8560-39bb-4eed-9e6d-6868497ee6da" returned: 0 in 0.342s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:10 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-e3d368d5-0b5a-46f4-9843-3c92c7753a10 tempest-GroupsTest-929656509 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:47:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e3d368d5-0b5a-46f4-9843-3c92c7753a10 tempest-GroupsTest-929656509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:47:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-152a76df-a4a1-4a56-9951-66b9efe04059 req-3b6bb2c3-d41e-4008-bff1-69c0eaa828cf tempest-AttachVolumeNegativeTest-74284645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.130s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:47:10 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e3d368d5-0b5a-46f4-9843-3c92c7753a10 tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4670706a-96a0-47c5-b68a-c4bb4a87b300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ffb8560-39bb-4eed-9e6d-6868497ee6da', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:10 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e3d368d5-0b5a-46f4-9843-3c92c7753a10 tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39e89c9e-21f4-4fab-8b87-88fd701cf05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-152a76df-a4a1-4a56-9951-66b9efe04059 req-3b6bb2c3-d41e-4008-bff1-69c0eaa828cf tempest-AttachVolumeNegativeTest-74284645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.099s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:47:10 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-e3d368d5-0b5a-46f4-9843-3c92c7753a10 tempest-GroupsTest-929656509 None] Volume volume-3ffb8560-39bb-4eed-9e6d-6868497ee6da (3ffb8560-39bb-4eed-9e6d-6868497ee6da): created successfully Sep 10 16:47:10 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e3d368d5-0b5a-46f4-9843-3c92c7753a10 tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39e89c9e-21f4-4fab-8b87-88fd701cf05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:10 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e3d368d5-0b5a-46f4-9843-3c92c7753a10 tempest-GroupsTest-929656509 None] Flow 'volume_create_manager' (ed2ae0d1-4f22-4df7-82d1-be50442cf3c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:47:10 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-e3d368d5-0b5a-46f4-9843-3c92c7753a10 tempest-GroupsTest-929656509 None] Created volume successfully. Sep 10 16:47:10 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-152a76df-a4a1-4a56-9951-66b9efe04059 req-3b6bb2c3-d41e-4008-bff1-69c0eaa828cf tempest-AttachVolumeNegativeTest-74284645 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8', 'name': 'volume-249e6d26-0d9e-490f-99da-93584fc6eb0a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf02badd-9102-4be6-a592-940f97a6226d', 'enforce_multipath': True} {{(pid=88189) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 16:47:10 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-152a76df-a4a1-4a56-9951-66b9efe04059 req-3b6bb2c3-d41e-4008-bff1-69c0eaa828cf tempest-AttachVolumeNegativeTest-74284645 None] attachment_update completed successfully. Sep 10 16:47:12 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a52022e-b52b-4887-b0d3-f0e09fa6d3c5 tempest-GroupsTest-929656509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:47:12 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a52022e-b52b-4887-b0d3-f0e09fa6d3c5 tempest-GroupsTest-929656509 None] Flow 'volume_create_manager' (605e07cc-44b6-4f73-8501-2a1bf1c5d4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:47:12 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a52022e-b52b-4887-b0d3-f0e09fa6d3c5 tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f700558-1cde-4fc3-bda1-e0661064d446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:12 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a52022e-b52b-4887-b0d3-f0e09fa6d3c5 tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f700558-1cde-4fc3-bda1-e0661064d446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1036570878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=55ba7520-0ae7-4406-93d0-ac9a1dfb0358,host='devstack@QuobyteHD#QuobyteHD',id=720bc945-e4a3-4708-9e08-8c50a416187a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c046d708044962b232104657e796a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:47:12Z,use_quota=True,user_id='d6f50da4e98b4fc2b8b673992677d765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f840e645-05b9-4605-8480-2f2840439ad9),volume_type_id=f840e645-05b9-4605-8480-2f2840439ad9)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:12 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a52022e-b52b-4887-b0d3-f0e09fa6d3c5 tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e02370-a1c8-46c7-96d0-4ff2c4ba6153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:12 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a52022e-b52b-4887-b0d3-f0e09fa6d3c5 tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e02370-a1c8-46c7-96d0-4ff2c4ba6153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:12 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a52022e-b52b-4887-b0d3-f0e09fa6d3c5 tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d12e1139-66a9-4e25-8008-063d80467132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:12 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a52022e-b52b-4887-b0d3-f0e09fa6d3c5 tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d12e1139-66a9-4e25-8008-063d80467132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '720bc945-e4a3-4708-9e08-8c50a416187a', 'volume_name': 'volume-720bc945-e4a3-4708-9e08-8c50a416187a', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:12 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a52022e-b52b-4887-b0d3-f0e09fa6d3c5 tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (398e7f5a-ad29-416b-ba11-b1e1164491ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:12 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a52022e-b52b-4887-b0d3-f0e09fa6d3c5 tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (398e7f5a-ad29-416b-ba11-b1e1164491ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:12 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a52022e-b52b-4887-b0d3-f0e09fa6d3c5 tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (817a621e-8a27-4f35-837b-67403e8cdc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:12 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-8a52022e-b52b-4887-b0d3-f0e09fa6d3c5 tempest-GroupsTest-929656509 None] Volume 720bc945-e4a3-4708-9e08-8c50a416187a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-720bc945-e4a3-4708-9e08-8c50a416187a', 'volume_size': 1} Sep 10 16:47:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8a52022e-b52b-4887-b0d3-f0e09fa6d3c5 tempest-GroupsTest-929656509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:47:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8a52022e-b52b-4887-b0d3-f0e09fa6d3c5 tempest-GroupsTest-929656509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:47:12 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8a52022e-b52b-4887-b0d3-f0e09fa6d3c5 tempest-GroupsTest-929656509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=55ba7520-0ae7-4406-93d0-ac9a1dfb0358,created_at=2026-09-10T14:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1036570878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=55ba7520-0ae7-4406-93d0-ac9a1dfb0358,host='devstack@QuobyteHD#QuobyteHD',id=720bc945-e4a3-4708-9e08-8c50a416187a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c046d708044962b232104657e796a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:47:12Z,use_quota=True,user_id='d6f50da4e98b4fc2b8b673992677d765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f840e645-05b9-4605-8480-2f2840439ad9),volume_type_id=f840e645-05b9-4605-8480-2f2840439ad9)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:47:12 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-8a52022e-b52b-4887-b0d3-f0e09fa6d3c5 tempest-GroupsTest-929656509 None] Creating volume 720bc945-e4a3-4708-9e08-8c50a416187a {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:47:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8a52022e-b52b-4887-b0d3-f0e09fa6d3c5 tempest-GroupsTest-929656509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:47:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8a52022e-b52b-4887-b0d3-f0e09fa6d3c5 tempest-GroupsTest-929656509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:47:12 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8a52022e-b52b-4887-b0d3-f0e09fa6d3c5 tempest-GroupsTest-929656509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:47:12 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8a52022e-b52b-4887-b0d3-f0e09fa6d3c5 tempest-GroupsTest-929656509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:47:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8a52022e-b52b-4887-b0d3-f0e09fa6d3c5 tempest-GroupsTest-929656509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:47:12 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8a52022e-b52b-4887-b0d3-f0e09fa6d3c5 tempest-GroupsTest-929656509 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:47:12 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-8a52022e-b52b-4887-b0d3-f0e09fa6d3c5 tempest-GroupsTest-929656509 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:47:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8a52022e-b52b-4887-b0d3-f0e09fa6d3c5 tempest-GroupsTest-929656509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-720bc945-e4a3-4708-9e08-8c50a416187a 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:12 devstack sudo[99510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-720bc945-e4a3-4708-9e08-8c50a416187a 1073741824 Sep 10 16:47:12 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:12 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8a52022e-b52b-4887-b0d3-f0e09fa6d3c5 tempest-GroupsTest-929656509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-720bc945-e4a3-4708-9e08-8c50a416187a 1073741824" returned: 0 in 0.652s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8a52022e-b52b-4887-b0d3-f0e09fa6d3c5 tempest-GroupsTest-929656509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-720bc945-e4a3-4708-9e08-8c50a416187a {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:12 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-720bc945-e4a3-4708-9e08-8c50a416187a Sep 10 16:47:12 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:13 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8a52022e-b52b-4887-b0d3-f0e09fa6d3c5 tempest-GroupsTest-929656509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-720bc945-e4a3-4708-9e08-8c50a416187a" returned: 0 in 0.355s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:13 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8a52022e-b52b-4887-b0d3-f0e09fa6d3c5 tempest-GroupsTest-929656509 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:47:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8a52022e-b52b-4887-b0d3-f0e09fa6d3c5 tempest-GroupsTest-929656509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:47:13 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a52022e-b52b-4887-b0d3-f0e09fa6d3c5 tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (817a621e-8a27-4f35-837b-67403e8cdc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-720bc945-e4a3-4708-9e08-8c50a416187a', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:13 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a52022e-b52b-4887-b0d3-f0e09fa6d3c5 tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e84b7079-e6e5-42b4-b956-436bafa4e451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:13 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-8a52022e-b52b-4887-b0d3-f0e09fa6d3c5 tempest-GroupsTest-929656509 None] Volume volume-720bc945-e4a3-4708-9e08-8c50a416187a (720bc945-e4a3-4708-9e08-8c50a416187a): created successfully Sep 10 16:47:13 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a52022e-b52b-4887-b0d3-f0e09fa6d3c5 tempest-GroupsTest-929656509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e84b7079-e6e5-42b4-b956-436bafa4e451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:13 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a52022e-b52b-4887-b0d3-f0e09fa6d3c5 tempest-GroupsTest-929656509 None] Flow 'volume_create_manager' (605e07cc-44b6-4f73-8501-2a1bf1c5d4ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:47:13 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-8a52022e-b52b-4887-b0d3-f0e09fa6d3c5 tempest-GroupsTest-929656509 None] Created volume successfully. Sep 10 16:47:13 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-890119a8-9b1b-4ab6-936d-c01468c786a2 tempest-VolumesListTestJSON-690261169 None] Acquiring lock "cinder-dfd44034-edb2-4398-a4d2-10df1bd99a41-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:47:13 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-890119a8-9b1b-4ab6-936d-c01468c786a2 tempest-VolumesListTestJSON-690261169 None] Lock "cinder-dfd44034-edb2-4398-a4d2-10df1bd99a41-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:47:13 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-890119a8-9b1b-4ab6-936d-c01468c786a2 tempest-VolumesListTestJSON-690261169 None] Acquiring lock "cinder-quobyte-dfd44034-edb2-4398-a4d2-10df1bd99a41" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:47:13 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-890119a8-9b1b-4ab6-936d-c01468c786a2 tempest-VolumesListTestJSON-690261169 None] Lock "cinder-quobyte-dfd44034-edb2-4398-a4d2-10df1bd99a41" acquired by "delete_volume" :: waited 0.018s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:47:13 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7269a3-b803-44e2-baa3-48c5c9409acb]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:47:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-890119a8-9b1b-4ab6-936d-c01468c786a2 tempest-VolumesListTestJSON-690261169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dfd44034-edb2-4398-a4d2-10df1bd99a41 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:13 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dfd44034-edb2-4398-a4d2-10df1bd99a41 Sep 10 16:47:13 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:13 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-407d0b0f-5fc9-4880-955c-493c7105a439 req-a04b56ab-2262-4ed4-9e2d-a5ab7d631275 tempest-AttachVolumeNegativeTest-74284645 None] Terminate volume connection completed successfully. Sep 10 16:47:13 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-407d0b0f-5fc9-4880-955c-493c7105a439 req-a04b56ab-2262-4ed4-9e2d-a5ab7d631275 tempest-AttachVolumeNegativeTest-74284645 None] Deleting attachment bf02badd-9102-4be6-a592-940f97a6226d. {{(pid=88189) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 16:47:14 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-890119a8-9b1b-4ab6-936d-c01468c786a2 tempest-VolumesListTestJSON-690261169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dfd44034-edb2-4398-a4d2-10df1bd99a41" returned: 0 in 0.445s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-890119a8-9b1b-4ab6-936d-c01468c786a2 tempest-VolumesListTestJSON-690261169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dfd44034-edb2-4398-a4d2-10df1bd99a41 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:14 devstack sudo[99550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dfd44034-edb2-4398-a4d2-10df1bd99a41 Sep 10 16:47:14 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:14 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-890119a8-9b1b-4ab6-936d-c01468c786a2 tempest-VolumesListTestJSON-690261169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dfd44034-edb2-4398-a4d2-10df1bd99a41" returned: 0 in 0.280s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:14 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-890119a8-9b1b-4ab6-936d-c01468c786a2 tempest-VolumesListTestJSON-690261169 None] Lock "cinder-quobyte-dfd44034-edb2-4398-a4d2-10df1bd99a41" released by "delete_volume" :: held 0.772s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:47:14 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-890119a8-9b1b-4ab6-936d-c01468c786a2 tempest-VolumesListTestJSON-690261169 None] Created reservations ['9be81de8-f0e5-41e2-a1d5-4d665cd129c4', '845bbd5b-ea7f-4fd1-a047-8b34dea7f5bd', 'b24214f3-f4c6-4042-9e7d-35e53028a78c', 'bda6833d-bbe4-4f40-8228-a72c275170de'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:47:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-890119a8-9b1b-4ab6-936d-c01468c786a2 tempest-VolumesListTestJSON-690261169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:47:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-890119a8-9b1b-4ab6-936d-c01468c786a2 tempest-VolumesListTestJSON-690261169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:47:14 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-890119a8-9b1b-4ab6-936d-c01468c786a2 tempest-VolumesListTestJSON-690261169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:47:14 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-890119a8-9b1b-4ab6-936d-c01468c786a2 tempest-VolumesListTestJSON-690261169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:47:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-890119a8-9b1b-4ab6-936d-c01468c786a2 tempest-VolumesListTestJSON-690261169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:47:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-890119a8-9b1b-4ab6-936d-c01468c786a2 tempest-VolumesListTestJSON-690261169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:14 devstack sudo[99553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:47:14 devstack sudo[99553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:14 devstack sudo[99553]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-890119a8-9b1b-4ab6-936d-c01468c786a2 tempest-VolumesListTestJSON-690261169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.332s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:14 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-890119a8-9b1b-4ab6-936d-c01468c786a2 tempest-VolumesListTestJSON-690261169 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:47:14 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-890119a8-9b1b-4ab6-936d-c01468c786a2 tempest-VolumesListTestJSON-690261169 None] Deleted volume successfully. Sep 10 16:47:14 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-890119a8-9b1b-4ab6-936d-c01468c786a2 tempest-VolumesListTestJSON-690261169 None] Lock "cinder-dfd44034-edb2-4398-a4d2-10df1bd99a41-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:47:14 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4a8e554b-1db1-4ca9-9c2e-2fbbdc1fbd8e tempest-VolumesListTestJSON-690261169 None] Acquiring lock "cinder-0eedae53-a499-46c5-9f63-d05d22da4747-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:47:14 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4a8e554b-1db1-4ca9-9c2e-2fbbdc1fbd8e tempest-VolumesListTestJSON-690261169 None] Lock "cinder-0eedae53-a499-46c5-9f63-d05d22da4747-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:47:14 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-5f73e387-9da9-436d-b2da-657f4c9afd4a tempest-GroupsTest-929656509 None] Update group completed successfully. Sep 10 16:47:15 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4a8e554b-1db1-4ca9-9c2e-2fbbdc1fbd8e tempest-VolumesListTestJSON-690261169 None] Acquiring lock "cinder-quobyte-0eedae53-a499-46c5-9f63-d05d22da4747" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:47:15 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4a8e554b-1db1-4ca9-9c2e-2fbbdc1fbd8e tempest-VolumesListTestJSON-690261169 None] Lock "cinder-quobyte-0eedae53-a499-46c5-9f63-d05d22da4747" acquired by "delete_volume" :: waited 0.018s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:47:15 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[24df0351-7820-4c9a-924b-977f8d2bf650]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:47:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4a8e554b-1db1-4ca9-9c2e-2fbbdc1fbd8e tempest-VolumesListTestJSON-690261169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0eedae53-a499-46c5-9f63-d05d22da4747 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:15 devstack sudo[99556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0eedae53-a499-46c5-9f63-d05d22da4747 Sep 10 16:47:15 devstack sudo[99556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:15 devstack sudo[99556]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4a8e554b-1db1-4ca9-9c2e-2fbbdc1fbd8e tempest-VolumesListTestJSON-690261169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0eedae53-a499-46c5-9f63-d05d22da4747" returned: 0 in 0.514s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4a8e554b-1db1-4ca9-9c2e-2fbbdc1fbd8e tempest-VolumesListTestJSON-690261169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0eedae53-a499-46c5-9f63-d05d22da4747 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:15 devstack sudo[99579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0eedae53-a499-46c5-9f63-d05d22da4747 Sep 10 16:47:15 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-90b1fd82-5358-4ec0-a354-e8922f96abcf tempest-VolumesActionsTest-270422599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:47:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-90b1fd82-5358-4ec0-a354-e8922f96abcf tempest-VolumesActionsTest-270422599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:47:15 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cec03ae-7cd1-4ac2-90d6-07cd6898c9d0]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:47:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-90b1fd82-5358-4ec0-a354-e8922f96abcf tempest-VolumesActionsTest-270422599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:15 devstack sudo[99581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507 Sep 10 16:47:15 devstack sudo[99581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:15 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4a8e554b-1db1-4ca9-9c2e-2fbbdc1fbd8e tempest-VolumesListTestJSON-690261169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0eedae53-a499-46c5-9f63-d05d22da4747" returned: 0 in 0.308s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:15 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4a8e554b-1db1-4ca9-9c2e-2fbbdc1fbd8e tempest-VolumesListTestJSON-690261169 None] Lock "cinder-quobyte-0eedae53-a499-46c5-9f63-d05d22da4747" released by "delete_volume" :: held 0.880s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:47:16 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-4a8e554b-1db1-4ca9-9c2e-2fbbdc1fbd8e tempest-VolumesListTestJSON-690261169 None] Created reservations ['c4f0be25-fb0d-4dff-99df-de50e9b2f69f', 'a2a4eb6d-4c9c-4e71-a658-f9a193a9380b', '2e4738bc-28f0-43ee-bdf3-adcffba7d178', '0a63c664-d5b8-4671-b640-5524132b67f0'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:47:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4a8e554b-1db1-4ca9-9c2e-2fbbdc1fbd8e tempest-VolumesListTestJSON-690261169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:47:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4a8e554b-1db1-4ca9-9c2e-2fbbdc1fbd8e tempest-VolumesListTestJSON-690261169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:47:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-4a8e554b-1db1-4ca9-9c2e-2fbbdc1fbd8e tempest-VolumesListTestJSON-690261169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:47:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-4a8e554b-1db1-4ca9-9c2e-2fbbdc1fbd8e tempest-VolumesListTestJSON-690261169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:47:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4a8e554b-1db1-4ca9-9c2e-2fbbdc1fbd8e tempest-VolumesListTestJSON-690261169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:47:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4a8e554b-1db1-4ca9-9c2e-2fbbdc1fbd8e tempest-VolumesListTestJSON-690261169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:16 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:47:16 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:16 devstack sudo[99581]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-90b1fd82-5358-4ec0-a354-e8922f96abcf tempest-VolumesActionsTest-270422599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507" returned: 0 in 0.508s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:16 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-20cc35ac-8b69-49c9-bb98-513b8b01a961 tempest-VolumesListTestJSON-690261169 None] Acquiring lock "cinder-60e431e8-c568-4694-9fa1-b9d5e047d80e-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:47:16 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97c4719-299e-4aca-97ba-4cd3695bc01c]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:47:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-90b1fd82-5358-4ec0-a354-e8922f96abcf tempest-VolumesActionsTest-270422599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:16 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-20cc35ac-8b69-49c9-bb98-513b8b01a961 tempest-VolumesListTestJSON-690261169 None] Lock "cinder-60e431e8-c568-4694-9fa1-b9d5e047d80e-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:47:16 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-3634977e-791e-4450-a1bc-603124419330 tempest-GroupsTest-929656509 None] Update group completed successfully. Sep 10 16:47:16 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-20cc35ac-8b69-49c9-bb98-513b8b01a961 tempest-VolumesListTestJSON-690261169 None] Acquiring lock "cinder-quobyte-60e431e8-c568-4694-9fa1-b9d5e047d80e" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:47:16 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-20cc35ac-8b69-49c9-bb98-513b8b01a961 tempest-VolumesListTestJSON-690261169 None] Lock "cinder-quobyte-60e431e8-c568-4694-9fa1-b9d5e047d80e" acquired by "delete_volume" :: waited 0.034s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:47:16 devstack sudo[99589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507 Sep 10 16:47:16 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:16 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4a8e554b-1db1-4ca9-9c2e-2fbbdc1fbd8e tempest-VolumesListTestJSON-690261169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.406s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:16 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-4a8e554b-1db1-4ca9-9c2e-2fbbdc1fbd8e tempest-VolumesListTestJSON-690261169 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:47:16 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-4a8e554b-1db1-4ca9-9c2e-2fbbdc1fbd8e tempest-VolumesListTestJSON-690261169 None] Deleted volume successfully. Sep 10 16:47:16 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ea9a78-7d62-438b-9871-e6528580f7ce]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:47:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-20cc35ac-8b69-49c9-bb98-513b8b01a961 tempest-VolumesListTestJSON-690261169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-60e431e8-c568-4694-9fa1-b9d5e047d80e {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:16 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4a8e554b-1db1-4ca9-9c2e-2fbbdc1fbd8e tempest-VolumesListTestJSON-690261169 None] Lock "cinder-0eedae53-a499-46c5-9f63-d05d22da4747-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:47:16 devstack sudo[99592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-60e431e8-c568-4694-9fa1-b9d5e047d80e Sep 10 16:47:16 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:16 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-90b1fd82-5358-4ec0-a354-e8922f96abcf tempest-VolumesActionsTest-270422599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507" returned: 0 in 0.512s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-90b1fd82-5358-4ec0-a354-e8922f96abcf tempest-VolumesActionsTest-270422599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507 /opt/stack/data/cinder/conversion/8def1d0e-5a45-4fc8-8126-19bfd3057507.temp_image.77dfe9e8-3df1-4a38-a0e4-c20f0347bc23_61c8ill.img {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:16 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507 /opt/stack/data/cinder/conversion/8def1d0e-5a45-4fc8-8126-19bfd3057507.temp_image.77dfe9e8-3df1-4a38-a0e4-c20f0347bc23_61c8ill.img Sep 10 16:47:16 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:17 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-20cc35ac-8b69-49c9-bb98-513b8b01a961 tempest-VolumesListTestJSON-690261169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-60e431e8-c568-4694-9fa1-b9d5e047d80e" returned: 0 in 0.480s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-20cc35ac-8b69-49c9-bb98-513b8b01a961 tempest-VolumesListTestJSON-690261169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-60e431e8-c568-4694-9fa1-b9d5e047d80e {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:17 devstack sudo[99603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-60e431e8-c568-4694-9fa1-b9d5e047d80e Sep 10 16:47:17 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:17 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-20cc35ac-8b69-49c9-bb98-513b8b01a961 tempest-VolumesListTestJSON-690261169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-60e431e8-c568-4694-9fa1-b9d5e047d80e" returned: 0 in 0.447s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:17 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-20cc35ac-8b69-49c9-bb98-513b8b01a961 tempest-VolumesListTestJSON-690261169 None] Lock "cinder-quobyte-60e431e8-c568-4694-9fa1-b9d5e047d80e" released by "delete_volume" :: held 1.035s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:47:17 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=135,cinder:INSERT=25,cinder:UPDATE=126,cinder:DELETE=9 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:47:17 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-20cc35ac-8b69-49c9-bb98-513b8b01a961 tempest-VolumesListTestJSON-690261169 None] Created reservations ['59263f49-360a-4bed-8f48-55681e0152f7', '64defe0a-4920-4601-8627-2ec6768b684c', '896aebda-5d49-41d8-a721-862a20e14b8d', '7e0f8de4-ce00-493b-9206-339a1dcb2b70'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:47:17 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:INSERT=33,cinder:UPDATE=137,cinder:SELECT=124,cinder:DELETE=9 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:47:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-20cc35ac-8b69-49c9-bb98-513b8b01a961 tempest-VolumesListTestJSON-690261169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:47:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-20cc35ac-8b69-49c9-bb98-513b8b01a961 tempest-VolumesListTestJSON-690261169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:47:18 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-20cc35ac-8b69-49c9-bb98-513b8b01a961 tempest-VolumesListTestJSON-690261169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:47:18 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-20cc35ac-8b69-49c9-bb98-513b8b01a961 tempest-VolumesListTestJSON-690261169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:47:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-20cc35ac-8b69-49c9-bb98-513b8b01a961 tempest-VolumesListTestJSON-690261169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:47:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-20cc35ac-8b69-49c9-bb98-513b8b01a961 tempest-VolumesListTestJSON-690261169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:18 devstack sudo[99618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:47:18 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:18 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-20cc35ac-8b69-49c9-bb98-513b8b01a961 tempest-VolumesListTestJSON-690261169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.821s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:18 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-20cc35ac-8b69-49c9-bb98-513b8b01a961 tempest-VolumesListTestJSON-690261169 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:47:18 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-20cc35ac-8b69-49c9-bb98-513b8b01a961 tempest-VolumesListTestJSON-690261169 None] Deleted volume successfully. Sep 10 16:47:19 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-20cc35ac-8b69-49c9-bb98-513b8b01a961 tempest-VolumesListTestJSON-690261169 None] Lock "cinder-60e431e8-c568-4694-9fa1-b9d5e047d80e-delete_volume" released by "delete_volume" :: held 2.614s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:47:20 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-ff02d643-6250-4e23-ace4-1e9b0eb85c72 tempest-GroupsTest-929656509 None] Acquiring lock "cinder-quobyte-3ffb8560-39bb-4eed-9e6d-6868497ee6da" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:47:20 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-ff02d643-6250-4e23-ace4-1e9b0eb85c72 tempest-GroupsTest-929656509 None] Lock "cinder-quobyte-3ffb8560-39bb-4eed-9e6d-6868497ee6da" acquired by "delete_volume" :: waited 0.035s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:47:20 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e780a291-7bf7-46e9-8eeb-976f170af127]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:47:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ff02d643-6250-4e23-ace4-1e9b0eb85c72 tempest-GroupsTest-929656509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3ffb8560-39bb-4eed-9e6d-6868497ee6da {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:20 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3ffb8560-39bb-4eed-9e6d-6868497ee6da Sep 10 16:47:20 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:21 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ff02d643-6250-4e23-ace4-1e9b0eb85c72 tempest-GroupsTest-929656509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3ffb8560-39bb-4eed-9e6d-6868497ee6da" returned: 0 in 1.031s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ff02d643-6250-4e23-ace4-1e9b0eb85c72 tempest-GroupsTest-929656509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3ffb8560-39bb-4eed-9e6d-6868497ee6da {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:21 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3ffb8560-39bb-4eed-9e6d-6868497ee6da Sep 10 16:47:21 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:21 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ff02d643-6250-4e23-ace4-1e9b0eb85c72 tempest-GroupsTest-929656509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3ffb8560-39bb-4eed-9e6d-6868497ee6da" returned: 0 in 0.654s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-ff02d643-6250-4e23-ace4-1e9b0eb85c72 tempest-GroupsTest-929656509 None] Lock "cinder-quobyte-3ffb8560-39bb-4eed-9e6d-6868497ee6da" released by "delete_volume" :: held 1.817s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:47:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-ff02d643-6250-4e23-ace4-1e9b0eb85c72 tempest-GroupsTest-929656509 None] Acquiring lock "cinder-quobyte-720bc945-e4a3-4708-9e08-8c50a416187a" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:47:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-ff02d643-6250-4e23-ace4-1e9b0eb85c72 tempest-GroupsTest-929656509 None] Lock "cinder-quobyte-720bc945-e4a3-4708-9e08-8c50a416187a" acquired by "delete_volume" :: waited 0.037s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:47:21 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[44055839-08a0-455e-88f6-868be91fa1af]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:47:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ff02d643-6250-4e23-ace4-1e9b0eb85c72 tempest-GroupsTest-929656509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-720bc945-e4a3-4708-9e08-8c50a416187a {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:22 devstack sudo[99633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-720bc945-e4a3-4708-9e08-8c50a416187a Sep 10 16:47:22 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:22 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ff02d643-6250-4e23-ace4-1e9b0eb85c72 tempest-GroupsTest-929656509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-720bc945-e4a3-4708-9e08-8c50a416187a" returned: 0 in 0.991s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ff02d643-6250-4e23-ace4-1e9b0eb85c72 tempest-GroupsTest-929656509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-720bc945-e4a3-4708-9e08-8c50a416187a {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:22 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-720bc945-e4a3-4708-9e08-8c50a416187a Sep 10 16:47:22 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:23 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-90b1fd82-5358-4ec0-a354-e8922f96abcf tempest-VolumesActionsTest-270422599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507 /opt/stack/data/cinder/conversion/8def1d0e-5a45-4fc8-8126-19bfd3057507.temp_image.77dfe9e8-3df1-4a38-a0e4-c20f0347bc23_61c8ill.img" returned: 0 in 6.149s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:23 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[666bfb92-f00a-487f-b209-feed1f8bf42a]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:47:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-90b1fd82-5358-4ec0-a354-e8922f96abcf tempest-VolumesActionsTest-270422599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:23 devstack sudo[99640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507 Sep 10 16:47:23 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:23 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ff02d643-6250-4e23-ace4-1e9b0eb85c72 tempest-GroupsTest-929656509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-720bc945-e4a3-4708-9e08-8c50a416187a" returned: 0 in 0.486s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:23 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-ff02d643-6250-4e23-ace4-1e9b0eb85c72 tempest-GroupsTest-929656509 None] Lock "cinder-quobyte-720bc945-e4a3-4708-9e08-8c50a416187a" released by "delete_volume" :: held 1.568s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:47:23 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-ff02d643-6250-4e23-ace4-1e9b0eb85c72 tempest-GroupsTest-929656509 None] Created reservations ['4f1ca735-2fe2-409f-88f6-f3fa218184f7'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:47:23 devstack cinder-volume[88189]: WARNING cinder.quota [None req-ff02d643-6250-4e23-ace4-1e9b0eb85c72 tempest-GroupsTest-929656509 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2116411612 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2116411612, it is now deprecated. Please use the default quota class for default quota. Sep 10 16:47:23 devstack cinder-volume[88189]: WARNING cinder.quota [None req-ff02d643-6250-4e23-ace4-1e9b0eb85c72 tempest-GroupsTest-929656509 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2116411612 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2116411612, it is now deprecated. Please use the default quota class for default quota. Sep 10 16:47:23 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-ff02d643-6250-4e23-ace4-1e9b0eb85c72 tempest-GroupsTest-929656509 None] Created reservations ['e37d9ee9-fbc0-487b-98df-5e645e1003ca', 'f235d444-17a1-48e7-914e-da4cf5c97c02', '2ab84159-16cf-45af-9f4a-de0ff9dca6a0', '17cbd1fc-72f5-4c60-8455-af92e959344a'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:47:23 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-90b1fd82-5358-4ec0-a354-e8922f96abcf tempest-VolumesActionsTest-270422599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507" returned: 0 in 0.679s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:23 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-90b1fd82-5358-4ec0-a354-e8922f96abcf tempest-VolumesActionsTest-270422599 None] Image conversion details: src /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507, size 1024.00 MB, duration 6.15 sec, destination /opt/stack/data/cinder/conversion/8def1d0e-5a45-4fc8-8126-19bfd3057507.temp_image.77dfe9e8-3df1-4a38-a0e4-c20f0347bc23_61c8ill.img {{(pid=88189) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 16:47:23 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-90b1fd82-5358-4ec0-a354-e8922f96abcf tempest-VolumesActionsTest-270422599 None] Converted 1024.00 MB image at 166.48 MB/s Sep 10 16:47:23 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-90b1fd82-5358-4ec0-a354-e8922f96abcf tempest-VolumesActionsTest-270422599 None] 77dfe9e8-3df1-4a38-a0e4-c20f0347bc23 was raw, no need to convert to raw {{(pid=88189) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 10 16:47:23 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-ff02d643-6250-4e23-ace4-1e9b0eb85c72 tempest-GroupsTest-929656509 None] Created reservations ['ffc7ebca-f830-44a8-be99-d36fb957e7d2', '4a10566f-131c-40ee-b1c3-422b3afbc739', '5f9c545d-9f5d-4a5c-b745-e8e347df4efe', 'bd8351cb-7c11-45a7-84ed-414602adf06a'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:47:23 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-80988acc-5e9e-4223-b182-5646ee75e2e8 tempest-AttachVolumeNegativeTest-74284645 None] Acquiring lock "cinder-249e6d26-0d9e-490f-99da-93584fc6eb0a-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:47:23 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-80988acc-5e9e-4223-b182-5646ee75e2e8 tempest-AttachVolumeNegativeTest-74284645 None] Lock "cinder-249e6d26-0d9e-490f-99da-93584fc6eb0a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:47:23 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-80988acc-5e9e-4223-b182-5646ee75e2e8 tempest-AttachVolumeNegativeTest-74284645 None] Acquiring lock "cinder-quobyte-249e6d26-0d9e-490f-99da-93584fc6eb0a" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:47:23 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-80988acc-5e9e-4223-b182-5646ee75e2e8 tempest-AttachVolumeNegativeTest-74284645 None] Lock "cinder-quobyte-249e6d26-0d9e-490f-99da-93584fc6eb0a" acquired by "delete_volume" :: waited 0.020s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:47:23 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8406a3e-6b6e-4e1d-acd9-242041e21f21]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:47:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-80988acc-5e9e-4223-b182-5646ee75e2e8 tempest-AttachVolumeNegativeTest-74284645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-249e6d26-0d9e-490f-99da-93584fc6eb0a {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ff02d643-6250-4e23-ace4-1e9b0eb85c72 tempest-GroupsTest-929656509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:47:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ff02d643-6250-4e23-ace4-1e9b0eb85c72 tempest-GroupsTest-929656509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:47:24 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ff02d643-6250-4e23-ace4-1e9b0eb85c72 tempest-GroupsTest-929656509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:47:24 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ff02d643-6250-4e23-ace4-1e9b0eb85c72 tempest-GroupsTest-929656509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:47:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ff02d643-6250-4e23-ace4-1e9b0eb85c72 tempest-GroupsTest-929656509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:47:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ff02d643-6250-4e23-ace4-1e9b0eb85c72 tempest-GroupsTest-929656509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:24 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:47:24 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:24 devstack sudo[99646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-249e6d26-0d9e-490f-99da-93584fc6eb0a Sep 10 16:47:24 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:24 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ff02d643-6250-4e23-ace4-1e9b0eb85c72 tempest-GroupsTest-929656509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.315s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:24 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-ff02d643-6250-4e23-ace4-1e9b0eb85c72 tempest-GroupsTest-929656509 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:47:24 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-ff02d643-6250-4e23-ace4-1e9b0eb85c72 tempest-GroupsTest-929656509 None] Delete group completed successfully. Sep 10 16:47:24 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-80988acc-5e9e-4223-b182-5646ee75e2e8 tempest-AttachVolumeNegativeTest-74284645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-249e6d26-0d9e-490f-99da-93584fc6eb0a" returned: 0 in 0.493s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-80988acc-5e9e-4223-b182-5646ee75e2e8 tempest-AttachVolumeNegativeTest-74284645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-249e6d26-0d9e-490f-99da-93584fc6eb0a {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:24 devstack sudo[99660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-249e6d26-0d9e-490f-99da-93584fc6eb0a Sep 10 16:47:24 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:24 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-80988acc-5e9e-4223-b182-5646ee75e2e8 tempest-AttachVolumeNegativeTest-74284645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-249e6d26-0d9e-490f-99da-93584fc6eb0a" returned: 0 in 0.288s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:24 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-80988acc-5e9e-4223-b182-5646ee75e2e8 tempest-AttachVolumeNegativeTest-74284645 None] Lock "cinder-quobyte-249e6d26-0d9e-490f-99da-93584fc6eb0a" released by "delete_volume" :: held 0.838s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:47:24 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-80988acc-5e9e-4223-b182-5646ee75e2e8 tempest-AttachVolumeNegativeTest-74284645 None] Created reservations ['f45b6079-137b-49b0-9805-6d9ceb4e540f', 'b1758ef1-081a-493b-8e6b-d1268f4acc13', 'b0e1aaf4-a467-4f4d-8f7d-1d8e9f56e544', '28f79436-ef1b-4c38-97bd-daf949b865b2'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:47:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-80988acc-5e9e-4223-b182-5646ee75e2e8 tempest-AttachVolumeNegativeTest-74284645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:47:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-80988acc-5e9e-4223-b182-5646ee75e2e8 tempest-AttachVolumeNegativeTest-74284645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:47:24 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-80988acc-5e9e-4223-b182-5646ee75e2e8 tempest-AttachVolumeNegativeTest-74284645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:47:24 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-80988acc-5e9e-4223-b182-5646ee75e2e8 tempest-AttachVolumeNegativeTest-74284645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:47:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-80988acc-5e9e-4223-b182-5646ee75e2e8 tempest-AttachVolumeNegativeTest-74284645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:47:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-80988acc-5e9e-4223-b182-5646ee75e2e8 tempest-AttachVolumeNegativeTest-74284645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:24 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:47:24 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:25 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-3555c403-9965-4526-aa1e-2f30a99ba4ae tempest-AttachVolumeNegativeTest-74284645 None] Acquiring lock "cinder-69795769-1c29-4f4b-9db8-82cfdeb53b11-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:47:25 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-3555c403-9965-4526-aa1e-2f30a99ba4ae tempest-AttachVolumeNegativeTest-74284645 None] Lock "cinder-69795769-1c29-4f4b-9db8-82cfdeb53b11-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:47:25 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-3555c403-9965-4526-aa1e-2f30a99ba4ae tempest-AttachVolumeNegativeTest-74284645 None] Acquiring lock "cinder-quobyte-69795769-1c29-4f4b-9db8-82cfdeb53b11" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:47:25 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-3555c403-9965-4526-aa1e-2f30a99ba4ae tempest-AttachVolumeNegativeTest-74284645 None] Lock "cinder-quobyte-69795769-1c29-4f4b-9db8-82cfdeb53b11" acquired by "delete_volume" :: waited 0.022s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:47:25 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1dfe8a-df9d-4ddb-a196-98b80001a4cc]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:47:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3555c403-9965-4526-aa1e-2f30a99ba4ae tempest-AttachVolumeNegativeTest-74284645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-69795769-1c29-4f4b-9db8-82cfdeb53b11 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:25 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-80988acc-5e9e-4223-b182-5646ee75e2e8 tempest-AttachVolumeNegativeTest-74284645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.421s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:25 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-80988acc-5e9e-4223-b182-5646ee75e2e8 tempest-AttachVolumeNegativeTest-74284645 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:47:25 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-80988acc-5e9e-4223-b182-5646ee75e2e8 tempest-AttachVolumeNegativeTest-74284645 None] Deleted volume successfully. Sep 10 16:47:25 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-80988acc-5e9e-4223-b182-5646ee75e2e8 tempest-AttachVolumeNegativeTest-74284645 None] Lock "cinder-249e6d26-0d9e-490f-99da-93584fc6eb0a-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:47:25 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-69795769-1c29-4f4b-9db8-82cfdeb53b11 Sep 10 16:47:25 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:25 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3555c403-9965-4526-aa1e-2f30a99ba4ae tempest-AttachVolumeNegativeTest-74284645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-69795769-1c29-4f4b-9db8-82cfdeb53b11" returned: 0 in 0.440s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3555c403-9965-4526-aa1e-2f30a99ba4ae tempest-AttachVolumeNegativeTest-74284645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-69795769-1c29-4f4b-9db8-82cfdeb53b11 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:25 devstack sudo[99672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-69795769-1c29-4f4b-9db8-82cfdeb53b11 Sep 10 16:47:25 devstack sudo[99672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:26 devstack sudo[99672]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3555c403-9965-4526-aa1e-2f30a99ba4ae tempest-AttachVolumeNegativeTest-74284645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-69795769-1c29-4f4b-9db8-82cfdeb53b11" returned: 0 in 0.255s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:26 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-3555c403-9965-4526-aa1e-2f30a99ba4ae tempest-AttachVolumeNegativeTest-74284645 None] Lock "cinder-quobyte-69795769-1c29-4f4b-9db8-82cfdeb53b11" released by "delete_volume" :: held 0.756s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:47:26 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-3555c403-9965-4526-aa1e-2f30a99ba4ae tempest-AttachVolumeNegativeTest-74284645 None] Created reservations ['851a070c-7646-4185-bb75-054086fed646', '6c7c76f8-ac12-4453-9f2b-002c43cfbfdc', 'fbc23162-ee11-4ebd-b72a-6a228c7de754', '7be64f6e-7794-4017-8839-c26fdf60bf38'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:47:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3555c403-9965-4526-aa1e-2f30a99ba4ae tempest-AttachVolumeNegativeTest-74284645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:47:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3555c403-9965-4526-aa1e-2f30a99ba4ae tempest-AttachVolumeNegativeTest-74284645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:47:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3555c403-9965-4526-aa1e-2f30a99ba4ae tempest-AttachVolumeNegativeTest-74284645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:47:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3555c403-9965-4526-aa1e-2f30a99ba4ae tempest-AttachVolumeNegativeTest-74284645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:47:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3555c403-9965-4526-aa1e-2f30a99ba4ae tempest-AttachVolumeNegativeTest-74284645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:47:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3555c403-9965-4526-aa1e-2f30a99ba4ae tempest-AttachVolumeNegativeTest-74284645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:26 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:47:26 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:26 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3555c403-9965-4526-aa1e-2f30a99ba4ae tempest-AttachVolumeNegativeTest-74284645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.355s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:26 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-3555c403-9965-4526-aa1e-2f30a99ba4ae tempest-AttachVolumeNegativeTest-74284645 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:47:26 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-3555c403-9965-4526-aa1e-2f30a99ba4ae tempest-AttachVolumeNegativeTest-74284645 None] Deleted volume successfully. Sep 10 16:47:26 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-3555c403-9965-4526-aa1e-2f30a99ba4ae tempest-AttachVolumeNegativeTest-74284645 None] Lock "cinder-69795769-1c29-4f4b-9db8-82cfdeb53b11-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:47:26 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a6a9201f-79d5-4a91-8199-5b48303f31bc tempest-AttachVolumeNegativeTest-74284645 None] Acquiring lock "cinder-364d218d-b617-4614-9899-a9bd8dffa59e-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:47:26 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a6a9201f-79d5-4a91-8199-5b48303f31bc tempest-AttachVolumeNegativeTest-74284645 None] Lock "cinder-364d218d-b617-4614-9899-a9bd8dffa59e-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:47:26 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a6a9201f-79d5-4a91-8199-5b48303f31bc tempest-AttachVolumeNegativeTest-74284645 None] Acquiring lock "cinder-quobyte-364d218d-b617-4614-9899-a9bd8dffa59e" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:47:26 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a6a9201f-79d5-4a91-8199-5b48303f31bc tempest-AttachVolumeNegativeTest-74284645 None] Lock "cinder-quobyte-364d218d-b617-4614-9899-a9bd8dffa59e" acquired by "delete_volume" :: waited 0.024s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:47:27 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[75670b37-2aa6-4853-ab2b-7ed71e4fc81e]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:47:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a6a9201f-79d5-4a91-8199-5b48303f31bc tempest-AttachVolumeNegativeTest-74284645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-364d218d-b617-4614-9899-a9bd8dffa59e {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:27 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-364d218d-b617-4614-9899-a9bd8dffa59e Sep 10 16:47:27 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:27 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-7730d41e-6d1a-46c3-b99e-2c9e9e91d61b tempest-VolumesNegativeTest-725043388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:47:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7730d41e-6d1a-46c3-b99e-2c9e9e91d61b tempest-VolumesNegativeTest-725043388 None] Flow 'volume_create_manager' (7808f0e9-a34b-4041-ad8b-d3e8ec0fb8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:47:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7730d41e-6d1a-46c3-b99e-2c9e9e91d61b tempest-VolumesNegativeTest-725043388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a048e8f-a6f2-4488-985f-8aad561726fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7730d41e-6d1a-46c3-b99e-2c9e9e91d61b tempest-VolumesNegativeTest-725043388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a048e8f-a6f2-4488-985f-8aad561726fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-955422430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8721a81-0c29-4ae1-9ecf-416b7ff09405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8fb3f1314a54f66a65b03634438b47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:47:27Z,use_quota=True,user_id='2d3dd26a69924461bb324374968982f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7730d41e-6d1a-46c3-b99e-2c9e9e91d61b tempest-VolumesNegativeTest-725043388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1af215c-bb37-4046-8438-849eb616d697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7730d41e-6d1a-46c3-b99e-2c9e9e91d61b tempest-VolumesNegativeTest-725043388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1af215c-bb37-4046-8438-849eb616d697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7730d41e-6d1a-46c3-b99e-2c9e9e91d61b tempest-VolumesNegativeTest-725043388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb037cc-370a-4539-84ae-3dce8ca376fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7730d41e-6d1a-46c3-b99e-2c9e9e91d61b tempest-VolumesNegativeTest-725043388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb037cc-370a-4539-84ae-3dce8ca376fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8721a81-0c29-4ae1-9ecf-416b7ff09405', 'volume_name': 'volume-c8721a81-0c29-4ae1-9ecf-416b7ff09405', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7730d41e-6d1a-46c3-b99e-2c9e9e91d61b tempest-VolumesNegativeTest-725043388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06ea2f31-74d9-45c3-b114-5b14a8152de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7730d41e-6d1a-46c3-b99e-2c9e9e91d61b tempest-VolumesNegativeTest-725043388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06ea2f31-74d9-45c3-b114-5b14a8152de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7730d41e-6d1a-46c3-b99e-2c9e9e91d61b tempest-VolumesNegativeTest-725043388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b1c8f52-32a4-401b-b560-6f8675465f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:27 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-7730d41e-6d1a-46c3-b99e-2c9e9e91d61b tempest-VolumesNegativeTest-725043388 None] Volume c8721a81-0c29-4ae1-9ecf-416b7ff09405: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8721a81-0c29-4ae1-9ecf-416b7ff09405', 'volume_size': 1} Sep 10 16:47:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7730d41e-6d1a-46c3-b99e-2c9e9e91d61b tempest-VolumesNegativeTest-725043388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:47:27 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a6a9201f-79d5-4a91-8199-5b48303f31bc tempest-AttachVolumeNegativeTest-74284645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-364d218d-b617-4614-9899-a9bd8dffa59e" returned: 0 in 0.566s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a6a9201f-79d5-4a91-8199-5b48303f31bc tempest-AttachVolumeNegativeTest-74284645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-364d218d-b617-4614-9899-a9bd8dffa59e {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:27 devstack sudo[99683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-364d218d-b617-4614-9899-a9bd8dffa59e Sep 10 16:47:27 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:27 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a6a9201f-79d5-4a91-8199-5b48303f31bc tempest-AttachVolumeNegativeTest-74284645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-364d218d-b617-4614-9899-a9bd8dffa59e" returned: 0 in 0.357s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:27 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a6a9201f-79d5-4a91-8199-5b48303f31bc tempest-AttachVolumeNegativeTest-74284645 None] Lock "cinder-quobyte-364d218d-b617-4614-9899-a9bd8dffa59e" released by "delete_volume" :: held 1.014s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:47:28 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-a6a9201f-79d5-4a91-8199-5b48303f31bc tempest-AttachVolumeNegativeTest-74284645 None] Created reservations ['90472b62-f108-425a-9fa5-0c59f7bffb38', '73ea4c71-8ebc-45d9-a73d-19b700d603d9', '731b30b5-4f02-4318-83cf-8718dfec1d0a', '7a543295-6d8b-49a7-a07a-6232d8e255c6'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:47:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a6a9201f-79d5-4a91-8199-5b48303f31bc tempest-AttachVolumeNegativeTest-74284645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:47:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a6a9201f-79d5-4a91-8199-5b48303f31bc tempest-AttachVolumeNegativeTest-74284645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:47:28 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-a6a9201f-79d5-4a91-8199-5b48303f31bc tempest-AttachVolumeNegativeTest-74284645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:47:28 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-a6a9201f-79d5-4a91-8199-5b48303f31bc tempest-AttachVolumeNegativeTest-74284645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:47:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a6a9201f-79d5-4a91-8199-5b48303f31bc tempest-AttachVolumeNegativeTest-74284645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:47:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a6a9201f-79d5-4a91-8199-5b48303f31bc tempest-AttachVolumeNegativeTest-74284645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:28 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:47:28 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:28 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a6a9201f-79d5-4a91-8199-5b48303f31bc tempest-AttachVolumeNegativeTest-74284645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.330s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:28 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-a6a9201f-79d5-4a91-8199-5b48303f31bc tempest-AttachVolumeNegativeTest-74284645 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:47:28 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-a6a9201f-79d5-4a91-8199-5b48303f31bc tempest-AttachVolumeNegativeTest-74284645 None] Deleted volume successfully. Sep 10 16:47:28 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a6a9201f-79d5-4a91-8199-5b48303f31bc tempest-AttachVolumeNegativeTest-74284645 None] Lock "cinder-364d218d-b617-4614-9899-a9bd8dffa59e-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:47:32 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-2e4549d0-594f-41ad-9a88-ad38b1ba9398 tempest-GroupsV314Test-796416885 None] Group tempest-GroupsV314Test-Group-333258158: creating Sep 10 16:47:32 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-2e4549d0-594f-41ad-9a88-ad38b1ba9398 tempest-GroupsV314Test-796416885 None] Group tempest-GroupsV314Test-Group-333258158: created successfully Sep 10 16:47:32 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-2e4549d0-594f-41ad-9a88-ad38b1ba9398 tempest-GroupsV314Test-796416885 None] Create group completed successfully. Sep 10 16:47:34 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-79daeba8-956f-4d3d-bf50-6792996d38b8 tempest-GroupsV314Test-796416885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:47:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-79daeba8-956f-4d3d-bf50-6792996d38b8 tempest-GroupsV314Test-796416885 None] Flow 'volume_create_manager' (ab557968-ec51-41b9-bbb9-a83d2fa8bb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:47:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-79daeba8-956f-4d3d-bf50-6792996d38b8 tempest-GroupsV314Test-796416885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b98593e-a60f-4c72-bf7e-2e9c7a2737d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-79daeba8-956f-4d3d-bf50-6792996d38b8 tempest-GroupsV314Test-796416885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b98593e-a60f-4c72-bf7e-2e9c7a2737d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-350510008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dce9937d-92a8-400c-ad02-4bd5dda6521d,host='devstack@QuobyteHD#QuobyteHD',id=e02c4da8-6e31-410b-b317-472454e08ca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e799f76e1004181914db73f7a51aa0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:47:34Z,use_quota=True,user_id='0757d006b4814f629483716b93fffb27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6ccf621-1af1-42d4-a1a9-ed8a4f568b7a),volume_type_id=d6ccf621-1af1-42d4-a1a9-ed8a4f568b7a)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-79daeba8-956f-4d3d-bf50-6792996d38b8 tempest-GroupsV314Test-796416885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a366932-b013-48b5-b8e5-b359e2b1a99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-79daeba8-956f-4d3d-bf50-6792996d38b8 tempest-GroupsV314Test-796416885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a366932-b013-48b5-b8e5-b359e2b1a99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-79daeba8-956f-4d3d-bf50-6792996d38b8 tempest-GroupsV314Test-796416885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (407e192e-effd-4be6-97f5-7d8f3d80d3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-79daeba8-956f-4d3d-bf50-6792996d38b8 tempest-GroupsV314Test-796416885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (407e192e-effd-4be6-97f5-7d8f3d80d3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e02c4da8-6e31-410b-b317-472454e08ca7', 'volume_name': 'volume-e02c4da8-6e31-410b-b317-472454e08ca7', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-79daeba8-956f-4d3d-bf50-6792996d38b8 tempest-GroupsV314Test-796416885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0a12e39-59d6-46ab-94fc-fc40320a98f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-79daeba8-956f-4d3d-bf50-6792996d38b8 tempest-GroupsV314Test-796416885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0a12e39-59d6-46ab-94fc-fc40320a98f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-79daeba8-956f-4d3d-bf50-6792996d38b8 tempest-GroupsV314Test-796416885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2962523c-0b46-4bec-9aa2-676d9da82903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:34 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-79daeba8-956f-4d3d-bf50-6792996d38b8 tempest-GroupsV314Test-796416885 None] Volume e02c4da8-6e31-410b-b317-472454e08ca7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e02c4da8-6e31-410b-b317-472454e08ca7', 'volume_size': 1} Sep 10 16:47:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-79daeba8-956f-4d3d-bf50-6792996d38b8 tempest-GroupsV314Test-796416885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:47:38 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [req-e64301a9-8371-4ad0-a03e-07cab8285858 req-b300bd60-8499-4c31-9a3b-39c0813fef6d tempest-VolumesSnapshotsTestJSON-59137762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:47:38 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-e64301a9-8371-4ad0-a03e-07cab8285858 req-b300bd60-8499-4c31-9a3b-39c0813fef6d tempest-VolumesSnapshotsTestJSON-59137762 None] Flow 'volume_create_manager' (a17f1d1b-9387-4181-8384-eb0d6bd1085e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:47:38 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-e64301a9-8371-4ad0-a03e-07cab8285858 req-b300bd60-8499-4c31-9a3b-39c0813fef6d tempest-VolumesSnapshotsTestJSON-59137762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68584555-1e4d-4639-b77d-4a30fda7053f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:38 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-e64301a9-8371-4ad0-a03e-07cab8285858 req-b300bd60-8499-4c31-9a3b-39c0813fef6d tempest-VolumesSnapshotsTestJSON-59137762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68584555-1e4d-4639-b77d-4a30fda7053f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1648923506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44a2e681a24d426993874fcece9254ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:47:39Z,use_quota=True,user_id='8c2c729219ee46318678bc45d81d8f86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:38 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-e64301a9-8371-4ad0-a03e-07cab8285858 req-b300bd60-8499-4c31-9a3b-39c0813fef6d tempest-VolumesSnapshotsTestJSON-59137762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb099415-24f4-4fc0-afa6-366bcea52e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:38 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-e64301a9-8371-4ad0-a03e-07cab8285858 req-b300bd60-8499-4c31-9a3b-39c0813fef6d tempest-VolumesSnapshotsTestJSON-59137762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb099415-24f4-4fc0-afa6-366bcea52e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:38 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-e64301a9-8371-4ad0-a03e-07cab8285858 req-b300bd60-8499-4c31-9a3b-39c0813fef6d tempest-VolumesSnapshotsTestJSON-59137762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4537a901-2c48-470f-91ae-8d166002f3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:38 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-e64301a9-8371-4ad0-a03e-07cab8285858 req-b300bd60-8499-4c31-9a3b-39c0813fef6d tempest-VolumesSnapshotsTestJSON-59137762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4537a901-2c48-470f-91ae-8d166002f3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a', 'volume_name': 'volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:38 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-e64301a9-8371-4ad0-a03e-07cab8285858 req-b300bd60-8499-4c31-9a3b-39c0813fef6d tempest-VolumesSnapshotsTestJSON-59137762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed165e72-ac8b-4368-ba09-5a5e8c03a42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:38 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-e64301a9-8371-4ad0-a03e-07cab8285858 req-b300bd60-8499-4c31-9a3b-39c0813fef6d tempest-VolumesSnapshotsTestJSON-59137762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed165e72-ac8b-4368-ba09-5a5e8c03a42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:38 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-e64301a9-8371-4ad0-a03e-07cab8285858 req-b300bd60-8499-4c31-9a3b-39c0813fef6d tempest-VolumesSnapshotsTestJSON-59137762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab7b3fda-0c36-403d-bc3c-f9332796c922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:38 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [req-e64301a9-8371-4ad0-a03e-07cab8285858 req-b300bd60-8499-4c31-9a3b-39c0813fef6d tempest-VolumesSnapshotsTestJSON-59137762 None] Volume ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a', 'volume_size': 1} Sep 10 16:47:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-e64301a9-8371-4ad0-a03e-07cab8285858 req-b300bd60-8499-4c31-9a3b-39c0813fef6d tempest-VolumesSnapshotsTestJSON-59137762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:47:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-90b1fd82-5358-4ec0-a354-e8922f96abcf tempest-VolumesActionsTest-270422599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.790s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:47:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-90b1fd82-5358-4ec0-a354-e8922f96abcf tempest-VolumesActionsTest-270422599 None] Uploaded volume to glance image-id: 77dfe9e8-3df1-4a38-a0e4-c20f0347bc23. {{(pid=88189) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 10 16:47:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7730d41e-6d1a-46c3-b99e-2c9e9e91d61b tempest-VolumesNegativeTest-725043388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.997s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:47:46 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7730d41e-6d1a-46c3-b99e-2c9e9e91d61b tempest-VolumesNegativeTest-725043388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-955422430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8721a81-0c29-4ae1-9ecf-416b7ff09405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8fb3f1314a54f66a65b03634438b47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:47:27Z,use_quota=True,user_id='2d3dd26a69924461bb324374968982f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:47:46 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-7730d41e-6d1a-46c3-b99e-2c9e9e91d61b tempest-VolumesNegativeTest-725043388 None] Creating volume c8721a81-0c29-4ae1-9ecf-416b7ff09405 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:47:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7730d41e-6d1a-46c3-b99e-2c9e9e91d61b tempest-VolumesNegativeTest-725043388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:47:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7730d41e-6d1a-46c3-b99e-2c9e9e91d61b tempest-VolumesNegativeTest-725043388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:47:46 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7730d41e-6d1a-46c3-b99e-2c9e9e91d61b tempest-VolumesNegativeTest-725043388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:47:46 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7730d41e-6d1a-46c3-b99e-2c9e9e91d61b tempest-VolumesNegativeTest-725043388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:47:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7730d41e-6d1a-46c3-b99e-2c9e9e91d61b tempest-VolumesNegativeTest-725043388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:47:46 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7730d41e-6d1a-46c3-b99e-2c9e9e91d61b tempest-VolumesNegativeTest-725043388 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:47:46 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-7730d41e-6d1a-46c3-b99e-2c9e9e91d61b tempest-VolumesNegativeTest-725043388 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:47:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7730d41e-6d1a-46c3-b99e-2c9e9e91d61b tempest-VolumesNegativeTest-725043388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c8721a81-0c29-4ae1-9ecf-416b7ff09405 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:46 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c8721a81-0c29-4ae1-9ecf-416b7ff09405 1073741824 Sep 10 16:47:46 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:46 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-90b1fd82-5358-4ec0-a354-e8922f96abcf tempest-VolumesActionsTest-270422599 None] Copy volume to image completed successfully. Sep 10 16:47:46 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7730d41e-6d1a-46c3-b99e-2c9e9e91d61b tempest-VolumesNegativeTest-725043388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c8721a81-0c29-4ae1-9ecf-416b7ff09405 1073741824" returned: 0 in 0.406s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7730d41e-6d1a-46c3-b99e-2c9e9e91d61b tempest-VolumesNegativeTest-725043388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c8721a81-0c29-4ae1-9ecf-416b7ff09405 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:47 devstack sudo[99698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c8721a81-0c29-4ae1-9ecf-416b7ff09405 Sep 10 16:47:47 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:47 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7730d41e-6d1a-46c3-b99e-2c9e9e91d61b tempest-VolumesNegativeTest-725043388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c8721a81-0c29-4ae1-9ecf-416b7ff09405" returned: 0 in 0.246s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:47 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7730d41e-6d1a-46c3-b99e-2c9e9e91d61b tempest-VolumesNegativeTest-725043388 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:47:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7730d41e-6d1a-46c3-b99e-2c9e9e91d61b tempest-VolumesNegativeTest-725043388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:47:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-79daeba8-956f-4d3d-bf50-6792996d38b8 tempest-GroupsV314Test-796416885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.915s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:47:47 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-79daeba8-956f-4d3d-bf50-6792996d38b8 tempest-GroupsV314Test-796416885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dce9937d-92a8-400c-ad02-4bd5dda6521d,created_at=2026-09-10T14:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-350510008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dce9937d-92a8-400c-ad02-4bd5dda6521d,host='devstack@QuobyteHD#QuobyteHD',id=e02c4da8-6e31-410b-b317-472454e08ca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e799f76e1004181914db73f7a51aa0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:47:34Z,use_quota=True,user_id='0757d006b4814f629483716b93fffb27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6ccf621-1af1-42d4-a1a9-ed8a4f568b7a),volume_type_id=d6ccf621-1af1-42d4-a1a9-ed8a4f568b7a)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:47:47 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-79daeba8-956f-4d3d-bf50-6792996d38b8 tempest-GroupsV314Test-796416885 None] Creating volume e02c4da8-6e31-410b-b317-472454e08ca7 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:47:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-79daeba8-956f-4d3d-bf50-6792996d38b8 tempest-GroupsV314Test-796416885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:47:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-79daeba8-956f-4d3d-bf50-6792996d38b8 tempest-GroupsV314Test-796416885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:47:47 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-79daeba8-956f-4d3d-bf50-6792996d38b8 tempest-GroupsV314Test-796416885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:47:47 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-79daeba8-956f-4d3d-bf50-6792996d38b8 tempest-GroupsV314Test-796416885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:47:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-79daeba8-956f-4d3d-bf50-6792996d38b8 tempest-GroupsV314Test-796416885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:47:47 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-79daeba8-956f-4d3d-bf50-6792996d38b8 tempest-GroupsV314Test-796416885 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:47:47 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-79daeba8-956f-4d3d-bf50-6792996d38b8 tempest-GroupsV314Test-796416885 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:47:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-79daeba8-956f-4d3d-bf50-6792996d38b8 tempest-GroupsV314Test-796416885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:47 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7730d41e-6d1a-46c3-b99e-2c9e9e91d61b tempest-VolumesNegativeTest-725043388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b1c8f52-32a4-401b-b560-6f8675465f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8721a81-0c29-4ae1-9ecf-416b7ff09405', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:47 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7 1073741824 Sep 10 16:47:47 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:47 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7730d41e-6d1a-46c3-b99e-2c9e9e91d61b tempest-VolumesNegativeTest-725043388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e62b69bb-da60-46f4-a4bc-b013fd7ad29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:47 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-7730d41e-6d1a-46c3-b99e-2c9e9e91d61b tempest-VolumesNegativeTest-725043388 None] Volume volume-c8721a81-0c29-4ae1-9ecf-416b7ff09405 (c8721a81-0c29-4ae1-9ecf-416b7ff09405): created successfully Sep 10 16:47:47 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7730d41e-6d1a-46c3-b99e-2c9e9e91d61b tempest-VolumesNegativeTest-725043388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e62b69bb-da60-46f4-a4bc-b013fd7ad29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:47 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7730d41e-6d1a-46c3-b99e-2c9e9e91d61b tempest-VolumesNegativeTest-725043388 None] Flow 'volume_create_manager' (7808f0e9-a34b-4041-ad8b-d3e8ec0fb8c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:47:47 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-7730d41e-6d1a-46c3-b99e-2c9e9e91d61b tempest-VolumesNegativeTest-725043388 None] Created volume successfully. Sep 10 16:47:47 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-79daeba8-956f-4d3d-bf50-6792996d38b8 tempest-GroupsV314Test-796416885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7 1073741824" returned: 0 in 0.452s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-79daeba8-956f-4d3d-bf50-6792996d38b8 tempest-GroupsV314Test-796416885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:47 devstack sudo[99707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7 Sep 10 16:47:47 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:48 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-79daeba8-956f-4d3d-bf50-6792996d38b8 tempest-GroupsV314Test-796416885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7" returned: 0 in 0.282s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:48 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-79daeba8-956f-4d3d-bf50-6792996d38b8 tempest-GroupsV314Test-796416885 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:47:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-79daeba8-956f-4d3d-bf50-6792996d38b8 tempest-GroupsV314Test-796416885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:47:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-e64301a9-8371-4ad0-a03e-07cab8285858 req-b300bd60-8499-4c31-9a3b-39c0813fef6d tempest-VolumesSnapshotsTestJSON-59137762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.242s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:47:48 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [req-e64301a9-8371-4ad0-a03e-07cab8285858 req-b300bd60-8499-4c31-9a3b-39c0813fef6d tempest-VolumesSnapshotsTestJSON-59137762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1648923506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44a2e681a24d426993874fcece9254ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:47:39Z,use_quota=True,user_id='8c2c729219ee46318678bc45d81d8f86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:47:48 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [req-e64301a9-8371-4ad0-a03e-07cab8285858 req-b300bd60-8499-4c31-9a3b-39c0813fef6d tempest-VolumesSnapshotsTestJSON-59137762 None] Creating volume ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:47:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-e64301a9-8371-4ad0-a03e-07cab8285858 req-b300bd60-8499-4c31-9a3b-39c0813fef6d tempest-VolumesSnapshotsTestJSON-59137762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:47:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-e64301a9-8371-4ad0-a03e-07cab8285858 req-b300bd60-8499-4c31-9a3b-39c0813fef6d tempest-VolumesSnapshotsTestJSON-59137762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:47:48 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [req-e64301a9-8371-4ad0-a03e-07cab8285858 req-b300bd60-8499-4c31-9a3b-39c0813fef6d tempest-VolumesSnapshotsTestJSON-59137762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:47:48 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [req-e64301a9-8371-4ad0-a03e-07cab8285858 req-b300bd60-8499-4c31-9a3b-39c0813fef6d tempest-VolumesSnapshotsTestJSON-59137762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:47:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-e64301a9-8371-4ad0-a03e-07cab8285858 req-b300bd60-8499-4c31-9a3b-39c0813fef6d tempest-VolumesSnapshotsTestJSON-59137762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:47:48 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [req-e64301a9-8371-4ad0-a03e-07cab8285858 req-b300bd60-8499-4c31-9a3b-39c0813fef6d tempest-VolumesSnapshotsTestJSON-59137762 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:47:48 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [req-e64301a9-8371-4ad0-a03e-07cab8285858 req-b300bd60-8499-4c31-9a3b-39c0813fef6d tempest-VolumesSnapshotsTestJSON-59137762 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:47:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-e64301a9-8371-4ad0-a03e-07cab8285858 req-b300bd60-8499-4c31-9a3b-39c0813fef6d tempest-VolumesSnapshotsTestJSON-59137762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:48 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-79daeba8-956f-4d3d-bf50-6792996d38b8 tempest-GroupsV314Test-796416885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2962523c-0b46-4bec-9aa2-676d9da82903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e02c4da8-6e31-410b-b317-472454e08ca7', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:48 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-79daeba8-956f-4d3d-bf50-6792996d38b8 tempest-GroupsV314Test-796416885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f477ddbb-e54a-4eab-b476-66cdb85a5dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:48 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a 1073741824 Sep 10 16:47:48 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:48 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-79daeba8-956f-4d3d-bf50-6792996d38b8 tempest-GroupsV314Test-796416885 None] Volume volume-e02c4da8-6e31-410b-b317-472454e08ca7 (e02c4da8-6e31-410b-b317-472454e08ca7): created successfully Sep 10 16:47:48 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-79daeba8-956f-4d3d-bf50-6792996d38b8 tempest-GroupsV314Test-796416885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f477ddbb-e54a-4eab-b476-66cdb85a5dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:48 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-79daeba8-956f-4d3d-bf50-6792996d38b8 tempest-GroupsV314Test-796416885 None] Flow 'volume_create_manager' (ab557968-ec51-41b9-bbb9-a83d2fa8bb09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:47:48 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-79daeba8-956f-4d3d-bf50-6792996d38b8 tempest-GroupsV314Test-796416885 None] Created volume successfully. Sep 10 16:47:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-71001c52-df05-4dba-949e-9a14f481fb1c tempest-VolumesActionsTest-270422599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:47:48 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-e64301a9-8371-4ad0-a03e-07cab8285858 req-b300bd60-8499-4c31-9a3b-39c0813fef6d tempest-VolumesSnapshotsTestJSON-59137762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a 1073741824" returned: 0 in 0.533s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-e64301a9-8371-4ad0-a03e-07cab8285858 req-b300bd60-8499-4c31-9a3b-39c0813fef6d tempest-VolumesSnapshotsTestJSON-59137762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:48 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a Sep 10 16:47:48 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:48 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-e64301a9-8371-4ad0-a03e-07cab8285858 req-b300bd60-8499-4c31-9a3b-39c0813fef6d tempest-VolumesSnapshotsTestJSON-59137762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a" returned: 0 in 0.268s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:48 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [req-e64301a9-8371-4ad0-a03e-07cab8285858 req-b300bd60-8499-4c31-9a3b-39c0813fef6d tempest-VolumesSnapshotsTestJSON-59137762 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:47:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-e64301a9-8371-4ad0-a03e-07cab8285858 req-b300bd60-8499-4c31-9a3b-39c0813fef6d tempest-VolumesSnapshotsTestJSON-59137762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:47:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-71001c52-df05-4dba-949e-9a14f481fb1c tempest-VolumesActionsTest-270422599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.502s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:47:48 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-e64301a9-8371-4ad0-a03e-07cab8285858 req-b300bd60-8499-4c31-9a3b-39c0813fef6d tempest-VolumesSnapshotsTestJSON-59137762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab7b3fda-0c36-403d-bc3c-f9332796c922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:48 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-e64301a9-8371-4ad0-a03e-07cab8285858 req-b300bd60-8499-4c31-9a3b-39c0813fef6d tempest-VolumesSnapshotsTestJSON-59137762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a0b953a-5592-4706-bb74-df298aab7baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:47:48 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6d9281-1a29-457e-bba9-1be28b6280b9]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:47:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-71001c52-df05-4dba-949e-9a14f481fb1c tempest-VolumesActionsTest-270422599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:48 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [req-e64301a9-8371-4ad0-a03e-07cab8285858 req-b300bd60-8499-4c31-9a3b-39c0813fef6d tempest-VolumesSnapshotsTestJSON-59137762 None] Volume volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a (ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a): created successfully Sep 10 16:47:48 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-e64301a9-8371-4ad0-a03e-07cab8285858 req-b300bd60-8499-4c31-9a3b-39c0813fef6d tempest-VolumesSnapshotsTestJSON-59137762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a0b953a-5592-4706-bb74-df298aab7baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:47:48 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-e64301a9-8371-4ad0-a03e-07cab8285858 req-b300bd60-8499-4c31-9a3b-39c0813fef6d tempest-VolumesSnapshotsTestJSON-59137762 None] Flow 'volume_create_manager' (a17f1d1b-9387-4181-8384-eb0d6bd1085e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:47:48 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-e64301a9-8371-4ad0-a03e-07cab8285858 req-b300bd60-8499-4c31-9a3b-39c0813fef6d tempest-VolumesSnapshotsTestJSON-59137762 None] Created volume successfully. Sep 10 16:47:49 devstack sudo[99722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507 Sep 10 16:47:49 devstack sudo[99722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:49 devstack sudo[99722]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-71001c52-df05-4dba-949e-9a14f481fb1c tempest-VolumesActionsTest-270422599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507" returned: 0 in 0.419s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:49 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[66eb04c2-c926-4882-baa7-5a19115a8728]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:47:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-71001c52-df05-4dba-949e-9a14f481fb1c tempest-VolumesActionsTest-270422599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager._thread_info {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:47:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread count: 28 {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 16:47:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread info: [<_MainThread(MainThread, started 125792070905984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 16:47:49 devstack sudo[99727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507 Sep 10 16:47:49 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-5bc94af8-87d0-47c2-bb1b-89c35b91a7e8 req-3b9e6e05-77a0-4018-87cf-ef48e0501d49 tempest-VolumesSnapshotsTestJSON-59137762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:47:49 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-71001c52-df05-4dba-949e-9a14f481fb1c tempest-VolumesActionsTest-270422599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507" returned: 0 in 0.553s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-71001c52-df05-4dba-949e-9a14f481fb1c tempest-VolumesActionsTest-270422599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507 /opt/stack/data/cinder/conversion/8def1d0e-5a45-4fc8-8126-19bfd3057507.temp_image.6789e616-7801-497c-a05f-552dd2096297xczygrex.img {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:49 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507 /opt/stack/data/cinder/conversion/8def1d0e-5a45-4fc8-8126-19bfd3057507.temp_image.6789e616-7801-497c-a05f-552dd2096297xczygrex.img Sep 10 16:47:49 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:47:55 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-71001c52-df05-4dba-949e-9a14f481fb1c tempest-VolumesActionsTest-270422599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507 /opt/stack/data/cinder/conversion/8def1d0e-5a45-4fc8-8126-19bfd3057507.temp_image.6789e616-7801-497c-a05f-552dd2096297xczygrex.img" returned: 0 in 5.878s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:55 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae786b2c-b0ba-491d-b3d6-274d4ec34a82]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:47:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-71001c52-df05-4dba-949e-9a14f481fb1c tempest-VolumesActionsTest-270422599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:55 devstack sudo[99766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507 Sep 10 16:47:55 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:56 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-71001c52-df05-4dba-949e-9a14f481fb1c tempest-VolumesActionsTest-270422599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507" returned: 0 in 0.810s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:56 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-71001c52-df05-4dba-949e-9a14f481fb1c tempest-VolumesActionsTest-270422599 None] Image conversion details: src /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507, size 1024.00 MB, duration 5.88 sec, destination /opt/stack/data/cinder/conversion/8def1d0e-5a45-4fc8-8126-19bfd3057507.temp_image.6789e616-7801-497c-a05f-552dd2096297xczygrex.img {{(pid=88189) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 16:47:56 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-71001c52-df05-4dba-949e-9a14f481fb1c tempest-VolumesActionsTest-270422599 None] Converted 1024.00 MB image at 174.17 MB/s Sep 10 16:47:56 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-71001c52-df05-4dba-949e-9a14f481fb1c tempest-VolumesActionsTest-270422599 None] 6789e616-7801-497c-a05f-552dd2096297 was raw, converting to qcow2 {{(pid=88189) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 10 16:47:56 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[15647406-d8fc-4311-bbba-e338ad7bd679]: (4, 'raw') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:47:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-71001c52-df05-4dba-949e-9a14f481fb1c tempest-VolumesActionsTest-270422599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8def1d0e-5a45-4fc8-8126-19bfd3057507.temp_image.6789e616-7801-497c-a05f-552dd2096297xczygrex.img {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:56 devstack sudo[99825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8def1d0e-5a45-4fc8-8126-19bfd3057507.temp_image.6789e616-7801-497c-a05f-552dd2096297xczygrex.img Sep 10 16:47:56 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:57 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-71001c52-df05-4dba-949e-9a14f481fb1c tempest-VolumesActionsTest-270422599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8def1d0e-5a45-4fc8-8126-19bfd3057507.temp_image.6789e616-7801-497c-a05f-552dd2096297xczygrex.img" returned: 0 in 0.530s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-71001c52-df05-4dba-949e-9a14f481fb1c tempest-VolumesActionsTest-270422599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8def1d0e-5a45-4fc8-8126-19bfd3057507.temp_image.6789e616-7801-497c-a05f-552dd2096297xczygrex.img {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:57 devstack sudo[99839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8def1d0e-5a45-4fc8-8126-19bfd3057507.temp_image.6789e616-7801-497c-a05f-552dd2096297xczygrex.img Sep 10 16:47:57 devstack sudo[99839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:57 devstack sudo[99839]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-71001c52-df05-4dba-949e-9a14f481fb1c tempest-VolumesActionsTest-270422599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8def1d0e-5a45-4fc8-8126-19bfd3057507.temp_image.6789e616-7801-497c-a05f-552dd2096297xczygrex.img" returned: 1 in 0.390s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-71001c52-df05-4dba-949e-9a14f481fb1c tempest-VolumesActionsTest-270422599 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8def1d0e-5a45-4fc8-8126-19bfd3057507.temp_image.6789e616-7801-497c-a05f-552dd2096297xczygrex.img' failed. Not Retrying. {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 16:47:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-71001c52-df05-4dba-949e-9a14f481fb1c tempest-VolumesActionsTest-270422599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8def1d0e-5a45-4fc8-8126-19bfd3057507.temp_image.6789e616-7801-497c-a05f-552dd2096297xczygrex.img /opt/stack/data/cinder/conversion/vol_upload_6e9xh5xc {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:57 devstack sudo[99847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8def1d0e-5a45-4fc8-8126-19bfd3057507.temp_image.6789e616-7801-497c-a05f-552dd2096297xczygrex.img /opt/stack/data/cinder/conversion/vol_upload_6e9xh5xc Sep 10 16:47:57 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:58 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-71001c52-df05-4dba-949e-9a14f481fb1c tempest-VolumesActionsTest-270422599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8def1d0e-5a45-4fc8-8126-19bfd3057507.temp_image.6789e616-7801-497c-a05f-552dd2096297xczygrex.img /opt/stack/data/cinder/conversion/vol_upload_6e9xh5xc" returned: 0 in 0.402s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:47:58 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-71001c52-df05-4dba-949e-9a14f481fb1c tempest-VolumesActionsTest-270422599 None] Image conversion details: src /opt/stack/data/cinder/conversion/8def1d0e-5a45-4fc8-8126-19bfd3057507.temp_image.6789e616-7801-497c-a05f-552dd2096297xczygrex.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_6e9xh5xc {{(pid=88189) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 16:47:58 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-71001c52-df05-4dba-949e-9a14f481fb1c tempest-VolumesActionsTest-270422599 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 10 16:47:58 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b7f1d1-9c42-4b47-a54c-0067c483c763]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:47:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-71001c52-df05-4dba-949e-9a14f481fb1c tempest-VolumesActionsTest-270422599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_6e9xh5xc {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:47:58 devstack sudo[99854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_6e9xh5xc Sep 10 16:47:58 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:47:58 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root Sep 10 16:47:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-71001c52-df05-4dba-949e-9a14f481fb1c tempest-VolumesActionsTest-270422599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_6e9xh5xc" returned: 0 in 0.401s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-71001c52-df05-4dba-949e-9a14f481fb1c tempest-VolumesActionsTest-270422599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.129s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-71001c52-df05-4dba-949e-9a14f481fb1c tempest-VolumesActionsTest-270422599 None] Uploaded volume to glance image-id: 6789e616-7801-497c-a05f-552dd2096297. {{(pid=88189) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 10 16:48:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-5bc94af8-87d0-47c2-bb1b-89c35b91a7e8 req-3b9e6e05-77a0-4018-87cf-ef48e0501d49 tempest-VolumesSnapshotsTestJSON-59137762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.161s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:00 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [req-5bc94af8-87d0-47c2-bb1b-89c35b91a7e8 req-3b9e6e05-77a0-4018-87cf-ef48e0501d49 tempest-VolumesSnapshotsTestJSON-59137762 None] Creating offline snapshot 5cdde4b0-f971-4bb7-8c44-56bd96dd4b08 of volume ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:48:00 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-71001c52-df05-4dba-949e-9a14f481fb1c tempest-VolumesActionsTest-270422599 None] Copy volume to image completed successfully. Sep 10 16:48:00 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a2c7e7-9546-4f21-8539-98e6573f4d82]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:48:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-5bc94af8-87d0-47c2-bb1b-89c35b91a7e8 req-3b9e6e05-77a0-4018-87cf-ef48e0501d49 tempest-VolumesSnapshotsTestJSON-59137762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:00 devstack sudo[99878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a Sep 10 16:48:00 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:00 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-5bc94af8-87d0-47c2-bb1b-89c35b91a7e8 req-3b9e6e05-77a0-4018-87cf-ef48e0501d49 tempest-VolumesSnapshotsTestJSON-59137762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a" returned: 0 in 0.466s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-5bc94af8-87d0-47c2-bb1b-89c35b91a7e8 req-3b9e6e05-77a0-4018-87cf-ef48e0501d49 tempest-VolumesSnapshotsTestJSON-59137762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a.5cdde4b0-f971-4bb7-8c44-56bd96dd4b08 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:00 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a.5cdde4b0-f971-4bb7-8c44-56bd96dd4b08 1G Sep 10 16:48:00 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:01 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-5bc94af8-87d0-47c2-bb1b-89c35b91a7e8 req-3b9e6e05-77a0-4018-87cf-ef48e0501d49 tempest-VolumesSnapshotsTestJSON-59137762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a.5cdde4b0-f971-4bb7-8c44-56bd96dd4b08 1G" returned: 0 in 0.526s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-5bc94af8-87d0-47c2-bb1b-89c35b91a7e8 req-3b9e6e05-77a0-4018-87cf-ef48e0501d49 tempest-VolumesSnapshotsTestJSON-59137762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a.5cdde4b0-f971-4bb7-8c44-56bd96dd4b08 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:01 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a.5cdde4b0-f971-4bb7-8c44-56bd96dd4b08 Sep 10 16:48:01 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:01 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-5bc94af8-87d0-47c2-bb1b-89c35b91a7e8 req-3b9e6e05-77a0-4018-87cf-ef48e0501d49 tempest-VolumesSnapshotsTestJSON-59137762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a.5cdde4b0-f971-4bb7-8c44-56bd96dd4b08" returned: 0 in 0.348s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:01 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [req-5bc94af8-87d0-47c2-bb1b-89c35b91a7e8 req-3b9e6e05-77a0-4018-87cf-ef48e0501d49 tempest-VolumesSnapshotsTestJSON-59137762 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a.5cdde4b0-f971-4bb7-8c44-56bd96dd4b08 is being set with open permissions: ugo+rw Sep 10 16:48:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-5bc94af8-87d0-47c2-bb1b-89c35b91a7e8 req-3b9e6e05-77a0-4018-87cf-ef48e0501d49 tempest-VolumesSnapshotsTestJSON-59137762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a.5cdde4b0-f971-4bb7-8c44-56bd96dd4b08 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:01 devstack sudo[99903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a.5cdde4b0-f971-4bb7-8c44-56bd96dd4b08 Sep 10 16:48:01 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:01 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:01 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-38f64855-55bd-49f1-9b4b-092dfc7c1105 tempest-VolumesActionsTest-270422599 None] Acquiring lock "cinder-8def1d0e-5a45-4fc8-8126-19bfd3057507-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-5bc94af8-87d0-47c2-bb1b-89c35b91a7e8 req-3b9e6e05-77a0-4018-87cf-ef48e0501d49 tempest-VolumesSnapshotsTestJSON-59137762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a.5cdde4b0-f971-4bb7-8c44-56bd96dd4b08" returned: 0 in 0.316s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:01 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-38f64855-55bd-49f1-9b4b-092dfc7c1105 tempest-VolumesActionsTest-270422599 None] Lock "cinder-8def1d0e-5a45-4fc8-8126-19bfd3057507-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-5bc94af8-87d0-47c2-bb1b-89c35b91a7e8 req-3b9e6e05-77a0-4018-87cf-ef48e0501d49 tempest-VolumesSnapshotsTestJSON-59137762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:01 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-38f64855-55bd-49f1-9b4b-092dfc7c1105 tempest-VolumesActionsTest-270422599 None] Acquiring lock "cinder-quobyte-8def1d0e-5a45-4fc8-8126-19bfd3057507" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:01 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a.info Sep 10 16:48:01 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-38f64855-55bd-49f1-9b4b-092dfc7c1105 tempest-VolumesActionsTest-270422599 None] Lock "cinder-quobyte-8def1d0e-5a45-4fc8-8126-19bfd3057507" acquired by "delete_volume" :: waited 0.018s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:02 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac093570-9c3d-4f6f-8d78-f1e6d736c164]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:48:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-38f64855-55bd-49f1-9b4b-092dfc7c1105 tempest-VolumesActionsTest-270422599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:02 devstack sudo[99908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507 Sep 10 16:48:02 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:02 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-5bc94af8-87d0-47c2-bb1b-89c35b91a7e8 req-3b9e6e05-77a0-4018-87cf-ef48e0501d49 tempest-VolumesSnapshotsTestJSON-59137762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a.info" returned: 0 in 0.267s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:02 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [req-5bc94af8-87d0-47c2-bb1b-89c35b91a7e8 req-3b9e6e05-77a0-4018-87cf-ef48e0501d49 tempest-VolumesSnapshotsTestJSON-59137762 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a.info is being set with open permissions: ugo+rw Sep 10 16:48:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-5bc94af8-87d0-47c2-bb1b-89c35b91a7e8 req-3b9e6e05-77a0-4018-87cf-ef48e0501d49 tempest-VolumesSnapshotsTestJSON-59137762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:02 devstack sudo[99911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a.info Sep 10 16:48:02 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:02 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-38f64855-55bd-49f1-9b4b-092dfc7c1105 tempest-VolumesActionsTest-270422599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507" returned: 0 in 0.424s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-38f64855-55bd-49f1-9b4b-092dfc7c1105 tempest-VolumesActionsTest-270422599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:02 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507 Sep 10 16:48:02 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:02 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-5bc94af8-87d0-47c2-bb1b-89c35b91a7e8 req-3b9e6e05-77a0-4018-87cf-ef48e0501d49 tempest-VolumesSnapshotsTestJSON-59137762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a.info" returned: 0 in 0.281s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-5bc94af8-87d0-47c2-bb1b-89c35b91a7e8 req-3b9e6e05-77a0-4018-87cf-ef48e0501d49 tempest-VolumesSnapshotsTestJSON-59137762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.508s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 12.062s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:02 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Cloning volume e02c4da8-6e31-410b-b317-472454e08ca7 to volume dc8ac17b-0c5a-41d4-925e-73503bd730f0 Sep 10 16:48:02 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-5bc94af8-87d0-47c2-bb1b-89c35b91a7e8 req-3b9e6e05-77a0-4018-87cf-ef48e0501d49 tempest-VolumesSnapshotsTestJSON-59137762 None] Create snapshot completed successfully Sep 10 16:48:02 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Creating offline snapshot 5029b7bd-9755-4a43-b73d-c1ad8d5943b2 of volume e02c4da8-6e31-410b-b317-472454e08ca7 {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:48:02 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[28da1f22-867a-4e4a-a882-17588ff2b6bc]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:48:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:02 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-38f64855-55bd-49f1-9b4b-092dfc7c1105 tempest-VolumesActionsTest-270422599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8def1d0e-5a45-4fc8-8126-19bfd3057507" returned: 0 in 0.282s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-38f64855-55bd-49f1-9b4b-092dfc7c1105 tempest-VolumesActionsTest-270422599 None] Lock "cinder-quobyte-8def1d0e-5a45-4fc8-8126-19bfd3057507" released by "delete_volume" :: held 0.743s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:02 devstack sudo[99919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7 Sep 10 16:48:02 devstack sudo[99919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:02 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-38f64855-55bd-49f1-9b4b-092dfc7c1105 tempest-VolumesActionsTest-270422599 None] Created reservations ['bb4af778-c7cc-40f4-b495-aade760e0d4a', '0b5ee4df-1851-413c-81e6-6977ba81757b', '66da2fc5-b021-4e48-ab23-30ae928f9ba0', '5683769b-7fb3-47cb-8c3d-03e7e20ed89d'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:48:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-38f64855-55bd-49f1-9b4b-092dfc7c1105 tempest-VolumesActionsTest-270422599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-38f64855-55bd-49f1-9b4b-092dfc7c1105 tempest-VolumesActionsTest-270422599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:02 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-38f64855-55bd-49f1-9b4b-092dfc7c1105 tempest-VolumesActionsTest-270422599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:48:02 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-38f64855-55bd-49f1-9b4b-092dfc7c1105 tempest-VolumesActionsTest-270422599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:48:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-38f64855-55bd-49f1-9b4b-092dfc7c1105 tempest-VolumesActionsTest-270422599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-38f64855-55bd-49f1-9b4b-092dfc7c1105 tempest-VolumesActionsTest-270422599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:02 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:48:02 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:03 devstack sudo[99919]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7" returned: 0 in 0.437s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7.5029b7bd-9755-4a43-b73d-c1ad8d5943b2 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:03 devstack sudo[99928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7.5029b7bd-9755-4a43-b73d-c1ad8d5943b2 1G Sep 10 16:48:03 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:03 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-38f64855-55bd-49f1-9b4b-092dfc7c1105 tempest-VolumesActionsTest-270422599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.293s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:03 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-38f64855-55bd-49f1-9b4b-092dfc7c1105 tempest-VolumesActionsTest-270422599 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:48:03 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-38f64855-55bd-49f1-9b4b-092dfc7c1105 tempest-VolumesActionsTest-270422599 None] Deleted volume successfully. Sep 10 16:48:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-38f64855-55bd-49f1-9b4b-092dfc7c1105 tempest-VolumesActionsTest-270422599 None] Lock "cinder-8def1d0e-5a45-4fc8-8126-19bfd3057507-delete_volume" released by "delete_volume" :: held 1.289s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [req-0b7eae52-b5b7-44a9-9f48-ec2a529f574b req-8b9b8583-5840-495c-ab87-70592b024bb4 tempest-VolumesSnapshotsTestJSON-59137762 None] Acquiring lock "cinder-5cdde4b0-f971-4bb7-8c44-56bd96dd4b08-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [req-0b7eae52-b5b7-44a9-9f48-ec2a529f574b req-8b9b8583-5840-495c-ab87-70592b024bb4 tempest-VolumesSnapshotsTestJSON-59137762 None] Lock "cinder-5cdde4b0-f971-4bb7-8c44-56bd96dd4b08-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [req-0b7eae52-b5b7-44a9-9f48-ec2a529f574b req-8b9b8583-5840-495c-ab87-70592b024bb4 tempest-VolumesSnapshotsTestJSON-59137762 None] Acquiring lock "cinder-quobyte-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [req-0b7eae52-b5b7-44a9-9f48-ec2a529f574b req-8b9b8583-5840-495c-ab87-70592b024bb4 tempest-VolumesSnapshotsTestJSON-59137762 None] Lock "cinder-quobyte-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [req-0b7eae52-b5b7-44a9-9f48-ec2a529f574b req-8b9b8583-5840-495c-ab87-70592b024bb4 tempest-VolumesSnapshotsTestJSON-59137762 None] Acquiring lock "cinder-quobyte-5cdde4b0-f971-4bb7-8c44-56bd96dd4b08" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [req-0b7eae52-b5b7-44a9-9f48-ec2a529f574b req-8b9b8583-5840-495c-ab87-70592b024bb4 tempest-VolumesSnapshotsTestJSON-59137762 None] Lock "cinder-quobyte-5cdde4b0-f971-4bb7-8c44-56bd96dd4b08" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:03 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [req-0b7eae52-b5b7-44a9-9f48-ec2a529f574b req-8b9b8583-5840-495c-ab87-70592b024bb4 tempest-VolumesSnapshotsTestJSON-59137762 None] Deleting offline snapshot 5cdde4b0-f971-4bb7-8c44-56bd96dd4b08 of volume ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:48:03 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [req-0b7eae52-b5b7-44a9-9f48-ec2a529f574b req-8b9b8583-5840-495c-ab87-70592b024bb4 tempest-VolumesSnapshotsTestJSON-59137762 None] snapshot_file for this snap is: volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a.5cdde4b0-f971-4bb7-8c44-56bd96dd4b08 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:48:03 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:03 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ce135d-0350-4478-8002-059cc1fdada9]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:48:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-0b7eae52-b5b7-44a9-9f48-ec2a529f574b req-8b9b8583-5840-495c-ab87-70592b024bb4 tempest-VolumesSnapshotsTestJSON-59137762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a.5cdde4b0-f971-4bb7-8c44-56bd96dd4b08 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7.5029b7bd-9755-4a43-b73d-c1ad8d5943b2 1G" returned: 0 in 0.612s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e02c4da8-6e31-410b-b317-472454e08ca7 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7.5029b7bd-9755-4a43-b73d-c1ad8d5943b2 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:03 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e02c4da8-6e31-410b-b317-472454e08ca7 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7.5029b7bd-9755-4a43-b73d-c1ad8d5943b2 Sep 10 16:48:03 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:03 devstack sudo[99935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a.5cdde4b0-f971-4bb7-8c44-56bd96dd4b08 Sep 10 16:48:03 devstack sudo[99935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:04 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e02c4da8-6e31-410b-b317-472454e08ca7 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7.5029b7bd-9755-4a43-b73d-c1ad8d5943b2" returned: 0 in 0.390s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:04 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7.5029b7bd-9755-4a43-b73d-c1ad8d5943b2 is being set with open permissions: ugo+rw: NotImplementedError Sep 10 16:48:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7.5029b7bd-9755-4a43-b73d-c1ad8d5943b2 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:04 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7.5029b7bd-9755-4a43-b73d-c1ad8d5943b2 Sep 10 16:48:04 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:04 devstack sudo[99935]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-0b7eae52-b5b7-44a9-9f48-ec2a529f574b req-8b9b8583-5840-495c-ab87-70592b024bb4 tempest-VolumesSnapshotsTestJSON-59137762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a.5cdde4b0-f971-4bb7-8c44-56bd96dd4b08" returned: 0 in 0.504s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [req-0b7eae52-b5b7-44a9-9f48-ec2a529f574b req-8b9b8583-5840-495c-ab87-70592b024bb4 tempest-VolumesSnapshotsTestJSON-59137762 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:48:04 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfdd08b-47d5-412b-a07f-f000d73f5003]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:48:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-0b7eae52-b5b7-44a9-9f48-ec2a529f574b req-8b9b8583-5840-495c-ab87-70592b024bb4 tempest-VolumesSnapshotsTestJSON-59137762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:04 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a Sep 10 16:48:04 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:04 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7.5029b7bd-9755-4a43-b73d-c1ad8d5943b2" returned: 0 in 0.352s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:04 devstack sudo[99951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7.info Sep 10 16:48:04 devstack sudo[99951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:04 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-0b7eae52-b5b7-44a9-9f48-ec2a529f574b req-8b9b8583-5840-495c-ab87-70592b024bb4 tempest-VolumesSnapshotsTestJSON-59137762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a" returned: 0 in 0.489s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-0b7eae52-b5b7-44a9-9f48-ec2a529f574b req-8b9b8583-5840-495c-ab87-70592b024bb4 tempest-VolumesSnapshotsTestJSON-59137762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a.5cdde4b0-f971-4bb7-8c44-56bd96dd4b08 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:04 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a.5cdde4b0-f971-4bb7-8c44-56bd96dd4b08 Sep 10 16:48:04 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:04 devstack sudo[99951]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7.info" returned: 0 in 0.329s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:04 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7.info is being set with open permissions: ugo+rw: NotImplementedError Sep 10 16:48:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:04 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7.info Sep 10 16:48:04 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:05 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7.info" returned: 0 in 0.303s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:05 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Acquiring lock "cinder-quobyte-dc8ac17b-0c5a-41d4-925e-73503bd730f0" by "_copy_volume_from_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:05 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Lock "cinder-quobyte-dc8ac17b-0c5a-41d4-925e-73503bd730f0" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] snapshot: 5029b7bd-9755-4a43-b73d-c1ad8d5943b2, volume: dc8ac17b-0c5a-41d4-925e-73503bd730f0, {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 16:48:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:48:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:48:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:05 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:05 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[058ab565-0884-40c2-8e49-9449eb32e06e]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:48:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7.5029b7bd-9755-4a43-b73d-c1ad8d5943b2 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-0b7eae52-b5b7-44a9-9f48-ec2a529f574b req-8b9b8583-5840-495c-ab87-70592b024bb4 tempest-VolumesSnapshotsTestJSON-59137762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a.5cdde4b0-f971-4bb7-8c44-56bd96dd4b08" returned: 0 in 0.477s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-0b7eae52-b5b7-44a9-9f48-ec2a529f574b req-8b9b8583-5840-495c-ab87-70592b024bb4 tempest-VolumesSnapshotsTestJSON-59137762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a.5cdde4b0-f971-4bb7-8c44-56bd96dd4b08 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:05 devstack sudo[99969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a.5cdde4b0-f971-4bb7-8c44-56bd96dd4b08 Sep 10 16:48:05 devstack sudo[99969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:05 devstack sudo[99968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7.5029b7bd-9755-4a43-b73d-c1ad8d5943b2 Sep 10 16:48:05 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:05 devstack sudo[99969]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-0b7eae52-b5b7-44a9-9f48-ec2a529f574b req-8b9b8583-5840-495c-ab87-70592b024bb4 tempest-VolumesSnapshotsTestJSON-59137762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a.5cdde4b0-f971-4bb7-8c44-56bd96dd4b08" returned: 0 in 0.347s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:05 devstack cinder-volume[88189]: DEBUG cinder.coordination [req-0b7eae52-b5b7-44a9-9f48-ec2a529f574b req-8b9b8583-5840-495c-ab87-70592b024bb4 tempest-VolumesSnapshotsTestJSON-59137762 None] Lock "cinder-quobyte-5cdde4b0-f971-4bb7-8c44-56bd96dd4b08" released by "_delete_snapshot" :: held 1.981s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:05 devstack cinder-volume[88189]: DEBUG cinder.coordination [req-0b7eae52-b5b7-44a9-9f48-ec2a529f574b req-8b9b8583-5840-495c-ab87-70592b024bb4 tempest-VolumesSnapshotsTestJSON-59137762 None] Lock "cinder-quobyte-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a" released by "delete_snapshot" :: held 2.016s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:05 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7.5029b7bd-9755-4a43-b73d-c1ad8d5943b2" returned: 0 in 0.491s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e02c4da8-6e31-410b-b317-472454e08ca7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:48:05 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[34459441-7753-4376-bbd3-17768d9ef75d]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:48:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:05 devstack cinder-volume[88189]: DEBUG cinder.quota [req-0b7eae52-b5b7-44a9-9f48-ec2a529f574b req-8b9b8583-5840-495c-ab87-70592b024bb4 tempest-VolumesSnapshotsTestJSON-59137762 None] Created reservations ['592e83e4-e224-4652-ba21-9c327830def9', '3d9204a2-095d-4691-a106-ab9aa3b78f18', '0d858a1c-5675-4f13-9cfa-10b6ecc07b83', '8c8b2760-792f-4cbb-8c21-da494eba59ed'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:48:05 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-0b7eae52-b5b7-44a9-9f48-ec2a529f574b req-8b9b8583-5840-495c-ab87-70592b024bb4 tempest-VolumesSnapshotsTestJSON-59137762 None] Delete snapshot completed successfully. Sep 10 16:48:05 devstack cinder-volume[88189]: DEBUG cinder.coordination [req-0b7eae52-b5b7-44a9-9f48-ec2a529f574b req-8b9b8583-5840-495c-ab87-70592b024bb4 tempest-VolumesSnapshotsTestJSON-59137762 None] Lock "cinder-5cdde4b0-f971-4bb7-8c44-56bd96dd4b08-delete_snapshot" released by "delete_snapshot" :: held 2.249s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:05 devstack sudo[99976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7 Sep 10 16:48:05 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:06 devstack cinder-volume[88189]: DEBUG cinder.coordination [req-58e815eb-e74e-4a3e-b7f3-612821c67a25 req-5ada54a1-3ce5-42af-bd0d-fa8c73a65bbb tempest-VolumesSnapshotsTestJSON-59137762 None] Acquiring lock "cinder-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:06 devstack cinder-volume[88189]: DEBUG cinder.coordination [req-58e815eb-e74e-4a3e-b7f3-612821c67a25 req-5ada54a1-3ce5-42af-bd0d-fa8c73a65bbb tempest-VolumesSnapshotsTestJSON-59137762 None] Lock "cinder-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:06 devstack cinder-volume[88189]: DEBUG cinder.coordination [req-58e815eb-e74e-4a3e-b7f3-612821c67a25 req-5ada54a1-3ce5-42af-bd0d-fa8c73a65bbb tempest-VolumesSnapshotsTestJSON-59137762 None] Acquiring lock "cinder-quobyte-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:06 devstack cinder-volume[88189]: DEBUG cinder.coordination [req-58e815eb-e74e-4a3e-b7f3-612821c67a25 req-5ada54a1-3ce5-42af-bd0d-fa8c73a65bbb tempest-VolumesSnapshotsTestJSON-59137762 None] Lock "cinder-quobyte-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a" acquired by "delete_volume" :: waited 0.028s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:06 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2204277-40e5-422f-beed-5dc7db18c6b8]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:48:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-58e815eb-e74e-4a3e-b7f3-612821c67a25 req-5ada54a1-3ce5-42af-bd0d-fa8c73a65bbb tempest-VolumesSnapshotsTestJSON-59137762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:06 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7" returned: 0 in 0.541s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:06 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] will copy from snapshot at /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7 {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 16:48:06 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Creating direct copy from snapshot {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 16:48:06 devstack cinder-volume[88189]: DEBUG cinder.utils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Path /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dc8ac17b-0c5a-41d4-925e-73503bd730f0 not found in is_blk_device check {{(pid=88189) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 16:48:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dc8ac17b-0c5a-41d4-925e-73503bd730f0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:06 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dc8ac17b-0c5a-41d4-925e-73503bd730f0 Sep 10 16:48:06 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:06 devstack sudo[99982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a Sep 10 16:48:06 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:06 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-58e815eb-e74e-4a3e-b7f3-612821c67a25 req-5ada54a1-3ce5-42af-bd0d-fa8c73a65bbb tempest-VolumesSnapshotsTestJSON-59137762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a" returned: 0 in 0.401s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-58e815eb-e74e-4a3e-b7f3-612821c67a25 req-5ada54a1-3ce5-42af-bd0d-fa8c73a65bbb tempest-VolumesSnapshotsTestJSON-59137762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:06 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a Sep 10 16:48:06 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:06 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-58e815eb-e74e-4a3e-b7f3-612821c67a25 req-5ada54a1-3ce5-42af-bd0d-fa8c73a65bbb tempest-VolumesSnapshotsTestJSON-59137762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a" returned: 0 in 0.400s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:07 devstack cinder-volume[88189]: DEBUG cinder.coordination [req-58e815eb-e74e-4a3e-b7f3-612821c67a25 req-5ada54a1-3ce5-42af-bd0d-fa8c73a65bbb tempest-VolumesSnapshotsTestJSON-59137762 None] Lock "cinder-quobyte-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a" released by "delete_volume" :: held 0.917s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:07 devstack cinder-volume[88189]: DEBUG cinder.quota [req-58e815eb-e74e-4a3e-b7f3-612821c67a25 req-5ada54a1-3ce5-42af-bd0d-fa8c73a65bbb tempest-VolumesSnapshotsTestJSON-59137762 None] Created reservations ['2f0ef0b4-6d1a-4d08-a2b9-2c1d5749ed3f', 'ad72ef81-9b36-42b7-b70c-eab1ab3a60cd', '452cca7e-d6df-4ab6-a478-06e88bbc5d3b', '5c935ce5-1ea1-4ded-8381-d31effc9f3b7'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:48:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-58e815eb-e74e-4a3e-b7f3-612821c67a25 req-5ada54a1-3ce5-42af-bd0d-fa8c73a65bbb tempest-VolumesSnapshotsTestJSON-59137762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-58e815eb-e74e-4a3e-b7f3-612821c67a25 req-5ada54a1-3ce5-42af-bd0d-fa8c73a65bbb tempest-VolumesSnapshotsTestJSON-59137762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:07 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [req-58e815eb-e74e-4a3e-b7f3-612821c67a25 req-5ada54a1-3ce5-42af-bd0d-fa8c73a65bbb tempest-VolumesSnapshotsTestJSON-59137762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:48:07 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [req-58e815eb-e74e-4a3e-b7f3-612821c67a25 req-5ada54a1-3ce5-42af-bd0d-fa8c73a65bbb tempest-VolumesSnapshotsTestJSON-59137762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:48:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-58e815eb-e74e-4a3e-b7f3-612821c67a25 req-5ada54a1-3ce5-42af-bd0d-fa8c73a65bbb tempest-VolumesSnapshotsTestJSON-59137762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-58e815eb-e74e-4a3e-b7f3-612821c67a25 req-5ada54a1-3ce5-42af-bd0d-fa8c73a65bbb tempest-VolumesSnapshotsTestJSON-59137762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:07 devstack sudo[100003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:48:07 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:08 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-58e815eb-e74e-4a3e-b7f3-612821c67a25 req-5ada54a1-3ce5-42af-bd0d-fa8c73a65bbb tempest-VolumesSnapshotsTestJSON-59137762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.497s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:08 devstack cinder-volume[88189]: DEBUG cinder.manager [req-58e815eb-e74e-4a3e-b7f3-612821c67a25 req-5ada54a1-3ce5-42af-bd0d-fa8c73a65bbb tempest-VolumesSnapshotsTestJSON-59137762 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:48:08 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-58e815eb-e74e-4a3e-b7f3-612821c67a25 req-5ada54a1-3ce5-42af-bd0d-fa8c73a65bbb tempest-VolumesSnapshotsTestJSON-59137762 None] Deleted volume successfully. Sep 10 16:48:08 devstack cinder-volume[88189]: DEBUG cinder.coordination [req-58e815eb-e74e-4a3e-b7f3-612821c67a25 req-5ada54a1-3ce5-42af-bd0d-fa8c73a65bbb tempest-VolumesSnapshotsTestJSON-59137762 None] Lock "cinder-ec60b9a8-f21a-4ce5-8434-0dd6b9854f7a-delete_volume" released by "delete_volume" :: held 2.112s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:12 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dc8ac17b-0c5a-41d4-925e-73503bd730f0" returned: 0 in 6.234s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:12 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Image conversion details: src /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7, size 1024.00 MB, duration 6.23 sec, destination /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dc8ac17b-0c5a-41d4-925e-73503bd730f0 {{(pid=88189) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 16:48:12 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Converted 1024.00 MB image at 164.24 MB/s Sep 10 16:48:12 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dc8ac17b-0c5a-41d4-925e-73503bd730f0 is being set with open permissions: ugo+rw: NotImplementedError Sep 10 16:48:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dc8ac17b-0c5a-41d4-925e-73503bd730f0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:12 devstack sudo[100045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dc8ac17b-0c5a-41d4-925e-73503bd730f0 Sep 10 16:48:12 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:12 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dc8ac17b-0c5a-41d4-925e-73503bd730f0" returned: 0 in 0.352s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:12 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Lock "cinder-quobyte-dc8ac17b-0c5a-41d4-925e-73503bd730f0" released by "_copy_volume_from_snapshot" :: held 7.719s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:12 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Acquiring lock "cinder-quobyte-5029b7bd-9755-4a43-b73d-c1ad8d5943b2" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:12 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Lock "cinder-quobyte-5029b7bd-9755-4a43-b73d-c1ad8d5943b2" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:12 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Deleting offline snapshot 5029b7bd-9755-4a43-b73d-c1ad8d5943b2 of volume e02c4da8-6e31-410b-b317-472454e08ca7 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:48:12 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] snapshot_file for this snap is: volume-e02c4da8-6e31-410b-b317-472454e08ca7.5029b7bd-9755-4a43-b73d-c1ad8d5943b2 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:48:12 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef01782f-25f5-4130-8ae4-d33b518e31f5]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:48:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7.5029b7bd-9755-4a43-b73d-c1ad8d5943b2 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:13 devstack sudo[100048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7.5029b7bd-9755-4a43-b73d-c1ad8d5943b2 Sep 10 16:48:13 devstack sudo[100048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:13 devstack sudo[100048]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7.5029b7bd-9755-4a43-b73d-c1ad8d5943b2" returned: 0 in 0.498s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:13 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e02c4da8-6e31-410b-b317-472454e08ca7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:48:13 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c916fc84-67cd-41e9-8951-fa961d56c10e]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:48:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:13 devstack sudo[100053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7 Sep 10 16:48:13 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:14 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-90b219d9-4611-4caa-9b50-bc970376850a tempest-VolumesNegativeTest-725043388 None] Acquiring lock "cinder-c8721a81-0c29-4ae1-9ecf-416b7ff09405-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:14 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-90b219d9-4611-4caa-9b50-bc970376850a tempest-VolumesNegativeTest-725043388 None] Lock "cinder-c8721a81-0c29-4ae1-9ecf-416b7ff09405-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:14 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7" returned: 0 in 0.737s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7.5029b7bd-9755-4a43-b73d-c1ad8d5943b2 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:14 devstack sudo[100058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7.5029b7bd-9755-4a43-b73d-c1ad8d5943b2 Sep 10 16:48:14 devstack sudo[100058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:14 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-90b219d9-4611-4caa-9b50-bc970376850a tempest-VolumesNegativeTest-725043388 None] Acquiring lock "cinder-quobyte-c8721a81-0c29-4ae1-9ecf-416b7ff09405" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:14 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-90b219d9-4611-4caa-9b50-bc970376850a tempest-VolumesNegativeTest-725043388 None] Lock "cinder-quobyte-c8721a81-0c29-4ae1-9ecf-416b7ff09405" acquired by "delete_volume" :: waited 0.026s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:14 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c18db1-aafd-43d7-8c72-be441fa284f7]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:48:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-90b219d9-4611-4caa-9b50-bc970376850a tempest-VolumesNegativeTest-725043388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c8721a81-0c29-4ae1-9ecf-416b7ff09405 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:14 devstack sudo[100060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c8721a81-0c29-4ae1-9ecf-416b7ff09405 Sep 10 16:48:14 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:14 devstack sudo[100058]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7.5029b7bd-9755-4a43-b73d-c1ad8d5943b2" returned: 0 in 0.452s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7.5029b7bd-9755-4a43-b73d-c1ad8d5943b2 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:14 devstack sudo[100067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7.5029b7bd-9755-4a43-b73d-c1ad8d5943b2 Sep 10 16:48:14 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:14 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-90b219d9-4611-4caa-9b50-bc970376850a tempest-VolumesNegativeTest-725043388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c8721a81-0c29-4ae1-9ecf-416b7ff09405" returned: 0 in 0.439s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-90b219d9-4611-4caa-9b50-bc970376850a tempest-VolumesNegativeTest-725043388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c8721a81-0c29-4ae1-9ecf-416b7ff09405 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:14 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c8721a81-0c29-4ae1-9ecf-416b7ff09405 Sep 10 16:48:14 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:15 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7.5029b7bd-9755-4a43-b73d-c1ad8d5943b2" returned: 0 in 0.368s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:15 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Lock "cinder-quobyte-5029b7bd-9755-4a43-b73d-c1ad8d5943b2" released by "_delete_snapshot" :: held 2.216s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:15 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-90b219d9-4611-4caa-9b50-bc970376850a tempest-VolumesNegativeTest-725043388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c8721a81-0c29-4ae1-9ecf-416b7ff09405" returned: 0 in 0.338s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:15 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-90b219d9-4611-4caa-9b50-bc970376850a tempest-VolumesNegativeTest-725043388 None] Lock "cinder-quobyte-c8721a81-0c29-4ae1-9ecf-416b7ff09405" released by "delete_volume" :: held 0.827s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.631s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:15 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-90b219d9-4611-4caa-9b50-bc970376850a tempest-VolumesNegativeTest-725043388 None] Created reservations ['e3824e2b-17f1-49c1-8916-a218f0248ad1', '3535776c-3ac0-4bfc-8784-d572ef4d30f9', '151fb186-9a58-471d-b034-0f51d92f8b38', 'af81d8f4-a2c8-4bcb-9125-97fba824950c'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:48:15 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-dad1fcec-7a35-4ce5-a8fa-0eb894ece440 tempest-GroupsV314Test-796416885 None] Create group from source-group-dce9937d-92a8-400c-ad02-4bd5dda6521d completed successfully. Sep 10 16:48:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-90b219d9-4611-4caa-9b50-bc970376850a tempest-VolumesNegativeTest-725043388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-90b219d9-4611-4caa-9b50-bc970376850a tempest-VolumesNegativeTest-725043388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-90b219d9-4611-4caa-9b50-bc970376850a tempest-VolumesNegativeTest-725043388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:48:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-90b219d9-4611-4caa-9b50-bc970376850a tempest-VolumesNegativeTest-725043388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:48:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-90b219d9-4611-4caa-9b50-bc970376850a tempest-VolumesNegativeTest-725043388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-90b219d9-4611-4caa-9b50-bc970376850a tempest-VolumesNegativeTest-725043388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:15 devstack sudo[100075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:48:15 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:15 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-90b219d9-4611-4caa-9b50-bc970376850a tempest-VolumesNegativeTest-725043388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.286s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:15 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-90b219d9-4611-4caa-9b50-bc970376850a tempest-VolumesNegativeTest-725043388 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:48:15 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-90b219d9-4611-4caa-9b50-bc970376850a tempest-VolumesNegativeTest-725043388 None] Deleted volume successfully. Sep 10 16:48:15 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-90b219d9-4611-4caa-9b50-bc970376850a tempest-VolumesNegativeTest-725043388 None] Lock "cinder-c8721a81-0c29-4ae1-9ecf-416b7ff09405-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:15 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-476b2410-cfbe-43c4-8651-41a1de7156d5 tempest-VolumesSnapshotListTestJSON-332874068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-476b2410-cfbe-43c4-8651-41a1de7156d5 tempest-VolumesSnapshotListTestJSON-332874068 None] Flow 'volume_create_manager' (ea5ef480-8459-4285-9f35-0d5e2fa14bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-476b2410-cfbe-43c4-8651-41a1de7156d5 tempest-VolumesSnapshotListTestJSON-332874068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31b13540-a1a9-4d93-a7cf-720544904d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-476b2410-cfbe-43c4-8651-41a1de7156d5 tempest-VolumesSnapshotListTestJSON-332874068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31b13540-a1a9-4d93-a7cf-720544904d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1856423926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3a9893f-49d0-4cb4-a74c-690075884caf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54a3790448d440eca0672d973dddd903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:48:16Z,use_quota=True,user_id='d56e128a9db6454187f6e1e4be20cce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-476b2410-cfbe-43c4-8651-41a1de7156d5 tempest-VolumesSnapshotListTestJSON-332874068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78779fac-5cf2-4400-b124-6ebf62413de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-476b2410-cfbe-43c4-8651-41a1de7156d5 tempest-VolumesSnapshotListTestJSON-332874068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78779fac-5cf2-4400-b124-6ebf62413de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-476b2410-cfbe-43c4-8651-41a1de7156d5 tempest-VolumesSnapshotListTestJSON-332874068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa0a4375-ae53-4002-8a55-67a8e85d38d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-476b2410-cfbe-43c4-8651-41a1de7156d5 tempest-VolumesSnapshotListTestJSON-332874068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa0a4375-ae53-4002-8a55-67a8e85d38d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3a9893f-49d0-4cb4-a74c-690075884caf', 'volume_name': 'volume-b3a9893f-49d0-4cb4-a74c-690075884caf', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-476b2410-cfbe-43c4-8651-41a1de7156d5 tempest-VolumesSnapshotListTestJSON-332874068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba0d83c-f26c-4f18-8363-f1e2bb8ba3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-476b2410-cfbe-43c4-8651-41a1de7156d5 tempest-VolumesSnapshotListTestJSON-332874068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba0d83c-f26c-4f18-8363-f1e2bb8ba3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-476b2410-cfbe-43c4-8651-41a1de7156d5 tempest-VolumesSnapshotListTestJSON-332874068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b56f9025-c0db-4054-b8de-b9cb30d741b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:16 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-476b2410-cfbe-43c4-8651-41a1de7156d5 tempest-VolumesSnapshotListTestJSON-332874068 None] Volume b3a9893f-49d0-4cb4-a74c-690075884caf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3a9893f-49d0-4cb4-a74c-690075884caf', 'volume_size': 1} Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-476b2410-cfbe-43c4-8651-41a1de7156d5 tempest-VolumesSnapshotListTestJSON-332874068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-476b2410-cfbe-43c4-8651-41a1de7156d5 tempest-VolumesSnapshotListTestJSON-332874068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-476b2410-cfbe-43c4-8651-41a1de7156d5 tempest-VolumesSnapshotListTestJSON-332874068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1856423926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3a9893f-49d0-4cb4-a74c-690075884caf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54a3790448d440eca0672d973dddd903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:48:16Z,use_quota=True,user_id='d56e128a9db6454187f6e1e4be20cce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-476b2410-cfbe-43c4-8651-41a1de7156d5 tempest-VolumesSnapshotListTestJSON-332874068 None] Creating volume b3a9893f-49d0-4cb4-a74c-690075884caf {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-476b2410-cfbe-43c4-8651-41a1de7156d5 tempest-VolumesSnapshotListTestJSON-332874068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-476b2410-cfbe-43c4-8651-41a1de7156d5 tempest-VolumesSnapshotListTestJSON-332874068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-476b2410-cfbe-43c4-8651-41a1de7156d5 tempest-VolumesSnapshotListTestJSON-332874068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-476b2410-cfbe-43c4-8651-41a1de7156d5 tempest-VolumesSnapshotListTestJSON-332874068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-476b2410-cfbe-43c4-8651-41a1de7156d5 tempest-VolumesSnapshotListTestJSON-332874068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-476b2410-cfbe-43c4-8651-41a1de7156d5 tempest-VolumesSnapshotListTestJSON-332874068 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:48:16 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-476b2410-cfbe-43c4-8651-41a1de7156d5 tempest-VolumesSnapshotListTestJSON-332874068 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-476b2410-cfbe-43c4-8651-41a1de7156d5 tempest-VolumesSnapshotListTestJSON-332874068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:16 devstack sudo[100078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf 1073741824 Sep 10 16:48:16 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:16 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c75e76dd-61c0-4fae-9a00-8020a9b39dd5 tempest-GroupsV314Test-796416885 None] Acquiring lock "cinder-quobyte-dc8ac17b-0c5a-41d4-925e-73503bd730f0" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-476b2410-cfbe-43c4-8651-41a1de7156d5 tempest-VolumesSnapshotListTestJSON-332874068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf 1073741824" returned: 0 in 0.575s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c75e76dd-61c0-4fae-9a00-8020a9b39dd5 tempest-GroupsV314Test-796416885 None] Lock "cinder-quobyte-dc8ac17b-0c5a-41d4-925e-73503bd730f0" acquired by "delete_volume" :: waited 0.035s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[309cedd3-41e6-4155-b09d-6d5a4248afef]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c75e76dd-61c0-4fae-9a00-8020a9b39dd5 tempest-GroupsV314Test-796416885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dc8ac17b-0c5a-41d4-925e-73503bd730f0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-476b2410-cfbe-43c4-8651-41a1de7156d5 tempest-VolumesSnapshotListTestJSON-332874068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:16 devstack sudo[100085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf Sep 10 16:48:16 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [req-0e56911e-be41-42b6-8a8e-24dd1763eb92 req-93bf342a-e013-415f-8503-7b53b1ca617b tempest-VolumesGetTestJSON-983942127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-0e56911e-be41-42b6-8a8e-24dd1763eb92 req-93bf342a-e013-415f-8503-7b53b1ca617b tempest-VolumesGetTestJSON-983942127 None] Flow 'volume_create_manager' (aa3454cc-4f18-4afb-b9e9-f3b8854869b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-0e56911e-be41-42b6-8a8e-24dd1763eb92 req-93bf342a-e013-415f-8503-7b53b1ca617b tempest-VolumesGetTestJSON-983942127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d4b94cc-7c8a-41ca-84f7-f4e6c40c0917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-0e56911e-be41-42b6-8a8e-24dd1763eb92 req-93bf342a-e013-415f-8503-7b53b1ca617b tempest-VolumesGetTestJSON-983942127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d4b94cc-7c8a-41ca-84f7-f4e6c40c0917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1973799221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ea875bc-0351-4e4d-9f7d-24dfc1d0fb90,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='248ac465fa024e6ea30672a8c1ec4c9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:48:17Z,use_quota=True,user_id='ccbbcdccf0924af7a1afc9a331e8aeb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-0e56911e-be41-42b6-8a8e-24dd1763eb92 req-93bf342a-e013-415f-8503-7b53b1ca617b tempest-VolumesGetTestJSON-983942127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0178bf6-d172-4eb7-8c92-facaa909b9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-0e56911e-be41-42b6-8a8e-24dd1763eb92 req-93bf342a-e013-415f-8503-7b53b1ca617b tempest-VolumesGetTestJSON-983942127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0178bf6-d172-4eb7-8c92-facaa909b9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-0e56911e-be41-42b6-8a8e-24dd1763eb92 req-93bf342a-e013-415f-8503-7b53b1ca617b tempest-VolumesGetTestJSON-983942127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (793c3eb5-aef0-4cb3-99a3-29ada91fba8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-0e56911e-be41-42b6-8a8e-24dd1763eb92 req-93bf342a-e013-415f-8503-7b53b1ca617b tempest-VolumesGetTestJSON-983942127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (793c3eb5-aef0-4cb3-99a3-29ada91fba8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ea875bc-0351-4e4d-9f7d-24dfc1d0fb90', 'volume_name': 'volume-7ea875bc-0351-4e4d-9f7d-24dfc1d0fb90', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:16 devstack sudo[100084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dc8ac17b-0c5a-41d4-925e-73503bd730f0 Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-0e56911e-be41-42b6-8a8e-24dd1763eb92 req-93bf342a-e013-415f-8503-7b53b1ca617b tempest-VolumesGetTestJSON-983942127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25f34fb8-6608-4f83-8dd7-b4d2d4b2c110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:16 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-0e56911e-be41-42b6-8a8e-24dd1763eb92 req-93bf342a-e013-415f-8503-7b53b1ca617b tempest-VolumesGetTestJSON-983942127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25f34fb8-6608-4f83-8dd7-b4d2d4b2c110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-0e56911e-be41-42b6-8a8e-24dd1763eb92 req-93bf342a-e013-415f-8503-7b53b1ca617b tempest-VolumesGetTestJSON-983942127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c81a0d06-7a18-4873-b922-a2c0f82f39ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:16 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [req-0e56911e-be41-42b6-8a8e-24dd1763eb92 req-93bf342a-e013-415f-8503-7b53b1ca617b tempest-VolumesGetTestJSON-983942127 None] Volume 7ea875bc-0351-4e4d-9f7d-24dfc1d0fb90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ea875bc-0351-4e4d-9f7d-24dfc1d0fb90', 'volume_size': 1} Sep 10 16:48:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-0e56911e-be41-42b6-8a8e-24dd1763eb92 req-93bf342a-e013-415f-8503-7b53b1ca617b tempest-VolumesGetTestJSON-983942127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:17 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-476b2410-cfbe-43c4-8651-41a1de7156d5 tempest-VolumesSnapshotListTestJSON-332874068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf" returned: 0 in 0.313s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-476b2410-cfbe-43c4-8651-41a1de7156d5 tempest-VolumesSnapshotListTestJSON-332874068 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:48:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-476b2410-cfbe-43c4-8651-41a1de7156d5 tempest-VolumesSnapshotListTestJSON-332874068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-0e56911e-be41-42b6-8a8e-24dd1763eb92 req-93bf342a-e013-415f-8503-7b53b1ca617b tempest-VolumesGetTestJSON-983942127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.157s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [req-0e56911e-be41-42b6-8a8e-24dd1763eb92 req-93bf342a-e013-415f-8503-7b53b1ca617b tempest-VolumesGetTestJSON-983942127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1973799221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ea875bc-0351-4e4d-9f7d-24dfc1d0fb90,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='248ac465fa024e6ea30672a8c1ec4c9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:48:17Z,use_quota=True,user_id='ccbbcdccf0924af7a1afc9a331e8aeb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:48:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [req-0e56911e-be41-42b6-8a8e-24dd1763eb92 req-93bf342a-e013-415f-8503-7b53b1ca617b tempest-VolumesGetTestJSON-983942127 None] Creating volume 7ea875bc-0351-4e4d-9f7d-24dfc1d0fb90 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:48:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-0e56911e-be41-42b6-8a8e-24dd1763eb92 req-93bf342a-e013-415f-8503-7b53b1ca617b tempest-VolumesGetTestJSON-983942127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-0e56911e-be41-42b6-8a8e-24dd1763eb92 req-93bf342a-e013-415f-8503-7b53b1ca617b tempest-VolumesGetTestJSON-983942127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [req-0e56911e-be41-42b6-8a8e-24dd1763eb92 req-93bf342a-e013-415f-8503-7b53b1ca617b tempest-VolumesGetTestJSON-983942127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:48:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [req-0e56911e-be41-42b6-8a8e-24dd1763eb92 req-93bf342a-e013-415f-8503-7b53b1ca617b tempest-VolumesGetTestJSON-983942127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:48:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-0e56911e-be41-42b6-8a8e-24dd1763eb92 req-93bf342a-e013-415f-8503-7b53b1ca617b tempest-VolumesGetTestJSON-983942127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [req-0e56911e-be41-42b6-8a8e-24dd1763eb92 req-93bf342a-e013-415f-8503-7b53b1ca617b tempest-VolumesGetTestJSON-983942127 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:48:17 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [req-0e56911e-be41-42b6-8a8e-24dd1763eb92 req-93bf342a-e013-415f-8503-7b53b1ca617b tempest-VolumesGetTestJSON-983942127 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:48:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-0e56911e-be41-42b6-8a8e-24dd1763eb92 req-93bf342a-e013-415f-8503-7b53b1ca617b tempest-VolumesGetTestJSON-983942127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7ea875bc-0351-4e4d-9f7d-24dfc1d0fb90 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-476b2410-cfbe-43c4-8651-41a1de7156d5 tempest-VolumesSnapshotListTestJSON-332874068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b56f9025-c0db-4054-b8de-b9cb30d741b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3a9893f-49d0-4cb4-a74c-690075884caf', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:17 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7ea875bc-0351-4e4d-9f7d-24dfc1d0fb90 1073741824 Sep 10 16:48:17 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-476b2410-cfbe-43c4-8651-41a1de7156d5 tempest-VolumesSnapshotListTestJSON-332874068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb25bd9d-d526-4d03-8cd3-abef55ff1535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:17 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-476b2410-cfbe-43c4-8651-41a1de7156d5 tempest-VolumesSnapshotListTestJSON-332874068 None] Volume volume-b3a9893f-49d0-4cb4-a74c-690075884caf (b3a9893f-49d0-4cb4-a74c-690075884caf): created successfully Sep 10 16:48:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-476b2410-cfbe-43c4-8651-41a1de7156d5 tempest-VolumesSnapshotListTestJSON-332874068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb25bd9d-d526-4d03-8cd3-abef55ff1535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-476b2410-cfbe-43c4-8651-41a1de7156d5 tempest-VolumesSnapshotListTestJSON-332874068 None] Flow 'volume_create_manager' (ea5ef480-8459-4285-9f35-0d5e2fa14bc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:48:17 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-476b2410-cfbe-43c4-8651-41a1de7156d5 tempest-VolumesSnapshotListTestJSON-332874068 None] Created volume successfully. Sep 10 16:48:17 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c75e76dd-61c0-4fae-9a00-8020a9b39dd5 tempest-GroupsV314Test-796416885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dc8ac17b-0c5a-41d4-925e-73503bd730f0" returned: 0 in 0.476s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c75e76dd-61c0-4fae-9a00-8020a9b39dd5 tempest-GroupsV314Test-796416885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dc8ac17b-0c5a-41d4-925e-73503bd730f0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:17 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dc8ac17b-0c5a-41d4-925e-73503bd730f0 Sep 10 16:48:17 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:17 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c75e76dd-61c0-4fae-9a00-8020a9b39dd5 tempest-GroupsV314Test-796416885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dc8ac17b-0c5a-41d4-925e-73503bd730f0" returned: 0 in 0.286s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:17 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c75e76dd-61c0-4fae-9a00-8020a9b39dd5 tempest-GroupsV314Test-796416885 None] Lock "cinder-quobyte-dc8ac17b-0c5a-41d4-925e-73503bd730f0" released by "delete_volume" :: held 0.849s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:17 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:17 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-c75e76dd-61c0-4fae-9a00-8020a9b39dd5 tempest-GroupsV314Test-796416885 None] Created reservations ['8da62a02-e812-4c69-800a-bd178a6426a5'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:48:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-0e56911e-be41-42b6-8a8e-24dd1763eb92 req-93bf342a-e013-415f-8503-7b53b1ca617b tempest-VolumesGetTestJSON-983942127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7ea875bc-0351-4e4d-9f7d-24dfc1d0fb90 1073741824" returned: 0 in 0.491s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-0e56911e-be41-42b6-8a8e-24dd1763eb92 req-93bf342a-e013-415f-8503-7b53b1ca617b tempest-VolumesGetTestJSON-983942127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7ea875bc-0351-4e4d-9f7d-24dfc1d0fb90 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:17 devstack cinder-volume[88189]: WARNING cinder.quota [None req-c75e76dd-61c0-4fae-9a00-8020a9b39dd5 tempest-GroupsV314Test-796416885 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1084254261 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1084254261, it is now deprecated. Please use the default quota class for default quota. Sep 10 16:48:17 devstack cinder-volume[88189]: WARNING cinder.quota [None req-c75e76dd-61c0-4fae-9a00-8020a9b39dd5 tempest-GroupsV314Test-796416885 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1084254261 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1084254261, it is now deprecated. Please use the default quota class for default quota. Sep 10 16:48:17 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=91,cinder:INSERT=28,cinder:UPDATE=106,cinder:DELETE=5 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:48:17 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7ea875bc-0351-4e4d-9f7d-24dfc1d0fb90 Sep 10 16:48:17 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:17 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-c75e76dd-61c0-4fae-9a00-8020a9b39dd5 tempest-GroupsV314Test-796416885 None] Created reservations ['24a84630-1256-44ba-a05e-a20583cbad9a', '4ffd9597-49db-47f1-944d-1fba95e68922', 'c3131180-6439-413a-8b7c-9a4abcf5226f', '88210cc4-3d6f-4fef-8d46-db045f2f7ba6'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:48:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c75e76dd-61c0-4fae-9a00-8020a9b39dd5 tempest-GroupsV314Test-796416885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c75e76dd-61c0-4fae-9a00-8020a9b39dd5 tempest-GroupsV314Test-796416885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c75e76dd-61c0-4fae-9a00-8020a9b39dd5 tempest-GroupsV314Test-796416885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:48:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c75e76dd-61c0-4fae-9a00-8020a9b39dd5 tempest-GroupsV314Test-796416885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:48:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c75e76dd-61c0-4fae-9a00-8020a9b39dd5 tempest-GroupsV314Test-796416885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c75e76dd-61c0-4fae-9a00-8020a9b39dd5 tempest-GroupsV314Test-796416885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:17 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:48:17 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:18 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-0e56911e-be41-42b6-8a8e-24dd1763eb92 req-93bf342a-e013-415f-8503-7b53b1ca617b tempest-VolumesGetTestJSON-983942127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7ea875bc-0351-4e4d-9f7d-24dfc1d0fb90" returned: 0 in 0.370s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:18 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [req-0e56911e-be41-42b6-8a8e-24dd1763eb92 req-93bf342a-e013-415f-8503-7b53b1ca617b tempest-VolumesGetTestJSON-983942127 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:48:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-0e56911e-be41-42b6-8a8e-24dd1763eb92 req-93bf342a-e013-415f-8503-7b53b1ca617b tempest-VolumesGetTestJSON-983942127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-0e56911e-be41-42b6-8a8e-24dd1763eb92 req-93bf342a-e013-415f-8503-7b53b1ca617b tempest-VolumesGetTestJSON-983942127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c81a0d06-7a18-4873-b922-a2c0f82f39ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ea875bc-0351-4e4d-9f7d-24dfc1d0fb90', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-0e56911e-be41-42b6-8a8e-24dd1763eb92 req-93bf342a-e013-415f-8503-7b53b1ca617b tempest-VolumesGetTestJSON-983942127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e65ff79-e9bc-4176-a315-3b545e8614ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:18 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:UPDATE=106,cinder:SELECT=76,cinder:INSERT=25,cinder:DELETE=7 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:48:18 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [req-0e56911e-be41-42b6-8a8e-24dd1763eb92 req-93bf342a-e013-415f-8503-7b53b1ca617b tempest-VolumesGetTestJSON-983942127 None] Volume volume-7ea875bc-0351-4e4d-9f7d-24dfc1d0fb90 (7ea875bc-0351-4e4d-9f7d-24dfc1d0fb90): created successfully Sep 10 16:48:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-0e56911e-be41-42b6-8a8e-24dd1763eb92 req-93bf342a-e013-415f-8503-7b53b1ca617b tempest-VolumesGetTestJSON-983942127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e65ff79-e9bc-4176-a315-3b545e8614ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-0e56911e-be41-42b6-8a8e-24dd1763eb92 req-93bf342a-e013-415f-8503-7b53b1ca617b tempest-VolumesGetTestJSON-983942127 None] Flow 'volume_create_manager' (aa3454cc-4f18-4afb-b9e9-f3b8854869b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:48:18 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-0e56911e-be41-42b6-8a8e-24dd1763eb92 req-93bf342a-e013-415f-8503-7b53b1ca617b tempest-VolumesGetTestJSON-983942127 None] Created volume successfully. Sep 10 16:48:18 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c75e76dd-61c0-4fae-9a00-8020a9b39dd5 tempest-GroupsV314Test-796416885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.391s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:18 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-c75e76dd-61c0-4fae-9a00-8020a9b39dd5 tempest-GroupsV314Test-796416885 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:48:18 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-c75e76dd-61c0-4fae-9a00-8020a9b39dd5 tempest-GroupsV314Test-796416885 None] Delete group completed successfully. Sep 10 16:48:18 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d9de870a-7953-4a8b-956a-c5481f9843f6 tempest-GroupsV314Test-796416885 None] Acquiring lock "cinder-quobyte-e02c4da8-6e31-410b-b317-472454e08ca7" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:18 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d9de870a-7953-4a8b-956a-c5481f9843f6 tempest-GroupsV314Test-796416885 None] Lock "cinder-quobyte-e02c4da8-6e31-410b-b317-472454e08ca7" acquired by "delete_volume" :: waited 0.028s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:18 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9624c87-5f06-4610-8f2e-51489cdf75fd]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:48:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d9de870a-7953-4a8b-956a-c5481f9843f6 tempest-GroupsV314Test-796416885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-088cc4ee-4603-4945-ac31-d9e712a718d7 tempest-VolumesSnapshotListTestJSON-332874068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-088cc4ee-4603-4945-ac31-d9e712a718d7 tempest-VolumesSnapshotListTestJSON-332874068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:18 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-088cc4ee-4603-4945-ac31-d9e712a718d7 tempest-VolumesSnapshotListTestJSON-332874068 None] Creating offline snapshot eea15253-4cae-4b98-86bc-5d904903494f of volume b3a9893f-49d0-4cb4-a74c-690075884caf {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:48:18 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4896ac99-cefd-4867-ac34-8da17d60068c]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:48:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-088cc4ee-4603-4945-ac31-d9e712a718d7 tempest-VolumesSnapshotListTestJSON-332874068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:18 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7 Sep 10 16:48:18 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:18 devstack cinder-volume[88189]: DEBUG cinder.coordination [req-fcc4b619-937c-4c03-83b8-e39fc7f59c01 req-550adbdf-5d58-4e06-af60-1f4d91180270 tempest-VolumesGetTestJSON-983942127 None] Acquiring lock "cinder-7ea875bc-0351-4e4d-9f7d-24dfc1d0fb90-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:18 devstack cinder-volume[88189]: DEBUG cinder.coordination [req-fcc4b619-937c-4c03-83b8-e39fc7f59c01 req-550adbdf-5d58-4e06-af60-1f4d91180270 tempest-VolumesGetTestJSON-983942127 None] Lock "cinder-7ea875bc-0351-4e4d-9f7d-24dfc1d0fb90-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:18 devstack cinder-volume[88189]: DEBUG cinder.coordination [req-fcc4b619-937c-4c03-83b8-e39fc7f59c01 req-550adbdf-5d58-4e06-af60-1f4d91180270 tempest-VolumesGetTestJSON-983942127 None] Acquiring lock "cinder-quobyte-7ea875bc-0351-4e4d-9f7d-24dfc1d0fb90" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:18 devstack cinder-volume[88189]: DEBUG cinder.coordination [req-fcc4b619-937c-4c03-83b8-e39fc7f59c01 req-550adbdf-5d58-4e06-af60-1f4d91180270 tempest-VolumesGetTestJSON-983942127 None] Lock "cinder-quobyte-7ea875bc-0351-4e4d-9f7d-24dfc1d0fb90" acquired by "delete_volume" :: waited 0.025s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:18 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ad59d5-9161-49cf-b272-ae21fcad4122]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:48:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-fcc4b619-937c-4c03-83b8-e39fc7f59c01 req-550adbdf-5d58-4e06-af60-1f4d91180270 tempest-VolumesGetTestJSON-983942127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7ea875bc-0351-4e4d-9f7d-24dfc1d0fb90 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:18 devstack sudo[100108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf Sep 10 16:48:18 devstack sudo[100108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:19 devstack sudo[100110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7ea875bc-0351-4e4d-9f7d-24dfc1d0fb90 Sep 10 16:48:19 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:19 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d9de870a-7953-4a8b-956a-c5481f9843f6 tempest-GroupsV314Test-796416885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7" returned: 0 in 0.560s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d9de870a-7953-4a8b-956a-c5481f9843f6 tempest-GroupsV314Test-796416885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:19 devstack sudo[100116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7 Sep 10 16:48:19 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:19 devstack sudo[100108]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-088cc4ee-4603-4945-ac31-d9e712a718d7 tempest-VolumesSnapshotListTestJSON-332874068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf" returned: 0 in 0.570s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-088cc4ee-4603-4945-ac31-d9e712a718d7 tempest-VolumesSnapshotListTestJSON-332874068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.eea15253-4cae-4b98-86bc-5d904903494f 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:19 devstack sudo[100123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.eea15253-4cae-4b98-86bc-5d904903494f 1G Sep 10 16:48:19 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:19 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-fcc4b619-937c-4c03-83b8-e39fc7f59c01 req-550adbdf-5d58-4e06-af60-1f4d91180270 tempest-VolumesGetTestJSON-983942127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7ea875bc-0351-4e4d-9f7d-24dfc1d0fb90" returned: 0 in 0.514s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-fcc4b619-937c-4c03-83b8-e39fc7f59c01 req-550adbdf-5d58-4e06-af60-1f4d91180270 tempest-VolumesGetTestJSON-983942127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7ea875bc-0351-4e4d-9f7d-24dfc1d0fb90 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:19 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d9de870a-7953-4a8b-956a-c5481f9843f6 tempest-GroupsV314Test-796416885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e02c4da8-6e31-410b-b317-472454e08ca7" returned: 0 in 0.343s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:19 devstack sudo[100127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7ea875bc-0351-4e4d-9f7d-24dfc1d0fb90 Sep 10 16:48:19 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:19 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d9de870a-7953-4a8b-956a-c5481f9843f6 tempest-GroupsV314Test-796416885 None] Lock "cinder-quobyte-e02c4da8-6e31-410b-b317-472454e08ca7" released by "delete_volume" :: held 1.014s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:19 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-d9de870a-7953-4a8b-956a-c5481f9843f6 tempest-GroupsV314Test-796416885 None] Created reservations ['892da966-b43e-4a74-872c-56f3f2328d7a'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:48:19 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-d9de870a-7953-4a8b-956a-c5481f9843f6 tempest-GroupsV314Test-796416885 None] Created reservations ['f6616165-d4d6-4250-b708-70d9509a5f85', '45f49675-13ab-4ca8-be6f-f72debeb67bb', 'a33c5e24-2dae-4c02-af49-7faec9bb4541', 'eb88e6c6-6c33-439e-aff7-f19d892f472f'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:48:19 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-fcc4b619-937c-4c03-83b8-e39fc7f59c01 req-550adbdf-5d58-4e06-af60-1f4d91180270 tempest-VolumesGetTestJSON-983942127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7ea875bc-0351-4e4d-9f7d-24dfc1d0fb90" returned: 0 in 0.295s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:19 devstack cinder-volume[88189]: DEBUG cinder.coordination [req-fcc4b619-937c-4c03-83b8-e39fc7f59c01 req-550adbdf-5d58-4e06-af60-1f4d91180270 tempest-VolumesGetTestJSON-983942127 None] Lock "cinder-quobyte-7ea875bc-0351-4e4d-9f7d-24dfc1d0fb90" released by "delete_volume" :: held 0.878s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d9de870a-7953-4a8b-956a-c5481f9843f6 tempest-GroupsV314Test-796416885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d9de870a-7953-4a8b-956a-c5481f9843f6 tempest-GroupsV314Test-796416885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:19 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d9de870a-7953-4a8b-956a-c5481f9843f6 tempest-GroupsV314Test-796416885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:48:19 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d9de870a-7953-4a8b-956a-c5481f9843f6 tempest-GroupsV314Test-796416885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:48:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d9de870a-7953-4a8b-956a-c5481f9843f6 tempest-GroupsV314Test-796416885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d9de870a-7953-4a8b-956a-c5481f9843f6 tempest-GroupsV314Test-796416885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:19 devstack cinder-volume[88189]: DEBUG cinder.quota [req-fcc4b619-937c-4c03-83b8-e39fc7f59c01 req-550adbdf-5d58-4e06-af60-1f4d91180270 tempest-VolumesGetTestJSON-983942127 None] Created reservations ['37ee4c26-db17-48f8-b25f-b2c1750eccd7', '16954529-aed3-473b-9dde-1af56f0d9434', 'cad652a0-c78d-4029-b7f4-e6121953e7a0', '5774838a-92b2-48ab-a2ef-29471df2c9cb'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:48:19 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:48:19 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:19 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-088cc4ee-4603-4945-ac31-d9e712a718d7 tempest-VolumesSnapshotListTestJSON-332874068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.eea15253-4cae-4b98-86bc-5d904903494f 1G" returned: 0 in 0.694s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-088cc4ee-4603-4945-ac31-d9e712a718d7 tempest-VolumesSnapshotListTestJSON-332874068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3a9893f-49d0-4cb4-a74c-690075884caf -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.eea15253-4cae-4b98-86bc-5d904903494f {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-fcc4b619-937c-4c03-83b8-e39fc7f59c01 req-550adbdf-5d58-4e06-af60-1f4d91180270 tempest-VolumesGetTestJSON-983942127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-fcc4b619-937c-4c03-83b8-e39fc7f59c01 req-550adbdf-5d58-4e06-af60-1f4d91180270 tempest-VolumesGetTestJSON-983942127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:20 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [req-fcc4b619-937c-4c03-83b8-e39fc7f59c01 req-550adbdf-5d58-4e06-af60-1f4d91180270 tempest-VolumesGetTestJSON-983942127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:48:20 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [req-fcc4b619-937c-4c03-83b8-e39fc7f59c01 req-550adbdf-5d58-4e06-af60-1f4d91180270 tempest-VolumesGetTestJSON-983942127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:48:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-fcc4b619-937c-4c03-83b8-e39fc7f59c01 req-550adbdf-5d58-4e06-af60-1f4d91180270 tempest-VolumesGetTestJSON-983942127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-fcc4b619-937c-4c03-83b8-e39fc7f59c01 req-550adbdf-5d58-4e06-af60-1f4d91180270 tempest-VolumesGetTestJSON-983942127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:20 devstack sudo[100136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3a9893f-49d0-4cb4-a74c-690075884caf -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.eea15253-4cae-4b98-86bc-5d904903494f Sep 10 16:48:20 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:20 devstack sudo[100138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:48:20 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:20 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d9de870a-7953-4a8b-956a-c5481f9843f6 tempest-GroupsV314Test-796416885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.424s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:20 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-d9de870a-7953-4a8b-956a-c5481f9843f6 tempest-GroupsV314Test-796416885 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:48:20 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-d9de870a-7953-4a8b-956a-c5481f9843f6 tempest-GroupsV314Test-796416885 None] Delete group completed successfully. Sep 10 16:48:20 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-fcc4b619-937c-4c03-83b8-e39fc7f59c01 req-550adbdf-5d58-4e06-af60-1f4d91180270 tempest-VolumesGetTestJSON-983942127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.341s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:20 devstack cinder-volume[88189]: DEBUG cinder.manager [req-fcc4b619-937c-4c03-83b8-e39fc7f59c01 req-550adbdf-5d58-4e06-af60-1f4d91180270 tempest-VolumesGetTestJSON-983942127 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:48:20 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-fcc4b619-937c-4c03-83b8-e39fc7f59c01 req-550adbdf-5d58-4e06-af60-1f4d91180270 tempest-VolumesGetTestJSON-983942127 None] Deleted volume successfully. Sep 10 16:48:20 devstack cinder-volume[88189]: DEBUG cinder.coordination [req-fcc4b619-937c-4c03-83b8-e39fc7f59c01 req-550adbdf-5d58-4e06-af60-1f4d91180270 tempest-VolumesGetTestJSON-983942127 None] Lock "cinder-7ea875bc-0351-4e4d-9f7d-24dfc1d0fb90-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:20 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-088cc4ee-4603-4945-ac31-d9e712a718d7 tempest-VolumesSnapshotListTestJSON-332874068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3a9893f-49d0-4cb4-a74c-690075884caf -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.eea15253-4cae-4b98-86bc-5d904903494f" returned: 0 in 0.425s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:20 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-088cc4ee-4603-4945-ac31-d9e712a718d7 tempest-VolumesSnapshotListTestJSON-332874068 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.eea15253-4cae-4b98-86bc-5d904903494f is being set with open permissions: ugo+rw Sep 10 16:48:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-088cc4ee-4603-4945-ac31-d9e712a718d7 tempest-VolumesSnapshotListTestJSON-332874068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.eea15253-4cae-4b98-86bc-5d904903494f {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:20 devstack sudo[100146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.eea15253-4cae-4b98-86bc-5d904903494f Sep 10 16:48:20 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:20 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-088cc4ee-4603-4945-ac31-d9e712a718d7 tempest-VolumesSnapshotListTestJSON-332874068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.eea15253-4cae-4b98-86bc-5d904903494f" returned: 0 in 0.271s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-088cc4ee-4603-4945-ac31-d9e712a718d7 tempest-VolumesSnapshotListTestJSON-332874068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:20 devstack sudo[100149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.info Sep 10 16:48:20 devstack sudo[100149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:21 devstack sudo[100149]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-088cc4ee-4603-4945-ac31-d9e712a718d7 tempest-VolumesSnapshotListTestJSON-332874068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.info" returned: 0 in 0.324s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:21 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-088cc4ee-4603-4945-ac31-d9e712a718d7 tempest-VolumesSnapshotListTestJSON-332874068 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.info is being set with open permissions: ugo+rw Sep 10 16:48:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-088cc4ee-4603-4945-ac31-d9e712a718d7 tempest-VolumesSnapshotListTestJSON-332874068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:21 devstack sudo[100152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.info Sep 10 16:48:21 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:21 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-088cc4ee-4603-4945-ac31-d9e712a718d7 tempest-VolumesSnapshotListTestJSON-332874068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.info" returned: 0 in 0.377s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-088cc4ee-4603-4945-ac31-d9e712a718d7 tempest-VolumesSnapshotListTestJSON-332874068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.782s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:21 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-088cc4ee-4603-4945-ac31-d9e712a718d7 tempest-VolumesSnapshotListTestJSON-332874068 None] Create snapshot completed successfully Sep 10 16:48:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-fe46d377-b05f-4fae-86b5-0a39d80a0ced tempest-VolumesSnapshotListTestJSON-332874068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-fe46d377-b05f-4fae-86b5-0a39d80a0ced tempest-VolumesSnapshotListTestJSON-332874068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:22 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-fe46d377-b05f-4fae-86b5-0a39d80a0ced tempest-VolumesSnapshotListTestJSON-332874068 None] Creating offline snapshot b785f92d-3f55-4ca2-9772-5a2c36e0e4fb of volume b3a9893f-49d0-4cb4-a74c-690075884caf {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:48:22 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ceae09a-280d-45bf-80aa-35f466b8bac1]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:48:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fe46d377-b05f-4fae-86b5-0a39d80a0ced tempest-VolumesSnapshotListTestJSON-332874068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.eea15253-4cae-4b98-86bc-5d904903494f {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:22 devstack sudo[100155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.eea15253-4cae-4b98-86bc-5d904903494f Sep 10 16:48:22 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:22 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fe46d377-b05f-4fae-86b5-0a39d80a0ced tempest-VolumesSnapshotListTestJSON-332874068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.eea15253-4cae-4b98-86bc-5d904903494f" returned: 0 in 0.473s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:22 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-fe46d377-b05f-4fae-86b5-0a39d80a0ced tempest-VolumesSnapshotListTestJSON-332874068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3a9893f-49d0-4cb4-a74c-690075884caf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:48:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fe46d377-b05f-4fae-86b5-0a39d80a0ced tempest-VolumesSnapshotListTestJSON-332874068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.eea15253-4cae-4b98-86bc-5d904903494f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.b785f92d-3f55-4ca2-9772-5a2c36e0e4fb 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:22 devstack sudo[100163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.eea15253-4cae-4b98-86bc-5d904903494f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.b785f92d-3f55-4ca2-9772-5a2c36e0e4fb 1G Sep 10 16:48:22 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:23 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fe46d377-b05f-4fae-86b5-0a39d80a0ced tempest-VolumesSnapshotListTestJSON-332874068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.eea15253-4cae-4b98-86bc-5d904903494f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.b785f92d-3f55-4ca2-9772-5a2c36e0e4fb 1G" returned: 0 in 0.709s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fe46d377-b05f-4fae-86b5-0a39d80a0ced tempest-VolumesSnapshotListTestJSON-332874068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3a9893f-49d0-4cb4-a74c-690075884caf.eea15253-4cae-4b98-86bc-5d904903494f -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.b785f92d-3f55-4ca2-9772-5a2c36e0e4fb {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:23 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3a9893f-49d0-4cb4-a74c-690075884caf.eea15253-4cae-4b98-86bc-5d904903494f -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.b785f92d-3f55-4ca2-9772-5a2c36e0e4fb Sep 10 16:48:23 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:23 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fe46d377-b05f-4fae-86b5-0a39d80a0ced tempest-VolumesSnapshotListTestJSON-332874068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3a9893f-49d0-4cb4-a74c-690075884caf.eea15253-4cae-4b98-86bc-5d904903494f -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.b785f92d-3f55-4ca2-9772-5a2c36e0e4fb" returned: 0 in 0.402s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:23 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-fe46d377-b05f-4fae-86b5-0a39d80a0ced tempest-VolumesSnapshotListTestJSON-332874068 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.b785f92d-3f55-4ca2-9772-5a2c36e0e4fb is being set with open permissions: ugo+rw Sep 10 16:48:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fe46d377-b05f-4fae-86b5-0a39d80a0ced tempest-VolumesSnapshotListTestJSON-332874068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.b785f92d-3f55-4ca2-9772-5a2c36e0e4fb {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:23 devstack sudo[100175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.b785f92d-3f55-4ca2-9772-5a2c36e0e4fb Sep 10 16:48:23 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:24 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fe46d377-b05f-4fae-86b5-0a39d80a0ced tempest-VolumesSnapshotListTestJSON-332874068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.b785f92d-3f55-4ca2-9772-5a2c36e0e4fb" returned: 0 in 0.326s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-fe46d377-b05f-4fae-86b5-0a39d80a0ced tempest-VolumesSnapshotListTestJSON-332874068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.079s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:24 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-fe46d377-b05f-4fae-86b5-0a39d80a0ced tempest-VolumesSnapshotListTestJSON-332874068 None] Create snapshot completed successfully Sep 10 16:48:25 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcce1de5-bf45-46cd-8991-8333360c381d tempest-VolumesTestJSON-1885034036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:48:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-dcce1de5-bf45-46cd-8991-8333360c381d tempest-VolumesTestJSON-1885034036 None] Flow 'volume_create_manager' (f201302a-5e5c-4c29-8a0f-b9cb905508a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:48:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-dcce1de5-bf45-46cd-8991-8333360c381d tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42966604-a4db-4f8f-b159-1cba730b85b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-dcce1de5-bf45-46cd-8991-8333360c381d tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42966604-a4db-4f8f-b159-1cba730b85b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-225989930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d90ecbf9-345c-477d-a8a1-b123595c2925,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='94bf3c6766ac4d4bb957a64e82503a0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:48:25Z,use_quota=True,user_id='95c4f5eb90ae46afb0f6b27996e43d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-dcce1de5-bf45-46cd-8991-8333360c381d tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (716b1d29-e8e2-4751-9d94-05a3861eeb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-dcce1de5-bf45-46cd-8991-8333360c381d tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (716b1d29-e8e2-4751-9d94-05a3861eeb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-dcce1de5-bf45-46cd-8991-8333360c381d tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de1c538b-1af0-4643-b3d9-8fd2826a4332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-dcce1de5-bf45-46cd-8991-8333360c381d tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de1c538b-1af0-4643-b3d9-8fd2826a4332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd90ecbf9-345c-477d-a8a1-b123595c2925', 'volume_name': 'volume-d90ecbf9-345c-477d-a8a1-b123595c2925', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-dcce1de5-bf45-46cd-8991-8333360c381d tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c4bdd6-6402-4270-a105-d48a6dd0de32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-dcce1de5-bf45-46cd-8991-8333360c381d tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c4bdd6-6402-4270-a105-d48a6dd0de32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-dcce1de5-bf45-46cd-8991-8333360c381d tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b6ec52-b9fd-4124-9608-7e9a8decbb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:25 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-dcce1de5-bf45-46cd-8991-8333360c381d tempest-VolumesTestJSON-1885034036 None] Volume d90ecbf9-345c-477d-a8a1-b123595c2925: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d90ecbf9-345c-477d-a8a1-b123595c2925', 'volume_size': 1} Sep 10 16:48:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-dcce1de5-bf45-46cd-8991-8333360c381d tempest-VolumesTestJSON-1885034036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-dcce1de5-bf45-46cd-8991-8333360c381d tempest-VolumesTestJSON-1885034036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-dcce1de5-bf45-46cd-8991-8333360c381d tempest-VolumesTestJSON-1885034036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-225989930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d90ecbf9-345c-477d-a8a1-b123595c2925,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='94bf3c6766ac4d4bb957a64e82503a0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:48:25Z,use_quota=True,user_id='95c4f5eb90ae46afb0f6b27996e43d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:48:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-dcce1de5-bf45-46cd-8991-8333360c381d tempest-VolumesTestJSON-1885034036 None] Creating volume d90ecbf9-345c-477d-a8a1-b123595c2925 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:48:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-dcce1de5-bf45-46cd-8991-8333360c381d tempest-VolumesTestJSON-1885034036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-dcce1de5-bf45-46cd-8991-8333360c381d tempest-VolumesTestJSON-1885034036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-dcce1de5-bf45-46cd-8991-8333360c381d tempest-VolumesTestJSON-1885034036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:48:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-dcce1de5-bf45-46cd-8991-8333360c381d tempest-VolumesTestJSON-1885034036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:48:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-dcce1de5-bf45-46cd-8991-8333360c381d tempest-VolumesTestJSON-1885034036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-dcce1de5-bf45-46cd-8991-8333360c381d tempest-VolumesTestJSON-1885034036 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:48:25 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-dcce1de5-bf45-46cd-8991-8333360c381d tempest-VolumesTestJSON-1885034036 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:48:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dcce1de5-bf45-46cd-8991-8333360c381d tempest-VolumesTestJSON-1885034036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d90ecbf9-345c-477d-a8a1-b123595c2925 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:25 devstack sudo[100184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d90ecbf9-345c-477d-a8a1-b123595c2925 1073741824 Sep 10 16:48:25 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f50f40df-6ae0-4fd5-8097-4b54be2ba738 tempest-VolumesSnapshotListTestJSON-332874068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:26 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dcce1de5-bf45-46cd-8991-8333360c381d tempest-VolumesTestJSON-1885034036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d90ecbf9-345c-477d-a8a1-b123595c2925 1073741824" returned: 0 in 0.592s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dcce1de5-bf45-46cd-8991-8333360c381d tempest-VolumesTestJSON-1885034036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d90ecbf9-345c-477d-a8a1-b123595c2925 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:26 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d90ecbf9-345c-477d-a8a1-b123595c2925 Sep 10 16:48:26 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:26 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dcce1de5-bf45-46cd-8991-8333360c381d tempest-VolumesTestJSON-1885034036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d90ecbf9-345c-477d-a8a1-b123595c2925" returned: 0 in 0.265s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-dcce1de5-bf45-46cd-8991-8333360c381d tempest-VolumesTestJSON-1885034036 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:48:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-dcce1de5-bf45-46cd-8991-8333360c381d tempest-VolumesTestJSON-1885034036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f50f40df-6ae0-4fd5-8097-4b54be2ba738 tempest-VolumesSnapshotListTestJSON-332874068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.958s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-f50f40df-6ae0-4fd5-8097-4b54be2ba738 tempest-VolumesSnapshotListTestJSON-332874068 None] Creating offline snapshot ecfa86c0-fd5d-4d09-8028-3b00a12a37f1 of volume b3a9893f-49d0-4cb4-a74c-690075884caf {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:48:26 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[234d85eb-9c93-448b-be27-3cdfa4211029]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:48:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f50f40df-6ae0-4fd5-8097-4b54be2ba738 tempest-VolumesSnapshotListTestJSON-332874068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.b785f92d-3f55-4ca2-9772-5a2c36e0e4fb {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-dcce1de5-bf45-46cd-8991-8333360c381d tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b6ec52-b9fd-4124-9608-7e9a8decbb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d90ecbf9-345c-477d-a8a1-b123595c2925', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-dcce1de5-bf45-46cd-8991-8333360c381d tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7be5460-db7b-4f18-b962-a6d203181512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:26 devstack sudo[100193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.b785f92d-3f55-4ca2-9772-5a2c36e0e4fb Sep 10 16:48:26 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:26 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-dcce1de5-bf45-46cd-8991-8333360c381d tempest-VolumesTestJSON-1885034036 None] Volume volume-d90ecbf9-345c-477d-a8a1-b123595c2925 (d90ecbf9-345c-477d-a8a1-b123595c2925): created successfully Sep 10 16:48:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-dcce1de5-bf45-46cd-8991-8333360c381d tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7be5460-db7b-4f18-b962-a6d203181512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-dcce1de5-bf45-46cd-8991-8333360c381d tempest-VolumesTestJSON-1885034036 None] Flow 'volume_create_manager' (f201302a-5e5c-4c29-8a0f-b9cb905508a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:48:27 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f50f40df-6ae0-4fd5-8097-4b54be2ba738 tempest-VolumesSnapshotListTestJSON-332874068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.b785f92d-3f55-4ca2-9772-5a2c36e0e4fb" returned: 0 in 0.417s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-f50f40df-6ae0-4fd5-8097-4b54be2ba738 tempest-VolumesSnapshotListTestJSON-332874068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3a9893f-49d0-4cb4-a74c-690075884caf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:48:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f50f40df-6ae0-4fd5-8097-4b54be2ba738 tempest-VolumesSnapshotListTestJSON-332874068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.b785f92d-3f55-4ca2-9772-5a2c36e0e4fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.ecfa86c0-fd5d-4d09-8028-3b00a12a37f1 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:27 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-dcce1de5-bf45-46cd-8991-8333360c381d tempest-VolumesTestJSON-1885034036 None] Created volume successfully. Sep 10 16:48:27 devstack sudo[100198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.b785f92d-3f55-4ca2-9772-5a2c36e0e4fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.ecfa86c0-fd5d-4d09-8028-3b00a12a37f1 1G Sep 10 16:48:27 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:27 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f50f40df-6ae0-4fd5-8097-4b54be2ba738 tempest-VolumesSnapshotListTestJSON-332874068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.b785f92d-3f55-4ca2-9772-5a2c36e0e4fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.ecfa86c0-fd5d-4d09-8028-3b00a12a37f1 1G" returned: 0 in 0.673s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f50f40df-6ae0-4fd5-8097-4b54be2ba738 tempest-VolumesSnapshotListTestJSON-332874068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3a9893f-49d0-4cb4-a74c-690075884caf.b785f92d-3f55-4ca2-9772-5a2c36e0e4fb -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.ecfa86c0-fd5d-4d09-8028-3b00a12a37f1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:27 devstack sudo[100204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3a9893f-49d0-4cb4-a74c-690075884caf.b785f92d-3f55-4ca2-9772-5a2c36e0e4fb -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.ecfa86c0-fd5d-4d09-8028-3b00a12a37f1 Sep 10 16:48:27 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:28 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f50f40df-6ae0-4fd5-8097-4b54be2ba738 tempest-VolumesSnapshotListTestJSON-332874068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3a9893f-49d0-4cb4-a74c-690075884caf.b785f92d-3f55-4ca2-9772-5a2c36e0e4fb -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.ecfa86c0-fd5d-4d09-8028-3b00a12a37f1" returned: 0 in 0.422s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:28 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-f50f40df-6ae0-4fd5-8097-4b54be2ba738 tempest-VolumesSnapshotListTestJSON-332874068 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.ecfa86c0-fd5d-4d09-8028-3b00a12a37f1 is being set with open permissions: ugo+rw Sep 10 16:48:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f50f40df-6ae0-4fd5-8097-4b54be2ba738 tempest-VolumesSnapshotListTestJSON-332874068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.ecfa86c0-fd5d-4d09-8028-3b00a12a37f1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:28 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.ecfa86c0-fd5d-4d09-8028-3b00a12a37f1 Sep 10 16:48:28 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:28 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f50f40df-6ae0-4fd5-8097-4b54be2ba738 tempest-VolumesSnapshotListTestJSON-332874068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.ecfa86c0-fd5d-4d09-8028-3b00a12a37f1" returned: 0 in 0.318s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f50f40df-6ae0-4fd5-8097-4b54be2ba738 tempest-VolumesSnapshotListTestJSON-332874068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.962s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:28 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-f50f40df-6ae0-4fd5-8097-4b54be2ba738 tempest-VolumesSnapshotListTestJSON-332874068 None] Create snapshot completed successfully Sep 10 16:48:29 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-29e10460-f85b-4471-bb4a-1a6e213b2f4a tempest-VolumesTestJSON-1885034036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:48:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-29e10460-f85b-4471-bb4a-1a6e213b2f4a tempest-VolumesTestJSON-1885034036 None] Flow 'volume_create_manager' (0c83efb7-afb4-4548-a247-233daa041840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:48:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-29e10460-f85b-4471-bb4a-1a6e213b2f4a tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab685fdf-b87d-4d8c-9d8c-3425e752a3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-29e10460-f85b-4471-bb4a-1a6e213b2f4a tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab685fdf-b87d-4d8c-9d8c-3425e752a3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2053122489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=352daede-1537-4479-ae6b-f468121d0c56,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='94bf3c6766ac4d4bb957a64e82503a0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:48:30Z,use_quota=True,user_id='95c4f5eb90ae46afb0f6b27996e43d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-29e10460-f85b-4471-bb4a-1a6e213b2f4a tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b9730a4-3de5-448d-ba53-7cdd3e141981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-29e10460-f85b-4471-bb4a-1a6e213b2f4a tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b9730a4-3de5-448d-ba53-7cdd3e141981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-29e10460-f85b-4471-bb4a-1a6e213b2f4a tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1737d02b-1913-46c4-85c9-caf2d199906d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-29e10460-f85b-4471-bb4a-1a6e213b2f4a tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1737d02b-1913-46c4-85c9-caf2d199906d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '352daede-1537-4479-ae6b-f468121d0c56', 'volume_name': 'volume-352daede-1537-4479-ae6b-f468121d0c56', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-29e10460-f85b-4471-bb4a-1a6e213b2f4a tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7fb15fa-a2f1-452c-a859-e6bd1b74367b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-29e10460-f85b-4471-bb4a-1a6e213b2f4a tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7fb15fa-a2f1-452c-a859-e6bd1b74367b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-29e10460-f85b-4471-bb4a-1a6e213b2f4a tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b2aa19-e599-4c64-8301-821ffc727fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:30 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-29e10460-f85b-4471-bb4a-1a6e213b2f4a tempest-VolumesTestJSON-1885034036 None] Volume 352daede-1537-4479-ae6b-f468121d0c56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-352daede-1537-4479-ae6b-f468121d0c56', 'volume_size': 1} Sep 10 16:48:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-29e10460-f85b-4471-bb4a-1a6e213b2f4a tempest-VolumesTestJSON-1885034036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-29e10460-f85b-4471-bb4a-1a6e213b2f4a tempest-VolumesTestJSON-1885034036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-29e10460-f85b-4471-bb4a-1a6e213b2f4a tempest-VolumesTestJSON-1885034036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2053122489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=352daede-1537-4479-ae6b-f468121d0c56,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='94bf3c6766ac4d4bb957a64e82503a0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:48:30Z,use_quota=True,user_id='95c4f5eb90ae46afb0f6b27996e43d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:48:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-29e10460-f85b-4471-bb4a-1a6e213b2f4a tempest-VolumesTestJSON-1885034036 None] Creating volume 352daede-1537-4479-ae6b-f468121d0c56 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:48:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-29e10460-f85b-4471-bb4a-1a6e213b2f4a tempest-VolumesTestJSON-1885034036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-29e10460-f85b-4471-bb4a-1a6e213b2f4a tempest-VolumesTestJSON-1885034036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-29e10460-f85b-4471-bb4a-1a6e213b2f4a tempest-VolumesTestJSON-1885034036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:48:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-29e10460-f85b-4471-bb4a-1a6e213b2f4a tempest-VolumesTestJSON-1885034036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:48:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-29e10460-f85b-4471-bb4a-1a6e213b2f4a tempest-VolumesTestJSON-1885034036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-29e10460-f85b-4471-bb4a-1a6e213b2f4a tempest-VolumesTestJSON-1885034036 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:48:30 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-29e10460-f85b-4471-bb4a-1a6e213b2f4a tempest-VolumesTestJSON-1885034036 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:48:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-29e10460-f85b-4471-bb4a-1a6e213b2f4a tempest-VolumesTestJSON-1885034036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-352daede-1537-4479-ae6b-f468121d0c56 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:30 devstack sudo[100213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-352daede-1537-4479-ae6b-f468121d0c56 1073741824 Sep 10 16:48:30 devstack sudo[100213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:30 devstack sudo[100213]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-29e10460-f85b-4471-bb4a-1a6e213b2f4a tempest-VolumesTestJSON-1885034036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-352daede-1537-4479-ae6b-f468121d0c56 1073741824" returned: 0 in 0.467s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:30 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d3b0756c-df4c-4840-b8d9-5415562b60f0 tempest-VolumesSnapshotListTestJSON-332874068 None] Acquiring lock "cinder-ecfa86c0-fd5d-4d09-8028-3b00a12a37f1-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:30 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d3b0756c-df4c-4840-b8d9-5415562b60f0 tempest-VolumesSnapshotListTestJSON-332874068 None] Lock "cinder-ecfa86c0-fd5d-4d09-8028-3b00a12a37f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:30 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d3b0756c-df4c-4840-b8d9-5415562b60f0 tempest-VolumesSnapshotListTestJSON-332874068 None] Acquiring lock "cinder-quobyte-b3a9893f-49d0-4cb4-a74c-690075884caf" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:30 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d3b0756c-df4c-4840-b8d9-5415562b60f0 tempest-VolumesSnapshotListTestJSON-332874068 None] Lock "cinder-quobyte-b3a9893f-49d0-4cb4-a74c-690075884caf" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:30 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d3b0756c-df4c-4840-b8d9-5415562b60f0 tempest-VolumesSnapshotListTestJSON-332874068 None] Acquiring lock "cinder-quobyte-ecfa86c0-fd5d-4d09-8028-3b00a12a37f1" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:30 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d3b0756c-df4c-4840-b8d9-5415562b60f0 tempest-VolumesSnapshotListTestJSON-332874068 None] Lock "cinder-quobyte-ecfa86c0-fd5d-4d09-8028-3b00a12a37f1" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-d3b0756c-df4c-4840-b8d9-5415562b60f0 tempest-VolumesSnapshotListTestJSON-332874068 None] Deleting offline snapshot ecfa86c0-fd5d-4d09-8028-3b00a12a37f1 of volume b3a9893f-49d0-4cb4-a74c-690075884caf {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:48:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-d3b0756c-df4c-4840-b8d9-5415562b60f0 tempest-VolumesSnapshotListTestJSON-332874068 None] snapshot_file for this snap is: volume-b3a9893f-49d0-4cb4-a74c-690075884caf.ecfa86c0-fd5d-4d09-8028-3b00a12a37f1 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:48:30 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4f5407-d022-4695-a0b1-49479000ab53]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:48:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d3b0756c-df4c-4840-b8d9-5415562b60f0 tempest-VolumesSnapshotListTestJSON-332874068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.ecfa86c0-fd5d-4d09-8028-3b00a12a37f1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:30 devstack sudo[100220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.ecfa86c0-fd5d-4d09-8028-3b00a12a37f1 Sep 10 16:48:30 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:31 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d3b0756c-df4c-4840-b8d9-5415562b60f0 tempest-VolumesSnapshotListTestJSON-332874068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.ecfa86c0-fd5d-4d09-8028-3b00a12a37f1" returned: 0 in 0.392s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:31 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-d3b0756c-df4c-4840-b8d9-5415562b60f0 tempest-VolumesSnapshotListTestJSON-332874068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3a9893f-49d0-4cb4-a74c-690075884caf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:48:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-29e10460-f85b-4471-bb4a-1a6e213b2f4a tempest-VolumesTestJSON-1885034036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-352daede-1537-4479-ae6b-f468121d0c56 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:31 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b702fb10-ee1c-4638-98ce-3e44922079e4]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:48:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d3b0756c-df4c-4840-b8d9-5415562b60f0 tempest-VolumesSnapshotListTestJSON-332874068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.b785f92d-3f55-4ca2-9772-5a2c36e0e4fb {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:31 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-352daede-1537-4479-ae6b-f468121d0c56 Sep 10 16:48:31 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:31 devstack sudo[100226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.b785f92d-3f55-4ca2-9772-5a2c36e0e4fb Sep 10 16:48:31 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:31 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-29e10460-f85b-4471-bb4a-1a6e213b2f4a tempest-VolumesTestJSON-1885034036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-352daede-1537-4479-ae6b-f468121d0c56" returned: 0 in 0.328s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:31 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-29e10460-f85b-4471-bb4a-1a6e213b2f4a tempest-VolumesTestJSON-1885034036 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:48:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-29e10460-f85b-4471-bb4a-1a6e213b2f4a tempest-VolumesTestJSON-1885034036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:31 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d3b0756c-df4c-4840-b8d9-5415562b60f0 tempest-VolumesSnapshotListTestJSON-332874068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.b785f92d-3f55-4ca2-9772-5a2c36e0e4fb" returned: 0 in 0.382s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:31 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-d3b0756c-df4c-4840-b8d9-5415562b60f0 tempest-VolumesSnapshotListTestJSON-332874068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3a9893f-49d0-4cb4-a74c-690075884caf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:48:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d3b0756c-df4c-4840-b8d9-5415562b60f0 tempest-VolumesSnapshotListTestJSON-332874068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.ecfa86c0-fd5d-4d09-8028-3b00a12a37f1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-29e10460-f85b-4471-bb4a-1a6e213b2f4a tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b2aa19-e599-4c64-8301-821ffc727fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-352daede-1537-4479-ae6b-f468121d0c56', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-29e10460-f85b-4471-bb4a-1a6e213b2f4a tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd7d353-50bb-4862-be9a-37c8a59ba9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:31 devstack sudo[100233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.ecfa86c0-fd5d-4d09-8028-3b00a12a37f1 Sep 10 16:48:31 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:31 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-29e10460-f85b-4471-bb4a-1a6e213b2f4a tempest-VolumesTestJSON-1885034036 None] Volume volume-352daede-1537-4479-ae6b-f468121d0c56 (352daede-1537-4479-ae6b-f468121d0c56): created successfully Sep 10 16:48:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-29e10460-f85b-4471-bb4a-1a6e213b2f4a tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd7d353-50bb-4862-be9a-37c8a59ba9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-29e10460-f85b-4471-bb4a-1a6e213b2f4a tempest-VolumesTestJSON-1885034036 None] Flow 'volume_create_manager' (0c83efb7-afb4-4548-a247-233daa041840) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:48:31 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-29e10460-f85b-4471-bb4a-1a6e213b2f4a tempest-VolumesTestJSON-1885034036 None] Created volume successfully. Sep 10 16:48:32 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d3b0756c-df4c-4840-b8d9-5415562b60f0 tempest-VolumesSnapshotListTestJSON-332874068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.ecfa86c0-fd5d-4d09-8028-3b00a12a37f1" returned: 0 in 0.636s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d3b0756c-df4c-4840-b8d9-5415562b60f0 tempest-VolumesSnapshotListTestJSON-332874068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.ecfa86c0-fd5d-4d09-8028-3b00a12a37f1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:32 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.ecfa86c0-fd5d-4d09-8028-3b00a12a37f1 Sep 10 16:48:32 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:32 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d3b0756c-df4c-4840-b8d9-5415562b60f0 tempest-VolumesSnapshotListTestJSON-332874068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.ecfa86c0-fd5d-4d09-8028-3b00a12a37f1" returned: 0 in 0.347s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:32 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d3b0756c-df4c-4840-b8d9-5415562b60f0 tempest-VolumesSnapshotListTestJSON-332874068 None] Lock "cinder-quobyte-ecfa86c0-fd5d-4d09-8028-3b00a12a37f1" released by "_delete_snapshot" :: held 1.905s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:32 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d3b0756c-df4c-4840-b8d9-5415562b60f0 tempest-VolumesSnapshotListTestJSON-332874068 None] Lock "cinder-quobyte-b3a9893f-49d0-4cb4-a74c-690075884caf" released by "delete_snapshot" :: held 1.960s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:32 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-d3b0756c-df4c-4840-b8d9-5415562b60f0 tempest-VolumesSnapshotListTestJSON-332874068 None] Created reservations ['e480f641-0f02-48f8-86d7-f0cb69806981', 'feb970b5-d4a6-41dd-96ad-30659ff71f1f', '0f52ec3a-281d-4803-916b-8faef467e3b6', 'aedf8288-3fb6-43cd-a410-66e6ea77c456'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:48:32 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-3735d312-29e7-4047-b992-c104ee659eb1 tempest-VolumesTestJSON-1885034036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:48:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3735d312-29e7-4047-b992-c104ee659eb1 tempest-VolumesTestJSON-1885034036 None] Flow 'volume_create_manager' (e9f1746a-0032-4f5e-ac93-b271fe95f7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:48:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3735d312-29e7-4047-b992-c104ee659eb1 tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae10ce4-d88e-4c57-9751-2c81b006c2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3735d312-29e7-4047-b992-c104ee659eb1 tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae10ce4-d88e-4c57-9751-2c81b006c2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1538217438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d344f100-0e3e-4fdc-82af-1c105856a564,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='94bf3c6766ac4d4bb957a64e82503a0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:48:33Z,use_quota=True,user_id='95c4f5eb90ae46afb0f6b27996e43d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3735d312-29e7-4047-b992-c104ee659eb1 tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ec9e5c-8dea-4b48-9e11-bc0d86096c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3735d312-29e7-4047-b992-c104ee659eb1 tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ec9e5c-8dea-4b48-9e11-bc0d86096c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3735d312-29e7-4047-b992-c104ee659eb1 tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1439b18-aa79-4abe-acb5-95fe5564296a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3735d312-29e7-4047-b992-c104ee659eb1 tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1439b18-aa79-4abe-acb5-95fe5564296a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd344f100-0e3e-4fdc-82af-1c105856a564', 'volume_name': 'volume-d344f100-0e3e-4fdc-82af-1c105856a564', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3735d312-29e7-4047-b992-c104ee659eb1 tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (077eb029-9b41-422f-8e1e-3e54aaa73f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3735d312-29e7-4047-b992-c104ee659eb1 tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (077eb029-9b41-422f-8e1e-3e54aaa73f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3735d312-29e7-4047-b992-c104ee659eb1 tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7086f66-17b9-4ea9-9147-57030d029a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:32 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-3735d312-29e7-4047-b992-c104ee659eb1 tempest-VolumesTestJSON-1885034036 None] Volume d344f100-0e3e-4fdc-82af-1c105856a564: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d344f100-0e3e-4fdc-82af-1c105856a564', 'volume_size': 1} Sep 10 16:48:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3735d312-29e7-4047-b992-c104ee659eb1 tempest-VolumesTestJSON-1885034036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3735d312-29e7-4047-b992-c104ee659eb1 tempest-VolumesTestJSON-1885034036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3735d312-29e7-4047-b992-c104ee659eb1 tempest-VolumesTestJSON-1885034036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1538217438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d344f100-0e3e-4fdc-82af-1c105856a564,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='94bf3c6766ac4d4bb957a64e82503a0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:48:33Z,use_quota=True,user_id='95c4f5eb90ae46afb0f6b27996e43d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:48:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-3735d312-29e7-4047-b992-c104ee659eb1 tempest-VolumesTestJSON-1885034036 None] Creating volume d344f100-0e3e-4fdc-82af-1c105856a564 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:48:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3735d312-29e7-4047-b992-c104ee659eb1 tempest-VolumesTestJSON-1885034036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3735d312-29e7-4047-b992-c104ee659eb1 tempest-VolumesTestJSON-1885034036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3735d312-29e7-4047-b992-c104ee659eb1 tempest-VolumesTestJSON-1885034036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:48:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3735d312-29e7-4047-b992-c104ee659eb1 tempest-VolumesTestJSON-1885034036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:48:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3735d312-29e7-4047-b992-c104ee659eb1 tempest-VolumesTestJSON-1885034036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3735d312-29e7-4047-b992-c104ee659eb1 tempest-VolumesTestJSON-1885034036 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:48:32 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-3735d312-29e7-4047-b992-c104ee659eb1 tempest-VolumesTestJSON-1885034036 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:48:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3735d312-29e7-4047-b992-c104ee659eb1 tempest-VolumesTestJSON-1885034036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d344f100-0e3e-4fdc-82af-1c105856a564 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:32 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-d3b0756c-df4c-4840-b8d9-5415562b60f0 tempest-VolumesSnapshotListTestJSON-332874068 None] Delete snapshot completed successfully. Sep 10 16:48:32 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d3b0756c-df4c-4840-b8d9-5415562b60f0 tempest-VolumesSnapshotListTestJSON-332874068 None] Lock "cinder-ecfa86c0-fd5d-4d09-8028-3b00a12a37f1-delete_snapshot" released by "delete_snapshot" :: held 2.384s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:32 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d344f100-0e3e-4fdc-82af-1c105856a564 1073741824 Sep 10 16:48:32 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:33 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-09fb5e6f-6fd4-4a5f-9ec8-84b9d0275f70 tempest-VolumesSnapshotListTestJSON-332874068 None] Acquiring lock "cinder-b785f92d-3f55-4ca2-9772-5a2c36e0e4fb-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:33 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-09fb5e6f-6fd4-4a5f-9ec8-84b9d0275f70 tempest-VolumesSnapshotListTestJSON-332874068 None] Lock "cinder-b785f92d-3f55-4ca2-9772-5a2c36e0e4fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:33 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-09fb5e6f-6fd4-4a5f-9ec8-84b9d0275f70 tempest-VolumesSnapshotListTestJSON-332874068 None] Acquiring lock "cinder-quobyte-b3a9893f-49d0-4cb4-a74c-690075884caf" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:33 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-09fb5e6f-6fd4-4a5f-9ec8-84b9d0275f70 tempest-VolumesSnapshotListTestJSON-332874068 None] Lock "cinder-quobyte-b3a9893f-49d0-4cb4-a74c-690075884caf" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:33 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-09fb5e6f-6fd4-4a5f-9ec8-84b9d0275f70 tempest-VolumesSnapshotListTestJSON-332874068 None] Acquiring lock "cinder-quobyte-b785f92d-3f55-4ca2-9772-5a2c36e0e4fb" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:33 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-09fb5e6f-6fd4-4a5f-9ec8-84b9d0275f70 tempest-VolumesSnapshotListTestJSON-332874068 None] Lock "cinder-quobyte-b785f92d-3f55-4ca2-9772-5a2c36e0e4fb" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-09fb5e6f-6fd4-4a5f-9ec8-84b9d0275f70 tempest-VolumesSnapshotListTestJSON-332874068 None] Deleting offline snapshot b785f92d-3f55-4ca2-9772-5a2c36e0e4fb of volume b3a9893f-49d0-4cb4-a74c-690075884caf {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:48:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-09fb5e6f-6fd4-4a5f-9ec8-84b9d0275f70 tempest-VolumesSnapshotListTestJSON-332874068 None] snapshot_file for this snap is: volume-b3a9893f-49d0-4cb4-a74c-690075884caf.b785f92d-3f55-4ca2-9772-5a2c36e0e4fb {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:48:33 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4dbf4b4-28bc-4072-b259-f586f7370a1d]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:48:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-09fb5e6f-6fd4-4a5f-9ec8-84b9d0275f70 tempest-VolumesSnapshotListTestJSON-332874068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.b785f92d-3f55-4ca2-9772-5a2c36e0e4fb {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:33 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.b785f92d-3f55-4ca2-9772-5a2c36e0e4fb Sep 10 16:48:33 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:33 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3735d312-29e7-4047-b992-c104ee659eb1 tempest-VolumesTestJSON-1885034036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d344f100-0e3e-4fdc-82af-1c105856a564 1073741824" returned: 0 in 0.580s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3735d312-29e7-4047-b992-c104ee659eb1 tempest-VolumesTestJSON-1885034036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d344f100-0e3e-4fdc-82af-1c105856a564 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:33 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d344f100-0e3e-4fdc-82af-1c105856a564 Sep 10 16:48:33 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:33 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-09fb5e6f-6fd4-4a5f-9ec8-84b9d0275f70 tempest-VolumesSnapshotListTestJSON-332874068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.b785f92d-3f55-4ca2-9772-5a2c36e0e4fb" returned: 0 in 0.472s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-09fb5e6f-6fd4-4a5f-9ec8-84b9d0275f70 tempest-VolumesSnapshotListTestJSON-332874068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3a9893f-49d0-4cb4-a74c-690075884caf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:48:33 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fefefa6-f1cf-4d4d-9ae4-fde7b1cd446d]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:48:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-09fb5e6f-6fd4-4a5f-9ec8-84b9d0275f70 tempest-VolumesSnapshotListTestJSON-332874068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.eea15253-4cae-4b98-86bc-5d904903494f {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:33 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3735d312-29e7-4047-b992-c104ee659eb1 tempest-VolumesTestJSON-1885034036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d344f100-0e3e-4fdc-82af-1c105856a564" returned: 0 in 0.360s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3735d312-29e7-4047-b992-c104ee659eb1 tempest-VolumesTestJSON-1885034036 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:48:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3735d312-29e7-4047-b992-c104ee659eb1 tempest-VolumesTestJSON-1885034036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3735d312-29e7-4047-b992-c104ee659eb1 tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7086f66-17b9-4ea9-9147-57030d029a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d344f100-0e3e-4fdc-82af-1c105856a564', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3735d312-29e7-4047-b992-c104ee659eb1 tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d70b45-2a47-4739-8af9-55fc76225397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:33 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-3735d312-29e7-4047-b992-c104ee659eb1 tempest-VolumesTestJSON-1885034036 None] Volume volume-d344f100-0e3e-4fdc-82af-1c105856a564 (d344f100-0e3e-4fdc-82af-1c105856a564): created successfully Sep 10 16:48:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3735d312-29e7-4047-b992-c104ee659eb1 tempest-VolumesTestJSON-1885034036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d70b45-2a47-4739-8af9-55fc76225397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3735d312-29e7-4047-b992-c104ee659eb1 tempest-VolumesTestJSON-1885034036 None] Flow 'volume_create_manager' (e9f1746a-0032-4f5e-ac93-b271fe95f7cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:48:34 devstack sudo[100256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.eea15253-4cae-4b98-86bc-5d904903494f Sep 10 16:48:34 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:34 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-3735d312-29e7-4047-b992-c104ee659eb1 tempest-VolumesTestJSON-1885034036 None] Created volume successfully. Sep 10 16:48:34 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-09fb5e6f-6fd4-4a5f-9ec8-84b9d0275f70 tempest-VolumesSnapshotListTestJSON-332874068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.eea15253-4cae-4b98-86bc-5d904903494f" returned: 0 in 0.506s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:34 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-09fb5e6f-6fd4-4a5f-9ec8-84b9d0275f70 tempest-VolumesSnapshotListTestJSON-332874068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3a9893f-49d0-4cb4-a74c-690075884caf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:48:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-09fb5e6f-6fd4-4a5f-9ec8-84b9d0275f70 tempest-VolumesSnapshotListTestJSON-332874068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.b785f92d-3f55-4ca2-9772-5a2c36e0e4fb {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:34 devstack sudo[100264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.b785f92d-3f55-4ca2-9772-5a2c36e0e4fb Sep 10 16:48:34 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:34 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-f28cb824-19fb-4076-a3d7-7ef8c0dfa48a tempest-VolumesSnapshotTestJSON-623931556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:48:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f28cb824-19fb-4076-a3d7-7ef8c0dfa48a tempest-VolumesSnapshotTestJSON-623931556 None] Flow 'volume_create_manager' (7e6cae77-1f94-43f9-b257-1877f86c7ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:48:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f28cb824-19fb-4076-a3d7-7ef8c0dfa48a tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4efdd0fb-aa32-40c0-8c57-dd33c25b17af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f28cb824-19fb-4076-a3d7-7ef8c0dfa48a tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4efdd0fb-aa32-40c0-8c57-dd33c25b17af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1328971716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c8b00b5-f814-4479-8416-468bff417462,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0294cc0ede470b950accb5d195d50e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:48:34Z,use_quota=True,user_id='2c50e2a2615142c586667b4535fb0307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f28cb824-19fb-4076-a3d7-7ef8c0dfa48a tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (216bfb31-71fc-4f9b-bea9-ca6f5b899af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f28cb824-19fb-4076-a3d7-7ef8c0dfa48a tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (216bfb31-71fc-4f9b-bea9-ca6f5b899af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f28cb824-19fb-4076-a3d7-7ef8c0dfa48a tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e03690-d0c8-46dc-8122-ef3422f95c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f28cb824-19fb-4076-a3d7-7ef8c0dfa48a tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e03690-d0c8-46dc-8122-ef3422f95c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c8b00b5-f814-4479-8416-468bff417462', 'volume_name': 'volume-9c8b00b5-f814-4479-8416-468bff417462', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f28cb824-19fb-4076-a3d7-7ef8c0dfa48a tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34cf9fbd-ac3f-4343-b814-b3e3f175beb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f28cb824-19fb-4076-a3d7-7ef8c0dfa48a tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34cf9fbd-ac3f-4343-b814-b3e3f175beb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f28cb824-19fb-4076-a3d7-7ef8c0dfa48a tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8713828b-0f59-4852-90e0-43cd27a57e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:34 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-f28cb824-19fb-4076-a3d7-7ef8c0dfa48a tempest-VolumesSnapshotTestJSON-623931556 None] Volume 9c8b00b5-f814-4479-8416-468bff417462: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c8b00b5-f814-4479-8416-468bff417462', 'volume_size': 1} Sep 10 16:48:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f28cb824-19fb-4076-a3d7-7ef8c0dfa48a tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f28cb824-19fb-4076-a3d7-7ef8c0dfa48a tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:34 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f28cb824-19fb-4076-a3d7-7ef8c0dfa48a tempest-VolumesSnapshotTestJSON-623931556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1328971716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c8b00b5-f814-4479-8416-468bff417462,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0294cc0ede470b950accb5d195d50e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:48:34Z,use_quota=True,user_id='2c50e2a2615142c586667b4535fb0307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:48:34 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-f28cb824-19fb-4076-a3d7-7ef8c0dfa48a tempest-VolumesSnapshotTestJSON-623931556 None] Creating volume 9c8b00b5-f814-4479-8416-468bff417462 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:48:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f28cb824-19fb-4076-a3d7-7ef8c0dfa48a tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f28cb824-19fb-4076-a3d7-7ef8c0dfa48a tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:34 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f28cb824-19fb-4076-a3d7-7ef8c0dfa48a tempest-VolumesSnapshotTestJSON-623931556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:48:34 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f28cb824-19fb-4076-a3d7-7ef8c0dfa48a tempest-VolumesSnapshotTestJSON-623931556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:48:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f28cb824-19fb-4076-a3d7-7ef8c0dfa48a tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:34 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f28cb824-19fb-4076-a3d7-7ef8c0dfa48a tempest-VolumesSnapshotTestJSON-623931556 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:48:34 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-f28cb824-19fb-4076-a3d7-7ef8c0dfa48a tempest-VolumesSnapshotTestJSON-623931556 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:48:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f28cb824-19fb-4076-a3d7-7ef8c0dfa48a tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:34 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462 1073741824 Sep 10 16:48:34 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:34 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-09fb5e6f-6fd4-4a5f-9ec8-84b9d0275f70 tempest-VolumesSnapshotListTestJSON-332874068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.b785f92d-3f55-4ca2-9772-5a2c36e0e4fb" returned: 0 in 0.369s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-09fb5e6f-6fd4-4a5f-9ec8-84b9d0275f70 tempest-VolumesSnapshotListTestJSON-332874068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.b785f92d-3f55-4ca2-9772-5a2c36e0e4fb {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:34 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.b785f92d-3f55-4ca2-9772-5a2c36e0e4fb Sep 10 16:48:34 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:34 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f28cb824-19fb-4076-a3d7-7ef8c0dfa48a tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462 1073741824" returned: 0 in 0.409s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:34 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f28cb824-19fb-4076-a3d7-7ef8c0dfa48a tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-09fb5e6f-6fd4-4a5f-9ec8-84b9d0275f70 tempest-VolumesSnapshotListTestJSON-332874068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.b785f92d-3f55-4ca2-9772-5a2c36e0e4fb" returned: 0 in 0.269s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:34 devstack sudo[100277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462 Sep 10 16:48:34 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:34 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-09fb5e6f-6fd4-4a5f-9ec8-84b9d0275f70 tempest-VolumesSnapshotListTestJSON-332874068 None] Lock "cinder-quobyte-b785f92d-3f55-4ca2-9772-5a2c36e0e4fb" released by "_delete_snapshot" :: held 1.765s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:34 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-09fb5e6f-6fd4-4a5f-9ec8-84b9d0275f70 tempest-VolumesSnapshotListTestJSON-332874068 None] Lock "cinder-quobyte-b3a9893f-49d0-4cb4-a74c-690075884caf" released by "delete_snapshot" :: held 1.800s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:35 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-09fb5e6f-6fd4-4a5f-9ec8-84b9d0275f70 tempest-VolumesSnapshotListTestJSON-332874068 None] Created reservations ['5ace3015-7321-4343-af4d-bb71f3ed2441', '8dbeafe1-6085-4592-8c10-19e221b1c881', 'ff77d0ad-6c3a-4bfe-9c0f-b24c37d4dd93', '74ce0c3d-0abf-47fa-8c50-b0dcdf270f10'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:48:35 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-09fb5e6f-6fd4-4a5f-9ec8-84b9d0275f70 tempest-VolumesSnapshotListTestJSON-332874068 None] Delete snapshot completed successfully. Sep 10 16:48:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-09fb5e6f-6fd4-4a5f-9ec8-84b9d0275f70 tempest-VolumesSnapshotListTestJSON-332874068 None] Lock "cinder-b785f92d-3f55-4ca2-9772-5a2c36e0e4fb-delete_snapshot" released by "delete_snapshot" :: held 1.992s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:35 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f28cb824-19fb-4076-a3d7-7ef8c0dfa48a tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462" returned: 0 in 0.365s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:35 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f28cb824-19fb-4076-a3d7-7ef8c0dfa48a tempest-VolumesSnapshotTestJSON-623931556 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:48:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f28cb824-19fb-4076-a3d7-7ef8c0dfa48a tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8ba3b63c-fe4c-4123-a918-c922d3080d5a tempest-VolumesSnapshotListTestJSON-332874068 None] Acquiring lock "cinder-eea15253-4cae-4b98-86bc-5d904903494f-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f28cb824-19fb-4076-a3d7-7ef8c0dfa48a tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8713828b-0f59-4852-90e0-43cd27a57e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c8b00b5-f814-4479-8416-468bff417462', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f28cb824-19fb-4076-a3d7-7ef8c0dfa48a tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1210301d-c447-4452-85f4-c103b7f2f10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8ba3b63c-fe4c-4123-a918-c922d3080d5a tempest-VolumesSnapshotListTestJSON-332874068 None] Lock "cinder-eea15253-4cae-4b98-86bc-5d904903494f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8ba3b63c-fe4c-4123-a918-c922d3080d5a tempest-VolumesSnapshotListTestJSON-332874068 None] Acquiring lock "cinder-quobyte-b3a9893f-49d0-4cb4-a74c-690075884caf" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:35 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-f28cb824-19fb-4076-a3d7-7ef8c0dfa48a tempest-VolumesSnapshotTestJSON-623931556 None] Volume volume-9c8b00b5-f814-4479-8416-468bff417462 (9c8b00b5-f814-4479-8416-468bff417462): created successfully Sep 10 16:48:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f28cb824-19fb-4076-a3d7-7ef8c0dfa48a tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1210301d-c447-4452-85f4-c103b7f2f10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f28cb824-19fb-4076-a3d7-7ef8c0dfa48a tempest-VolumesSnapshotTestJSON-623931556 None] Flow 'volume_create_manager' (7e6cae77-1f94-43f9-b257-1877f86c7ae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:48:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8ba3b63c-fe4c-4123-a918-c922d3080d5a tempest-VolumesSnapshotListTestJSON-332874068 None] Lock "cinder-quobyte-b3a9893f-49d0-4cb4-a74c-690075884caf" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8ba3b63c-fe4c-4123-a918-c922d3080d5a tempest-VolumesSnapshotListTestJSON-332874068 None] Acquiring lock "cinder-quobyte-eea15253-4cae-4b98-86bc-5d904903494f" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:35 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-f28cb824-19fb-4076-a3d7-7ef8c0dfa48a tempest-VolumesSnapshotTestJSON-623931556 None] Created volume successfully. Sep 10 16:48:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8ba3b63c-fe4c-4123-a918-c922d3080d5a tempest-VolumesSnapshotListTestJSON-332874068 None] Lock "cinder-quobyte-eea15253-4cae-4b98-86bc-5d904903494f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:35 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-8ba3b63c-fe4c-4123-a918-c922d3080d5a tempest-VolumesSnapshotListTestJSON-332874068 None] Deleting offline snapshot eea15253-4cae-4b98-86bc-5d904903494f of volume b3a9893f-49d0-4cb4-a74c-690075884caf {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:48:35 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-8ba3b63c-fe4c-4123-a918-c922d3080d5a tempest-VolumesSnapshotListTestJSON-332874068 None] snapshot_file for this snap is: volume-b3a9893f-49d0-4cb4-a74c-690075884caf.eea15253-4cae-4b98-86bc-5d904903494f {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:48:35 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a88cded-b517-4633-80f7-ba2380b2d453]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:48:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8ba3b63c-fe4c-4123-a918-c922d3080d5a tempest-VolumesSnapshotListTestJSON-332874068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.eea15253-4cae-4b98-86bc-5d904903494f {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:35 devstack sudo[100280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.eea15253-4cae-4b98-86bc-5d904903494f Sep 10 16:48:35 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:35 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8ba3b63c-fe4c-4123-a918-c922d3080d5a tempest-VolumesSnapshotListTestJSON-332874068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.eea15253-4cae-4b98-86bc-5d904903494f" returned: 0 in 0.435s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:35 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-8ba3b63c-fe4c-4123-a918-c922d3080d5a tempest-VolumesSnapshotListTestJSON-332874068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3a9893f-49d0-4cb4-a74c-690075884caf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:48:35 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1ea825-c077-403a-bff1-f0c5dfb22784]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:48:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8ba3b63c-fe4c-4123-a918-c922d3080d5a tempest-VolumesSnapshotListTestJSON-332874068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:36 devstack sudo[100286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf Sep 10 16:48:36 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-dd8d2960-1bb8-4af9-880c-8541206f09f7 tempest-VolumesTestJSON-1885034036 None] Acquiring lock "cinder-d344f100-0e3e-4fdc-82af-1c105856a564-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-dd8d2960-1bb8-4af9-880c-8541206f09f7 tempest-VolumesTestJSON-1885034036 None] Lock "cinder-d344f100-0e3e-4fdc-82af-1c105856a564-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:36 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8ba3b63c-fe4c-4123-a918-c922d3080d5a tempest-VolumesSnapshotListTestJSON-332874068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf" returned: 0 in 0.445s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8ba3b63c-fe4c-4123-a918-c922d3080d5a tempest-VolumesSnapshotListTestJSON-332874068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.eea15253-4cae-4b98-86bc-5d904903494f {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-dd8d2960-1bb8-4af9-880c-8541206f09f7 tempest-VolumesTestJSON-1885034036 None] Acquiring lock "cinder-quobyte-d344f100-0e3e-4fdc-82af-1c105856a564" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:36 devstack sudo[100292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.eea15253-4cae-4b98-86bc-5d904903494f Sep 10 16:48:36 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-dd8d2960-1bb8-4af9-880c-8541206f09f7 tempest-VolumesTestJSON-1885034036 None] Lock "cinder-quobyte-d344f100-0e3e-4fdc-82af-1c105856a564" acquired by "delete_volume" :: waited 0.020s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:36 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fb62e7-cbb1-47b2-9f0d-3b21d64aaae7]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:48:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dd8d2960-1bb8-4af9-880c-8541206f09f7 tempest-VolumesTestJSON-1885034036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d344f100-0e3e-4fdc-82af-1c105856a564 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:36 devstack sudo[100294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d344f100-0e3e-4fdc-82af-1c105856a564 Sep 10 16:48:36 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:36 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8ba3b63c-fe4c-4123-a918-c922d3080d5a tempest-VolumesSnapshotListTestJSON-332874068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.eea15253-4cae-4b98-86bc-5d904903494f" returned: 0 in 0.459s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8ba3b63c-fe4c-4123-a918-c922d3080d5a tempest-VolumesSnapshotListTestJSON-332874068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.eea15253-4cae-4b98-86bc-5d904903494f {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:36 devstack sudo[100301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.eea15253-4cae-4b98-86bc-5d904903494f Sep 10 16:48:36 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:36 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dd8d2960-1bb8-4af9-880c-8541206f09f7 tempest-VolumesTestJSON-1885034036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d344f100-0e3e-4fdc-82af-1c105856a564" returned: 0 in 0.470s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dd8d2960-1bb8-4af9-880c-8541206f09f7 tempest-VolumesTestJSON-1885034036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d344f100-0e3e-4fdc-82af-1c105856a564 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:36 devstack sudo[100304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d344f100-0e3e-4fdc-82af-1c105856a564 Sep 10 16:48:36 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c2ef567b-7286-41b0-962c-12502fd3ae96 tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c2ef567b-7286-41b0-962c-12502fd3ae96 tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:37 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-c2ef567b-7286-41b0-962c-12502fd3ae96 tempest-VolumesSnapshotTestJSON-623931556 None] Creating offline snapshot 4601b35d-72d6-492e-b9b9-718e7462bd8c of volume 9c8b00b5-f814-4479-8416-468bff417462 {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:48:37 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c5ff71-e10f-45c6-b848-ee2d4ce7d829]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:48:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c2ef567b-7286-41b0-962c-12502fd3ae96 tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:37 devstack sudo[100306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462 Sep 10 16:48:37 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:37 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8ba3b63c-fe4c-4123-a918-c922d3080d5a tempest-VolumesSnapshotListTestJSON-332874068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf.eea15253-4cae-4b98-86bc-5d904903494f" returned: 0 in 0.357s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:37 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8ba3b63c-fe4c-4123-a918-c922d3080d5a tempest-VolumesSnapshotListTestJSON-332874068 None] Lock "cinder-quobyte-eea15253-4cae-4b98-86bc-5d904903494f" released by "_delete_snapshot" :: held 1.862s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:37 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:37 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8ba3b63c-fe4c-4123-a918-c922d3080d5a tempest-VolumesSnapshotListTestJSON-332874068 None] Lock "cinder-quobyte-b3a9893f-49d0-4cb4-a74c-690075884caf" released by "delete_snapshot" :: held 1.897s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dd8d2960-1bb8-4af9-880c-8541206f09f7 tempest-VolumesTestJSON-1885034036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d344f100-0e3e-4fdc-82af-1c105856a564" returned: 0 in 0.335s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:37 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-dd8d2960-1bb8-4af9-880c-8541206f09f7 tempest-VolumesTestJSON-1885034036 None] Lock "cinder-quobyte-d344f100-0e3e-4fdc-82af-1c105856a564" released by "delete_volume" :: held 0.867s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:37 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-8ba3b63c-fe4c-4123-a918-c922d3080d5a tempest-VolumesSnapshotListTestJSON-332874068 None] Created reservations ['13220afa-4019-48c6-8ab1-0425da0aa6ad', '5748a886-0a06-406d-ae0a-199a1a7f9e5d', '864f9c86-5afd-4a3d-961c-deb5dd4d333d', 'cde68b7b-fd70-4bfb-8cc8-3bd4572d3346'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:48:37 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-dd8d2960-1bb8-4af9-880c-8541206f09f7 tempest-VolumesTestJSON-1885034036 None] Created reservations ['38a3c26b-4e4b-40ae-ad2f-c11f3b18e2ee', '09427795-c235-41fc-a352-99f372792f96', 'd06fd76a-7a8b-48da-8744-9926eb6622e5', '8e5c303c-1591-4de1-b88f-528f9771a9e1'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:48:37 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-8ba3b63c-fe4c-4123-a918-c922d3080d5a tempest-VolumesSnapshotListTestJSON-332874068 None] Delete snapshot completed successfully. Sep 10 16:48:37 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8ba3b63c-fe4c-4123-a918-c922d3080d5a tempest-VolumesSnapshotListTestJSON-332874068 None] Lock "cinder-eea15253-4cae-4b98-86bc-5d904903494f-delete_snapshot" released by "delete_snapshot" :: held 2.198s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-dd8d2960-1bb8-4af9-880c-8541206f09f7 tempest-VolumesTestJSON-1885034036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-dd8d2960-1bb8-4af9-880c-8541206f09f7 tempest-VolumesTestJSON-1885034036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:37 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-dd8d2960-1bb8-4af9-880c-8541206f09f7 tempest-VolumesTestJSON-1885034036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:48:37 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-dd8d2960-1bb8-4af9-880c-8541206f09f7 tempest-VolumesTestJSON-1885034036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:48:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-dd8d2960-1bb8-4af9-880c-8541206f09f7 tempest-VolumesTestJSON-1885034036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dd8d2960-1bb8-4af9-880c-8541206f09f7 tempest-VolumesTestJSON-1885034036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:37 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c2ef567b-7286-41b0-962c-12502fd3ae96 tempest-VolumesSnapshotTestJSON-623931556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462" returned: 0 in 0.539s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c2ef567b-7286-41b0-962c-12502fd3ae96 tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462.4601b35d-72d6-492e-b9b9-718e7462bd8c 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:37 devstack sudo[100313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:48:37 devstack sudo[100313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:37 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-751dd04a-2888-4721-8f5c-9cf7a0290db8 tempest-VolumesSnapshotListTestJSON-332874068 None] Acquiring lock "cinder-b3a9893f-49d0-4cb4-a74c-690075884caf-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:37 devstack sudo[100315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462.4601b35d-72d6-492e-b9b9-718e7462bd8c 1G Sep 10 16:48:37 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:37 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-751dd04a-2888-4721-8f5c-9cf7a0290db8 tempest-VolumesSnapshotListTestJSON-332874068 None] Lock "cinder-b3a9893f-49d0-4cb4-a74c-690075884caf-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:37 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-751dd04a-2888-4721-8f5c-9cf7a0290db8 tempest-VolumesSnapshotListTestJSON-332874068 None] Acquiring lock "cinder-quobyte-b3a9893f-49d0-4cb4-a74c-690075884caf" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:37 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-751dd04a-2888-4721-8f5c-9cf7a0290db8 tempest-VolumesSnapshotListTestJSON-332874068 None] Lock "cinder-quobyte-b3a9893f-49d0-4cb4-a74c-690075884caf" acquired by "delete_volume" :: waited 0.020s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:37 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be6f8f7-9314-4629-823b-9eba2ad2faaa]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:48:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-751dd04a-2888-4721-8f5c-9cf7a0290db8 tempest-VolumesSnapshotListTestJSON-332874068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:37 devstack sudo[100313]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dd8d2960-1bb8-4af9-880c-8541206f09f7 tempest-VolumesTestJSON-1885034036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.283s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:37 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-dd8d2960-1bb8-4af9-880c-8541206f09f7 tempest-VolumesTestJSON-1885034036 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:48:37 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-dd8d2960-1bb8-4af9-880c-8541206f09f7 tempest-VolumesTestJSON-1885034036 None] Deleted volume successfully. Sep 10 16:48:37 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-dd8d2960-1bb8-4af9-880c-8541206f09f7 tempest-VolumesTestJSON-1885034036 None] Lock "cinder-d344f100-0e3e-4fdc-82af-1c105856a564-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:37 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf Sep 10 16:48:37 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:38 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c2ef567b-7286-41b0-962c-12502fd3ae96 tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462.4601b35d-72d6-492e-b9b9-718e7462bd8c 1G" returned: 0 in 0.556s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c2ef567b-7286-41b0-962c-12502fd3ae96 tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c8b00b5-f814-4479-8416-468bff417462 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462.4601b35d-72d6-492e-b9b9-718e7462bd8c {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:38 devstack sudo[100324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c8b00b5-f814-4479-8416-468bff417462 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462.4601b35d-72d6-492e-b9b9-718e7462bd8c Sep 10 16:48:38 devstack sudo[100324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:38 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-751dd04a-2888-4721-8f5c-9cf7a0290db8 tempest-VolumesSnapshotListTestJSON-332874068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf" returned: 0 in 0.473s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-751dd04a-2888-4721-8f5c-9cf7a0290db8 tempest-VolumesSnapshotListTestJSON-332874068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:38 devstack sudo[100329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf Sep 10 16:48:38 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:38 devstack sudo[100324]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c2ef567b-7286-41b0-962c-12502fd3ae96 tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c8b00b5-f814-4479-8416-468bff417462 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462.4601b35d-72d6-492e-b9b9-718e7462bd8c" returned: 0 in 0.349s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:38 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-c2ef567b-7286-41b0-962c-12502fd3ae96 tempest-VolumesSnapshotTestJSON-623931556 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462.4601b35d-72d6-492e-b9b9-718e7462bd8c is being set with open permissions: ugo+rw Sep 10 16:48:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c2ef567b-7286-41b0-962c-12502fd3ae96 tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462.4601b35d-72d6-492e-b9b9-718e7462bd8c {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:38 devstack sudo[100334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462.4601b35d-72d6-492e-b9b9-718e7462bd8c Sep 10 16:48:38 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:38 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-751dd04a-2888-4721-8f5c-9cf7a0290db8 tempest-VolumesSnapshotListTestJSON-332874068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3a9893f-49d0-4cb4-a74c-690075884caf" returned: 0 in 0.312s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:38 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-751dd04a-2888-4721-8f5c-9cf7a0290db8 tempest-VolumesSnapshotListTestJSON-332874068 None] Lock "cinder-quobyte-b3a9893f-49d0-4cb4-a74c-690075884caf" released by "delete_volume" :: held 0.866s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:38 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a1fb172f-deed-42ea-900d-44b00048f69b tempest-VolumesTestJSON-1885034036 None] Acquiring lock "cinder-352daede-1537-4479-ae6b-f468121d0c56-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:38 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a1fb172f-deed-42ea-900d-44b00048f69b tempest-VolumesTestJSON-1885034036 None] Lock "cinder-352daede-1537-4479-ae6b-f468121d0c56-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:38 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-751dd04a-2888-4721-8f5c-9cf7a0290db8 tempest-VolumesSnapshotListTestJSON-332874068 None] Created reservations ['eabff936-efe9-41b3-ab15-ef7598a87da0', 'b652cddf-0924-45cc-ba85-65b768edb6c6', '82a49a48-baf8-4e80-b11e-5c7794619d1b', '41f06f2d-0ffa-4329-8716-d38387d36a8b'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:48:38 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a1fb172f-deed-42ea-900d-44b00048f69b tempest-VolumesTestJSON-1885034036 None] Acquiring lock "cinder-quobyte-352daede-1537-4479-ae6b-f468121d0c56" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:38 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a1fb172f-deed-42ea-900d-44b00048f69b tempest-VolumesTestJSON-1885034036 None] Lock "cinder-quobyte-352daede-1537-4479-ae6b-f468121d0c56" acquired by "delete_volume" :: waited 0.023s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:38 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45d01f3-6134-4b85-a666-1dd5c9d25651]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:48:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a1fb172f-deed-42ea-900d-44b00048f69b tempest-VolumesTestJSON-1885034036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-352daede-1537-4479-ae6b-f468121d0c56 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-751dd04a-2888-4721-8f5c-9cf7a0290db8 tempest-VolumesSnapshotListTestJSON-332874068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-751dd04a-2888-4721-8f5c-9cf7a0290db8 tempest-VolumesSnapshotListTestJSON-332874068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:38 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-751dd04a-2888-4721-8f5c-9cf7a0290db8 tempest-VolumesSnapshotListTestJSON-332874068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:48:38 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:38 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-751dd04a-2888-4721-8f5c-9cf7a0290db8 tempest-VolumesSnapshotListTestJSON-332874068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:48:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-751dd04a-2888-4721-8f5c-9cf7a0290db8 tempest-VolumesSnapshotListTestJSON-332874068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-751dd04a-2888-4721-8f5c-9cf7a0290db8 tempest-VolumesSnapshotListTestJSON-332874068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c2ef567b-7286-41b0-962c-12502fd3ae96 tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462.4601b35d-72d6-492e-b9b9-718e7462bd8c" returned: 0 in 0.402s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:38 devstack sudo[100339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:48:38 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c2ef567b-7286-41b0-962c-12502fd3ae96 tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:38 devstack sudo[100341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462.info Sep 10 16:48:38 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:39 devstack sudo[100338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-352daede-1537-4479-ae6b-f468121d0c56 Sep 10 16:48:39 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:39 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-751dd04a-2888-4721-8f5c-9cf7a0290db8 tempest-VolumesSnapshotListTestJSON-332874068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.365s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:39 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-751dd04a-2888-4721-8f5c-9cf7a0290db8 tempest-VolumesSnapshotListTestJSON-332874068 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:48:39 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-751dd04a-2888-4721-8f5c-9cf7a0290db8 tempest-VolumesSnapshotListTestJSON-332874068 None] Deleted volume successfully. Sep 10 16:48:39 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-751dd04a-2888-4721-8f5c-9cf7a0290db8 tempest-VolumesSnapshotListTestJSON-332874068 None] Lock "cinder-b3a9893f-49d0-4cb4-a74c-690075884caf-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:39 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c2ef567b-7286-41b0-962c-12502fd3ae96 tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462.info" returned: 0 in 0.378s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:39 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-c2ef567b-7286-41b0-962c-12502fd3ae96 tempest-VolumesSnapshotTestJSON-623931556 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462.info is being set with open permissions: ugo+rw Sep 10 16:48:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c2ef567b-7286-41b0-962c-12502fd3ae96 tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:39 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:39 devstack sudo[100350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462.info Sep 10 16:48:39 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a1fb172f-deed-42ea-900d-44b00048f69b tempest-VolumesTestJSON-1885034036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-352daede-1537-4479-ae6b-f468121d0c56" returned: 0 in 0.540s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a1fb172f-deed-42ea-900d-44b00048f69b tempest-VolumesTestJSON-1885034036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-352daede-1537-4479-ae6b-f468121d0c56 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:39 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-352daede-1537-4479-ae6b-f468121d0c56 Sep 10 16:48:39 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:39 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c2ef567b-7286-41b0-962c-12502fd3ae96 tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462.info" returned: 0 in 0.280s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:39 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c2ef567b-7286-41b0-962c-12502fd3ae96 tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.630s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a1fb172f-deed-42ea-900d-44b00048f69b tempest-VolumesTestJSON-1885034036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-352daede-1537-4479-ae6b-f468121d0c56" returned: 0 in 0.279s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:39 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a1fb172f-deed-42ea-900d-44b00048f69b tempest-VolumesTestJSON-1885034036 None] Lock "cinder-quobyte-352daede-1537-4479-ae6b-f468121d0c56" released by "delete_volume" :: held 0.872s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:39 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-c2ef567b-7286-41b0-962c-12502fd3ae96 tempest-VolumesSnapshotTestJSON-623931556 None] Create snapshot completed successfully Sep 10 16:48:39 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-a1fb172f-deed-42ea-900d-44b00048f69b tempest-VolumesTestJSON-1885034036 None] Created reservations ['b928fbc3-253a-4cf6-8cc6-d44111cba787', '59b4c838-563c-4c99-818b-37cd86c7de8b', 'b125809f-e00b-42c2-9c0e-62e5829096d8', '955fc90a-9a56-49d9-8385-ebbd2b1a8ea7'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:48:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a1fb172f-deed-42ea-900d-44b00048f69b tempest-VolumesTestJSON-1885034036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a1fb172f-deed-42ea-900d-44b00048f69b tempest-VolumesTestJSON-1885034036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:39 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-a1fb172f-deed-42ea-900d-44b00048f69b tempest-VolumesTestJSON-1885034036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:48:39 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-a1fb172f-deed-42ea-900d-44b00048f69b tempest-VolumesTestJSON-1885034036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:48:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a1fb172f-deed-42ea-900d-44b00048f69b tempest-VolumesTestJSON-1885034036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a1fb172f-deed-42ea-900d-44b00048f69b tempest-VolumesTestJSON-1885034036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:39 devstack sudo[100356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:48:39 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:40 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a1fb172f-deed-42ea-900d-44b00048f69b tempest-VolumesTestJSON-1885034036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.320s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:40 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-a1fb172f-deed-42ea-900d-44b00048f69b tempest-VolumesTestJSON-1885034036 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:48:40 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-a1fb172f-deed-42ea-900d-44b00048f69b tempest-VolumesTestJSON-1885034036 None] Deleted volume successfully. Sep 10 16:48:40 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a1fb172f-deed-42ea-900d-44b00048f69b tempest-VolumesTestJSON-1885034036 None] Lock "cinder-352daede-1537-4479-ae6b-f468121d0c56-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:40 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-01a8a95a-c92d-40f2-9cf2-6478b662b1b9 tempest-VolumesTestJSON-1885034036 None] Acquiring lock "cinder-d90ecbf9-345c-477d-a8a1-b123595c2925-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:40 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-01a8a95a-c92d-40f2-9cf2-6478b662b1b9 tempest-VolumesTestJSON-1885034036 None] Lock "cinder-d90ecbf9-345c-477d-a8a1-b123595c2925-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:40 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-01a8a95a-c92d-40f2-9cf2-6478b662b1b9 tempest-VolumesTestJSON-1885034036 None] Acquiring lock "cinder-quobyte-d90ecbf9-345c-477d-a8a1-b123595c2925" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:40 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-01a8a95a-c92d-40f2-9cf2-6478b662b1b9 tempest-VolumesTestJSON-1885034036 None] Lock "cinder-quobyte-d90ecbf9-345c-477d-a8a1-b123595c2925" acquired by "delete_volume" :: waited 0.019s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:40 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87b5970-8d4a-40c9-a579-6bae918ee2d6]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:48:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-01a8a95a-c92d-40f2-9cf2-6478b662b1b9 tempest-VolumesTestJSON-1885034036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d90ecbf9-345c-477d-a8a1-b123595c2925 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:40 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-30a9737f-7542-48dd-8c84-4f08c469a98c tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "cinder-4601b35d-72d6-492e-b9b9-718e7462bd8c-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:40 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-30a9737f-7542-48dd-8c84-4f08c469a98c tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-4601b35d-72d6-492e-b9b9-718e7462bd8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:40 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d90ecbf9-345c-477d-a8a1-b123595c2925 Sep 10 16:48:40 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:40 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-30a9737f-7542-48dd-8c84-4f08c469a98c tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "cinder-quobyte-9c8b00b5-f814-4479-8416-468bff417462" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:40 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-30a9737f-7542-48dd-8c84-4f08c469a98c tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-quobyte-9c8b00b5-f814-4479-8416-468bff417462" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:40 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-30a9737f-7542-48dd-8c84-4f08c469a98c tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "cinder-quobyte-4601b35d-72d6-492e-b9b9-718e7462bd8c" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:40 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-30a9737f-7542-48dd-8c84-4f08c469a98c tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-quobyte-4601b35d-72d6-492e-b9b9-718e7462bd8c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:40 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-30a9737f-7542-48dd-8c84-4f08c469a98c tempest-VolumesSnapshotTestJSON-623931556 None] Deleting offline snapshot 4601b35d-72d6-492e-b9b9-718e7462bd8c of volume 9c8b00b5-f814-4479-8416-468bff417462 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:48:40 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-30a9737f-7542-48dd-8c84-4f08c469a98c tempest-VolumesSnapshotTestJSON-623931556 None] snapshot_file for this snap is: volume-9c8b00b5-f814-4479-8416-468bff417462.4601b35d-72d6-492e-b9b9-718e7462bd8c {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:48:40 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[737319fc-451d-41ba-b3a4-b4a809329fbe]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:48:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-30a9737f-7542-48dd-8c84-4f08c469a98c tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462.4601b35d-72d6-492e-b9b9-718e7462bd8c {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:40 devstack sudo[100362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462.4601b35d-72d6-492e-b9b9-718e7462bd8c Sep 10 16:48:40 devstack sudo[100362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:40 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-01a8a95a-c92d-40f2-9cf2-6478b662b1b9 tempest-VolumesTestJSON-1885034036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d90ecbf9-345c-477d-a8a1-b123595c2925" returned: 0 in 0.494s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-01a8a95a-c92d-40f2-9cf2-6478b662b1b9 tempest-VolumesTestJSON-1885034036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d90ecbf9-345c-477d-a8a1-b123595c2925 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:40 devstack sudo[100368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d90ecbf9-345c-477d-a8a1-b123595c2925 Sep 10 16:48:40 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:41 devstack sudo[100362]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-30a9737f-7542-48dd-8c84-4f08c469a98c tempest-VolumesSnapshotTestJSON-623931556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462.4601b35d-72d6-492e-b9b9-718e7462bd8c" returned: 0 in 0.504s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:41 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-30a9737f-7542-48dd-8c84-4f08c469a98c tempest-VolumesSnapshotTestJSON-623931556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c8b00b5-f814-4479-8416-468bff417462(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:48:41 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d98030f-6989-4568-9d8b-45d46b6f7b31]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:48:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-30a9737f-7542-48dd-8c84-4f08c469a98c tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:41 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-01a8a95a-c92d-40f2-9cf2-6478b662b1b9 tempest-VolumesTestJSON-1885034036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d90ecbf9-345c-477d-a8a1-b123595c2925" returned: 0 in 0.412s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:41 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-01a8a95a-c92d-40f2-9cf2-6478b662b1b9 tempest-VolumesTestJSON-1885034036 None] Lock "cinder-quobyte-d90ecbf9-345c-477d-a8a1-b123595c2925" released by "delete_volume" :: held 0.973s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:41 devstack sudo[100374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462 Sep 10 16:48:41 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:41 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-01a8a95a-c92d-40f2-9cf2-6478b662b1b9 tempest-VolumesTestJSON-1885034036 None] Created reservations ['653dac66-2ceb-49e9-9fbe-abdf9d671ed3', '8c0e7d42-76c9-456d-883f-b08e73fe6166', '0b9a48e3-f4cb-477f-a520-958e6622ed91', 'ba2778d0-2af0-4546-86f0-6e7dad2973ea'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:48:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-01a8a95a-c92d-40f2-9cf2-6478b662b1b9 tempest-VolumesTestJSON-1885034036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-01a8a95a-c92d-40f2-9cf2-6478b662b1b9 tempest-VolumesTestJSON-1885034036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:41 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-01a8a95a-c92d-40f2-9cf2-6478b662b1b9 tempest-VolumesTestJSON-1885034036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:48:41 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-01a8a95a-c92d-40f2-9cf2-6478b662b1b9 tempest-VolumesTestJSON-1885034036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:48:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-01a8a95a-c92d-40f2-9cf2-6478b662b1b9 tempest-VolumesTestJSON-1885034036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-01a8a95a-c92d-40f2-9cf2-6478b662b1b9 tempest-VolumesTestJSON-1885034036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:41 devstack sudo[100376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:48:41 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:41 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-30a9737f-7542-48dd-8c84-4f08c469a98c tempest-VolumesSnapshotTestJSON-623931556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462" returned: 0 in 0.508s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-30a9737f-7542-48dd-8c84-4f08c469a98c tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462.4601b35d-72d6-492e-b9b9-718e7462bd8c {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:41 devstack sudo[100381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462.4601b35d-72d6-492e-b9b9-718e7462bd8c Sep 10 16:48:41 devstack sudo[100381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:41 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-01a8a95a-c92d-40f2-9cf2-6478b662b1b9 tempest-VolumesTestJSON-1885034036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.352s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:41 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-01a8a95a-c92d-40f2-9cf2-6478b662b1b9 tempest-VolumesTestJSON-1885034036 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:48:41 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-01a8a95a-c92d-40f2-9cf2-6478b662b1b9 tempest-VolumesTestJSON-1885034036 None] Deleted volume successfully. Sep 10 16:48:41 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-01a8a95a-c92d-40f2-9cf2-6478b662b1b9 tempest-VolumesTestJSON-1885034036 None] Lock "cinder-d90ecbf9-345c-477d-a8a1-b123595c2925-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:42 devstack sudo[100381]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-30a9737f-7542-48dd-8c84-4f08c469a98c tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462.4601b35d-72d6-492e-b9b9-718e7462bd8c" returned: 0 in 0.434s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-30a9737f-7542-48dd-8c84-4f08c469a98c tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462.4601b35d-72d6-492e-b9b9-718e7462bd8c {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:42 devstack sudo[100388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462.4601b35d-72d6-492e-b9b9-718e7462bd8c Sep 10 16:48:42 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:42 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-30a9737f-7542-48dd-8c84-4f08c469a98c tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462.4601b35d-72d6-492e-b9b9-718e7462bd8c" returned: 0 in 0.273s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:42 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-30a9737f-7542-48dd-8c84-4f08c469a98c tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-quobyte-4601b35d-72d6-492e-b9b9-718e7462bd8c" released by "_delete_snapshot" :: held 1.878s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:42 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-30a9737f-7542-48dd-8c84-4f08c469a98c tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-quobyte-9c8b00b5-f814-4479-8416-468bff417462" released by "delete_snapshot" :: held 1.910s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:42 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-30a9737f-7542-48dd-8c84-4f08c469a98c tempest-VolumesSnapshotTestJSON-623931556 None] Created reservations ['c657fc62-3766-4f1a-b42a-a5c07e50d377', 'dcf8c86e-081d-4311-be85-6bcee5442fa6', '0bbeb304-2ce2-43ba-b452-2174b1fac5ab', 'c3dcf9b1-9944-4c41-92bd-6ff8d406e4e7'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:48:42 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-30a9737f-7542-48dd-8c84-4f08c469a98c tempest-VolumesSnapshotTestJSON-623931556 None] Delete snapshot completed successfully. Sep 10 16:48:42 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-30a9737f-7542-48dd-8c84-4f08c469a98c tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-4601b35d-72d6-492e-b9b9-718e7462bd8c-delete_snapshot" released by "delete_snapshot" :: held 2.169s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:44 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-183e7b2d-6dc1-4633-9da4-34b7259adbf3 tempest-VolumesSnapshotTestJSON-623931556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:48:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-183e7b2d-6dc1-4633-9da4-34b7259adbf3 tempest-VolumesSnapshotTestJSON-623931556 None] Flow 'volume_create_manager' (0fc8c976-cbe3-4de9-b041-03bc4b3dd2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:48:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-183e7b2d-6dc1-4633-9da4-34b7259adbf3 tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3142d041-3491-4cb9-ad28-ec4660c02ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-183e7b2d-6dc1-4633-9da4-34b7259adbf3 tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3142d041-3491-4cb9-ad28-ec4660c02ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2011812848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7eec27c-9c98-4bad-b5d8-bef3792026c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0294cc0ede470b950accb5d195d50e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:48:44Z,use_quota=True,user_id='2c50e2a2615142c586667b4535fb0307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-183e7b2d-6dc1-4633-9da4-34b7259adbf3 tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d3980fd-7c26-4563-9de0-d59b9960e56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-183e7b2d-6dc1-4633-9da4-34b7259adbf3 tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d3980fd-7c26-4563-9de0-d59b9960e56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-183e7b2d-6dc1-4633-9da4-34b7259adbf3 tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7939c77-508c-4b12-aa69-298e244acc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-183e7b2d-6dc1-4633-9da4-34b7259adbf3 tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7939c77-508c-4b12-aa69-298e244acc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7eec27c-9c98-4bad-b5d8-bef3792026c2', 'volume_name': 'volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-183e7b2d-6dc1-4633-9da4-34b7259adbf3 tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1333404-a8fb-408c-b4f5-494f95fded9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-183e7b2d-6dc1-4633-9da4-34b7259adbf3 tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1333404-a8fb-408c-b4f5-494f95fded9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-183e7b2d-6dc1-4633-9da4-34b7259adbf3 tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97973316-d332-493d-b4f5-f58d87260463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:44 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-183e7b2d-6dc1-4633-9da4-34b7259adbf3 tempest-VolumesSnapshotTestJSON-623931556 None] Volume a7eec27c-9c98-4bad-b5d8-bef3792026c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2', 'volume_size': 1} Sep 10 16:48:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-183e7b2d-6dc1-4633-9da4-34b7259adbf3 tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-183e7b2d-6dc1-4633-9da4-34b7259adbf3 tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:44 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-183e7b2d-6dc1-4633-9da4-34b7259adbf3 tempest-VolumesSnapshotTestJSON-623931556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2011812848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7eec27c-9c98-4bad-b5d8-bef3792026c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0294cc0ede470b950accb5d195d50e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:48:44Z,use_quota=True,user_id='2c50e2a2615142c586667b4535fb0307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:48:44 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-183e7b2d-6dc1-4633-9da4-34b7259adbf3 tempest-VolumesSnapshotTestJSON-623931556 None] Creating volume a7eec27c-9c98-4bad-b5d8-bef3792026c2 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:48:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-183e7b2d-6dc1-4633-9da4-34b7259adbf3 tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-183e7b2d-6dc1-4633-9da4-34b7259adbf3 tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:44 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-183e7b2d-6dc1-4633-9da4-34b7259adbf3 tempest-VolumesSnapshotTestJSON-623931556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:48:44 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-183e7b2d-6dc1-4633-9da4-34b7259adbf3 tempest-VolumesSnapshotTestJSON-623931556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:48:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-183e7b2d-6dc1-4633-9da4-34b7259adbf3 tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:44 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-183e7b2d-6dc1-4633-9da4-34b7259adbf3 tempest-VolumesSnapshotTestJSON-623931556 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:48:44 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-183e7b2d-6dc1-4633-9da4-34b7259adbf3 tempest-VolumesSnapshotTestJSON-623931556 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:48:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-183e7b2d-6dc1-4633-9da4-34b7259adbf3 tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:44 devstack sudo[100391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2 1073741824 Sep 10 16:48:44 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:45 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-183e7b2d-6dc1-4633-9da4-34b7259adbf3 tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2 1073741824" returned: 0 in 0.685s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-183e7b2d-6dc1-4633-9da4-34b7259adbf3 tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:45 devstack sudo[100397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2 Sep 10 16:48:45 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:45 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-183e7b2d-6dc1-4633-9da4-34b7259adbf3 tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2" returned: 0 in 0.286s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:45 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-183e7b2d-6dc1-4633-9da4-34b7259adbf3 tempest-VolumesSnapshotTestJSON-623931556 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:48:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-183e7b2d-6dc1-4633-9da4-34b7259adbf3 tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-183e7b2d-6dc1-4633-9da4-34b7259adbf3 tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97973316-d332-493d-b4f5-f58d87260463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-183e7b2d-6dc1-4633-9da4-34b7259adbf3 tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45cf0587-538e-4964-85b9-20b04b0ba4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:45 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-183e7b2d-6dc1-4633-9da4-34b7259adbf3 tempest-VolumesSnapshotTestJSON-623931556 None] Volume volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2 (a7eec27c-9c98-4bad-b5d8-bef3792026c2): created successfully Sep 10 16:48:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-183e7b2d-6dc1-4633-9da4-34b7259adbf3 tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45cf0587-538e-4964-85b9-20b04b0ba4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-183e7b2d-6dc1-4633-9da4-34b7259adbf3 tempest-VolumesSnapshotTestJSON-623931556 None] Flow 'volume_create_manager' (0fc8c976-cbe3-4de9-b041-03bc4b3dd2e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:48:45 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-183e7b2d-6dc1-4633-9da4-34b7259adbf3 tempest-VolumesSnapshotTestJSON-623931556 None] Created volume successfully. Sep 10 16:48:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-cf799352-7c70-4d1b-a352-7f011fa3db13 tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-cf799352-7c70-4d1b-a352-7f011fa3db13 tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:46 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-cf799352-7c70-4d1b-a352-7f011fa3db13 tempest-VolumesSnapshotTestJSON-623931556 None] Creating offline snapshot 2d1c1697-795d-4c07-b98e-2a7a9d56a915 of volume a7eec27c-9c98-4bad-b5d8-bef3792026c2 {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:48:46 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4888bfcc-5964-43d7-b362-b08dcc2782e0]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:48:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cf799352-7c70-4d1b-a352-7f011fa3db13 tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:47 devstack sudo[100400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2 Sep 10 16:48:47 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:47 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cf799352-7c70-4d1b-a352-7f011fa3db13 tempest-VolumesSnapshotTestJSON-623931556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2" returned: 0 in 0.543s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cf799352-7c70-4d1b-a352-7f011fa3db13 tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2.2d1c1697-795d-4c07-b98e-2a7a9d56a915 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:47 devstack sudo[100405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2.2d1c1697-795d-4c07-b98e-2a7a9d56a915 1G Sep 10 16:48:47 devstack sudo[100405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:48 devstack sudo[100405]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cf799352-7c70-4d1b-a352-7f011fa3db13 tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2.2d1c1697-795d-4c07-b98e-2a7a9d56a915 1G" returned: 0 in 0.611s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cf799352-7c70-4d1b-a352-7f011fa3db13 tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2.2d1c1697-795d-4c07-b98e-2a7a9d56a915 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:48 devstack sudo[100411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2.2d1c1697-795d-4c07-b98e-2a7a9d56a915 Sep 10 16:48:48 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:48 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cf799352-7c70-4d1b-a352-7f011fa3db13 tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2.2d1c1697-795d-4c07-b98e-2a7a9d56a915" returned: 0 in 0.448s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:48 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-cf799352-7c70-4d1b-a352-7f011fa3db13 tempest-VolumesSnapshotTestJSON-623931556 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2.2d1c1697-795d-4c07-b98e-2a7a9d56a915 is being set with open permissions: ugo+rw Sep 10 16:48:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cf799352-7c70-4d1b-a352-7f011fa3db13 tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2.2d1c1697-795d-4c07-b98e-2a7a9d56a915 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:48 devstack sudo[100416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2.2d1c1697-795d-4c07-b98e-2a7a9d56a915 Sep 10 16:48:48 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:48 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cf799352-7c70-4d1b-a352-7f011fa3db13 tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2.2d1c1697-795d-4c07-b98e-2a7a9d56a915" returned: 0 in 0.320s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cf799352-7c70-4d1b-a352-7f011fa3db13 tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:48 devstack sudo[100420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2.info Sep 10 16:48:48 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:49 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cf799352-7c70-4d1b-a352-7f011fa3db13 tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2.info" returned: 0 in 0.343s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:49 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-cf799352-7c70-4d1b-a352-7f011fa3db13 tempest-VolumesSnapshotTestJSON-623931556 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2.info is being set with open permissions: ugo+rw Sep 10 16:48:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cf799352-7c70-4d1b-a352-7f011fa3db13 tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:49 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2.info Sep 10 16:48:49 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:49 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-b5248b55-1dd3-449c-a6aa-5ea0ec8ee757 tempest-GroupSnapshotsTest-816808975 None] Group tempest-GroupSnapshotsTest-Group-1983492830: creating Sep 10 16:48:49 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-b5248b55-1dd3-449c-a6aa-5ea0ec8ee757 tempest-GroupSnapshotsTest-816808975 None] Group tempest-GroupSnapshotsTest-Group-1983492830: created successfully Sep 10 16:48:49 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-b5248b55-1dd3-449c-a6aa-5ea0ec8ee757 tempest-GroupSnapshotsTest-816808975 None] Create group completed successfully. Sep 10 16:48:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:48:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:48:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:48:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:49 devstack sudo[100425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:48:49 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:49 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cf799352-7c70-4d1b-a352-7f011fa3db13 tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2.info" returned: 0 in 0.453s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-cf799352-7c70-4d1b-a352-7f011fa3db13 tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.850s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:49 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-cf799352-7c70-4d1b-a352-7f011fa3db13 tempest-VolumesSnapshotTestJSON-623931556 None] Create snapshot completed successfully Sep 10 16:48:49 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.347s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:49 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:48:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager._thread_info {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:48:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread count: 28 {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 16:48:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread info: [<_MainThread(MainThread, started 125792070905984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 16:48:50 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:48:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Flow 'volume_create_manager' (e08fab57-de9e-4021-b631-0d04e2062150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:48:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (043817a6-bee1-44ea-a4a7-73984e3b153c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (043817a6-bee1-44ea-a4a7-73984e3b153c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2078357551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a0f5c38-b544-4927-a169-7498ac1a6396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0294cc0ede470b950accb5d195d50e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:48:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=2d1c1697-795d-4c07-b98e-2a7a9d56a915,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:48:51Z,use_quota=True,user_id='2c50e2a2615142c586667b4535fb0307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45752112-284a-4a8e-8145-88de051325ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45752112-284a-4a8e-8145-88de051325ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf62723-198b-44e5-af75-073335d77893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf62723-198b-44e5-af75-073335d77893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8a0f5c38-b544-4927-a169-7498ac1a6396', 'volume_name': 'volume-8a0f5c38-b544-4927-a169-7498ac1a6396', 'volume_size': 2, 'snapshot_id': '2d1c1697-795d-4c07-b98e-2a7a9d56a915'}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c985d5-44f0-4339-a191-b8cc1ba69585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c985d5-44f0-4339-a191-b8cc1ba69585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf18938-79f1-45e3-9434-26301df787f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:50 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Volume 8a0f5c38-b544-4927-a169-7498ac1a6396: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8a0f5c38-b544-4927-a169-7498ac1a6396', 'volume_size': 2, 'snapshot_id': '2d1c1697-795d-4c07-b98e-2a7a9d56a915'} Sep 10 16:48:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:50 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "cinder-quobyte-2d1c1697-795d-4c07-b98e-2a7a9d56a915-8a0f5c38-b544-4927-a169-7498ac1a6396" by "_create_volume_from_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:50 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-quobyte-2d1c1697-795d-4c07-b98e-2a7a9d56a915-8a0f5c38-b544-4927-a169-7498ac1a6396" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:50 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Creating volume 8a0f5c38-b544-4927-a169-7498ac1a6396 from snapshot 2d1c1697-795d-4c07-b98e-2a7a9d56a915 {{(pid=88189) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 10 16:48:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:50 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:48:50 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:48:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:50 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:48:50 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "cinder-quobyte-8a0f5c38-b544-4927-a169-7498ac1a6396" by "_copy_volume_from_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:50 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-quobyte-8a0f5c38-b544-4927-a169-7498ac1a6396" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:50 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] snapshot: 2d1c1697-795d-4c07-b98e-2a7a9d56a915, volume: 8a0f5c38-b544-4927-a169-7498ac1a6396, {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 16:48:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:50 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:48:50 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:48:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:50 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[39672905-49d7-437a-afce-54c9c0cf9c3c]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:48:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2.2d1c1697-795d-4c07-b98e-2a7a9d56a915 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:51 devstack sudo[100430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2.2d1c1697-795d-4c07-b98e-2a7a9d56a915 Sep 10 16:48:51 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:51 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebd543f3-30de-42f9-946b-31ec7a89cd05 tempest-GroupSnapshotsTest-816808975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:48:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ebd543f3-30de-42f9-946b-31ec7a89cd05 tempest-GroupSnapshotsTest-816808975 None] Flow 'volume_create_manager' (c9637854-94e4-444d-8cdd-05958815a71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:48:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ebd543f3-30de-42f9-946b-31ec7a89cd05 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ad6a24-9d23-42f2-9963-9ed17e0f9c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ebd543f3-30de-42f9-946b-31ec7a89cd05 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ad6a24-9d23-42f2-9963-9ed17e0f9c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-366259656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2e1ace0d-cb4a-47a8-9536-10ae097ab437,host='devstack@QuobyteHD#QuobyteHD',id=948a0a77-c42f-4a97-a28b-232a4db0979d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db7640a88dee43a0adaf652df2e8f4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:48:51Z,use_quota=True,user_id='db5cc2cff9be401f8716a3989358ac94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8c19175-6ed5-4749-a577-783049f6fb50),volume_type_id=e8c19175-6ed5-4749-a577-783049f6fb50)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ebd543f3-30de-42f9-946b-31ec7a89cd05 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b004a596-9195-4e09-ad9a-a8231ae6fc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ebd543f3-30de-42f9-946b-31ec7a89cd05 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b004a596-9195-4e09-ad9a-a8231ae6fc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ebd543f3-30de-42f9-946b-31ec7a89cd05 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f717947c-c83a-49ee-9045-484922c13f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ebd543f3-30de-42f9-946b-31ec7a89cd05 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f717947c-c83a-49ee-9045-484922c13f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '948a0a77-c42f-4a97-a28b-232a4db0979d', 'volume_name': 'volume-948a0a77-c42f-4a97-a28b-232a4db0979d', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ebd543f3-30de-42f9-946b-31ec7a89cd05 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16eb6252-8639-42a4-b710-b00e77cc4c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ebd543f3-30de-42f9-946b-31ec7a89cd05 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16eb6252-8639-42a4-b710-b00e77cc4c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ebd543f3-30de-42f9-946b-31ec7a89cd05 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26957f72-21eb-4b39-b449-7da393a40111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:51 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-ebd543f3-30de-42f9-946b-31ec7a89cd05 tempest-GroupSnapshotsTest-816808975 None] Volume 948a0a77-c42f-4a97-a28b-232a4db0979d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-948a0a77-c42f-4a97-a28b-232a4db0979d', 'volume_size': 1} Sep 10 16:48:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ebd543f3-30de-42f9-946b-31ec7a89cd05 tempest-GroupSnapshotsTest-816808975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:51 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2.2d1c1697-795d-4c07-b98e-2a7a9d56a915" returned: 0 in 0.520s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:51 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:48:51 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d994eb5-528b-4be2-be96-3ca9622c999f]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:48:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:51 devstack sudo[100435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2 Sep 10 16:48:51 devstack sudo[100435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:51 devstack sudo[100435]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2" returned: 0 in 0.441s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:51 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] will copy from snapshot at /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2 {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 16:48:51 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Creating direct copy from snapshot {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 16:48:51 devstack cinder-volume[88189]: DEBUG cinder.utils [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Path /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a0f5c38-b544-4927-a169-7498ac1a6396 not found in is_blk_device check {{(pid=88189) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 16:48:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a0f5c38-b544-4927-a169-7498ac1a6396 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:51 devstack sudo[100440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a0f5c38-b544-4927-a169-7498ac1a6396 Sep 10 16:48:51 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:58 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a0f5c38-b544-4927-a169-7498ac1a6396" returned: 0 in 6.047s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:58 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Image conversion details: src /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2, size 1024.00 MB, duration 6.05 sec, destination /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a0f5c38-b544-4927-a169-7498ac1a6396 {{(pid=88189) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 16:48:58 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Converted 1024.00 MB image at 169.31 MB/s Sep 10 16:48:58 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a0f5c38-b544-4927-a169-7498ac1a6396 is being set with open permissions: ugo+rw Sep 10 16:48:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a0f5c38-b544-4927-a169-7498ac1a6396 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:58 devstack sudo[100456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a0f5c38-b544-4927-a169-7498ac1a6396 Sep 10 16:48:58 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:58 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a0f5c38-b544-4927-a169-7498ac1a6396" returned: 0 in 0.313s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:58 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-quobyte-8a0f5c38-b544-4927-a169-7498ac1a6396" released by "_copy_volume_from_snapshot" :: held 7.448s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:58 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-quobyte-2d1c1697-795d-4c07-b98e-2a7a9d56a915-8a0f5c38-b544-4927-a169-7498ac1a6396" released by "_create_volume_from_snapshot" :: held 7.535s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:48:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.559s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ebd543f3-30de-42f9-946b-31ec7a89cd05 tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.029s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:58 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ebd543f3-30de-42f9-946b-31ec7a89cd05 tempest-GroupSnapshotsTest-816808975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2e1ace0d-cb4a-47a8-9536-10ae097ab437,created_at=2026-09-10T14:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-366259656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2e1ace0d-cb4a-47a8-9536-10ae097ab437,host='devstack@QuobyteHD#QuobyteHD',id=948a0a77-c42f-4a97-a28b-232a4db0979d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db7640a88dee43a0adaf652df2e8f4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:48:51Z,use_quota=True,user_id='db5cc2cff9be401f8716a3989358ac94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8c19175-6ed5-4749-a577-783049f6fb50),volume_type_id=e8c19175-6ed5-4749-a577-783049f6fb50)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:48:58 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-ebd543f3-30de-42f9-946b-31ec7a89cd05 tempest-GroupSnapshotsTest-816808975 None] Creating volume 948a0a77-c42f-4a97-a28b-232a4db0979d {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:48:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ebd543f3-30de-42f9-946b-31ec7a89cd05 tempest-GroupSnapshotsTest-816808975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:48:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ebd543f3-30de-42f9-946b-31ec7a89cd05 tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:48:58 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ebd543f3-30de-42f9-946b-31ec7a89cd05 tempest-GroupSnapshotsTest-816808975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:48:58 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ebd543f3-30de-42f9-946b-31ec7a89cd05 tempest-GroupSnapshotsTest-816808975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:48:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ebd543f3-30de-42f9-946b-31ec7a89cd05 tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:58 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ebd543f3-30de-42f9-946b-31ec7a89cd05 tempest-GroupSnapshotsTest-816808975 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:48:58 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-ebd543f3-30de-42f9-946b-31ec7a89cd05 tempest-GroupSnapshotsTest-816808975 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:48:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ebd543f3-30de-42f9-946b-31ec7a89cd05 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:58 devstack sudo[100459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d 1073741824 Sep 10 16:48:58 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf18938-79f1-45e3-9434-26301df787f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a0f5c38-b544-4927-a169-7498ac1a6396', 'volume_size': 2, 'snapshot_id': '2d1c1697-795d-4c07-b98e-2a7a9d56a915'}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4642ccd-1c2d-45ba-942b-f2dca8d7b2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:58 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Volume volume-8a0f5c38-b544-4927-a169-7498ac1a6396 (8a0f5c38-b544-4927-a169-7498ac1a6396): created successfully Sep 10 16:48:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4642ccd-1c2d-45ba-942b-f2dca8d7b2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Flow 'volume_create_manager' (e08fab57-de9e-4021-b631-0d04e2062150) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:48:58 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-4cae1a16-a939-4754-bb96-40ad55773f9d tempest-VolumesSnapshotTestJSON-623931556 None] Created volume successfully. Sep 10 16:48:58 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-66a25db7-00bb-4671-a4a2-c69e4969f711 tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "cinder-8a0f5c38-b544-4927-a169-7498ac1a6396-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:58 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-66a25db7-00bb-4671-a4a2-c69e4969f711 tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-8a0f5c38-b544-4927-a169-7498ac1a6396-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:58 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-66a25db7-00bb-4671-a4a2-c69e4969f711 tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "cinder-quobyte-8a0f5c38-b544-4927-a169-7498ac1a6396" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:48:58 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-66a25db7-00bb-4671-a4a2-c69e4969f711 tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-quobyte-8a0f5c38-b544-4927-a169-7498ac1a6396" acquired by "delete_volume" :: waited 0.026s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:48:58 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bacc3b7-08a9-41c5-b281-54210e313742]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:48:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-66a25db7-00bb-4671-a4a2-c69e4969f711 tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a0f5c38-b544-4927-a169-7498ac1a6396 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:59 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ebd543f3-30de-42f9-946b-31ec7a89cd05 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d 1073741824" returned: 0 in 0.707s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:59 devstack sudo[100467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a0f5c38-b544-4927-a169-7498ac1a6396 Sep 10 16:48:59 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ebd543f3-30de-42f9-946b-31ec7a89cd05 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:59 devstack sudo[100469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d Sep 10 16:48:59 devstack sudo[100469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:59 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-66a25db7-00bb-4671-a4a2-c69e4969f711 tempest-VolumesSnapshotTestJSON-623931556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a0f5c38-b544-4927-a169-7498ac1a6396" returned: 0 in 0.667s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-66a25db7-00bb-4671-a4a2-c69e4969f711 tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a0f5c38-b544-4927-a169-7498ac1a6396 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:48:59 devstack sudo[100469]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ebd543f3-30de-42f9-946b-31ec7a89cd05 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d" returned: 0 in 0.465s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:59 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ebd543f3-30de-42f9-946b-31ec7a89cd05 tempest-GroupSnapshotsTest-816808975 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:48:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ebd543f3-30de-42f9-946b-31ec7a89cd05 tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.263s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:48:59 devstack sudo[100476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a0f5c38-b544-4927-a169-7498ac1a6396 Sep 10 16:48:59 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:48:59 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ebd543f3-30de-42f9-946b-31ec7a89cd05 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26957f72-21eb-4b39-b449-7da393a40111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-948a0a77-c42f-4a97-a28b-232a4db0979d', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:59 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ebd543f3-30de-42f9-946b-31ec7a89cd05 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09d56f9e-5ac5-45d1-abe4-ff0cd91abc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:48:59 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-ebd543f3-30de-42f9-946b-31ec7a89cd05 tempest-GroupSnapshotsTest-816808975 None] Volume volume-948a0a77-c42f-4a97-a28b-232a4db0979d (948a0a77-c42f-4a97-a28b-232a4db0979d): created successfully Sep 10 16:48:59 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ebd543f3-30de-42f9-946b-31ec7a89cd05 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09d56f9e-5ac5-45d1-abe4-ff0cd91abc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:48:59 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ebd543f3-30de-42f9-946b-31ec7a89cd05 tempest-GroupSnapshotsTest-816808975 None] Flow 'volume_create_manager' (c9637854-94e4-444d-8cdd-05958815a71d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:48:59 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-ebd543f3-30de-42f9-946b-31ec7a89cd05 tempest-GroupSnapshotsTest-816808975 None] Created volume successfully. Sep 10 16:48:59 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root Sep 10 16:48:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-66a25db7-00bb-4671-a4a2-c69e4969f711 tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a0f5c38-b544-4927-a169-7498ac1a6396" returned: 0 in 0.297s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:48:59 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-66a25db7-00bb-4671-a4a2-c69e4969f711 tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-quobyte-8a0f5c38-b544-4927-a169-7498ac1a6396" released by "delete_volume" :: held 1.054s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:00 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-66a25db7-00bb-4671-a4a2-c69e4969f711 tempest-VolumesSnapshotTestJSON-623931556 None] Created reservations ['03222d8a-4816-4ac8-820f-b7b970f681a3', '22a75b57-ddc8-44e5-a862-2ddf028d04da', 'fd77feb2-845e-4b0d-8404-4c0e94f0c3aa', '704838c1-d5d2-4bdd-8a1d-8740145ef2c3'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:49:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-66a25db7-00bb-4671-a4a2-c69e4969f711 tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-66a25db7-00bb-4671-a4a2-c69e4969f711 tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:00 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-66a25db7-00bb-4671-a4a2-c69e4969f711 tempest-VolumesSnapshotTestJSON-623931556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:49:00 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-66a25db7-00bb-4671-a4a2-c69e4969f711 tempest-VolumesSnapshotTestJSON-623931556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:49:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-66a25db7-00bb-4671-a4a2-c69e4969f711 tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-66a25db7-00bb-4671-a4a2-c69e4969f711 tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:00 devstack sudo[100480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:49:00 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:00 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-66a25db7-00bb-4671-a4a2-c69e4969f711 tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.333s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:00 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-66a25db7-00bb-4671-a4a2-c69e4969f711 tempest-VolumesSnapshotTestJSON-623931556 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:49:00 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-66a25db7-00bb-4671-a4a2-c69e4969f711 tempest-VolumesSnapshotTestJSON-623931556 None] Deleted volume successfully. Sep 10 16:49:00 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-66a25db7-00bb-4671-a4a2-c69e4969f711 tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-8a0f5c38-b544-4927-a169-7498ac1a6396-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:00 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-d0d19d5e-ca46-4198-8702-d30805b06544 tempest-GroupSnapshotsTest-816808975 None] GroupSnapshot 3b9031a7-f180-4c94-86c0-ce1fc0e4e717: creating. Sep 10 16:49:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d0d19d5e-ca46-4198-8702-d30805b06544 tempest-GroupSnapshotsTest-816808975 None] Group snapshot 3b9031a7-f180-4c94-86c0-ce1fc0e4e717: creating. {{(pid=88189) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 10 16:49:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d0d19d5e-ca46-4198-8702-d30805b06544 tempest-GroupSnapshotsTest-816808975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d0d19d5e-ca46-4198-8702-d30805b06544 tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:00 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-d0d19d5e-ca46-4198-8702-d30805b06544 tempest-GroupSnapshotsTest-816808975 None] Creating offline snapshot 3cfe1ffd-ca5b-45ce-9b0f-748ec7f716d7 of volume 948a0a77-c42f-4a97-a28b-232a4db0979d {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:49:00 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4961fae9-1c34-4588-952e-79e3a2c5719f]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d0d19d5e-ca46-4198-8702-d30805b06544 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:01 devstack sudo[100483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d Sep 10 16:49:01 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:01 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a4b9ca57-569c-4eeb-a86d-babd14a84c0a tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "cinder-2d1c1697-795d-4c07-b98e-2a7a9d56a915-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:49:01 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a4b9ca57-569c-4eeb-a86d-babd14a84c0a tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-2d1c1697-795d-4c07-b98e-2a7a9d56a915-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:49:01 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a4b9ca57-569c-4eeb-a86d-babd14a84c0a tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "cinder-quobyte-a7eec27c-9c98-4bad-b5d8-bef3792026c2" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:49:01 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a4b9ca57-569c-4eeb-a86d-babd14a84c0a tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-quobyte-a7eec27c-9c98-4bad-b5d8-bef3792026c2" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:49:01 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a4b9ca57-569c-4eeb-a86d-babd14a84c0a tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "cinder-quobyte-2d1c1697-795d-4c07-b98e-2a7a9d56a915" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:49:01 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a4b9ca57-569c-4eeb-a86d-babd14a84c0a tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-quobyte-2d1c1697-795d-4c07-b98e-2a7a9d56a915" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:49:01 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-a4b9ca57-569c-4eeb-a86d-babd14a84c0a tempest-VolumesSnapshotTestJSON-623931556 None] Deleting offline snapshot 2d1c1697-795d-4c07-b98e-2a7a9d56a915 of volume a7eec27c-9c98-4bad-b5d8-bef3792026c2 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:49:01 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-a4b9ca57-569c-4eeb-a86d-babd14a84c0a tempest-VolumesSnapshotTestJSON-623931556 None] snapshot_file for this snap is: volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2.2d1c1697-795d-4c07-b98e-2a7a9d56a915 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:49:01 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e30104-0d02-4b4e-a9b8-756b029c4a6f]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a4b9ca57-569c-4eeb-a86d-babd14a84c0a tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2.2d1c1697-795d-4c07-b98e-2a7a9d56a915 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:01 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d0d19d5e-ca46-4198-8702-d30805b06544 tempest-GroupSnapshotsTest-816808975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d" returned: 0 in 0.482s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d0d19d5e-ca46-4198-8702-d30805b06544 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d.3cfe1ffd-ca5b-45ce-9b0f-748ec7f716d7 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:01 devstack sudo[100489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d.3cfe1ffd-ca5b-45ce-9b0f-748ec7f716d7 1G Sep 10 16:49:01 devstack sudo[100489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:01 devstack sudo[100488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2.2d1c1697-795d-4c07-b98e-2a7a9d56a915 Sep 10 16:49:01 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:01 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a4b9ca57-569c-4eeb-a86d-babd14a84c0a tempest-VolumesSnapshotTestJSON-623931556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2.2d1c1697-795d-4c07-b98e-2a7a9d56a915" returned: 0 in 0.441s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:01 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-a4b9ca57-569c-4eeb-a86d-babd14a84c0a tempest-VolumesSnapshotTestJSON-623931556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:49:01 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87745a3-e3e9-4826-92b0-d0f5816f8a2f]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a4b9ca57-569c-4eeb-a86d-babd14a84c0a tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:01 devstack sudo[100489]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d0d19d5e-ca46-4198-8702-d30805b06544 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d.3cfe1ffd-ca5b-45ce-9b0f-748ec7f716d7 1G" returned: 0 in 0.561s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d0d19d5e-ca46-4198-8702-d30805b06544 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-948a0a77-c42f-4a97-a28b-232a4db0979d -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d.3cfe1ffd-ca5b-45ce-9b0f-748ec7f716d7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:02 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-948a0a77-c42f-4a97-a28b-232a4db0979d -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d.3cfe1ffd-ca5b-45ce-9b0f-748ec7f716d7 Sep 10 16:49:02 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:02 devstack sudo[100498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2 Sep 10 16:49:02 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:02 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d0d19d5e-ca46-4198-8702-d30805b06544 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-948a0a77-c42f-4a97-a28b-232a4db0979d -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d.3cfe1ffd-ca5b-45ce-9b0f-748ec7f716d7" returned: 0 in 0.450s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:02 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-d0d19d5e-ca46-4198-8702-d30805b06544 tempest-GroupSnapshotsTest-816808975 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d.3cfe1ffd-ca5b-45ce-9b0f-748ec7f716d7 is being set with open permissions: ugo+rw: NotImplementedError Sep 10 16:49:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d0d19d5e-ca46-4198-8702-d30805b06544 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d.3cfe1ffd-ca5b-45ce-9b0f-748ec7f716d7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:02 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d.3cfe1ffd-ca5b-45ce-9b0f-748ec7f716d7 Sep 10 16:49:02 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:02 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a4b9ca57-569c-4eeb-a86d-babd14a84c0a tempest-VolumesSnapshotTestJSON-623931556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2" returned: 0 in 0.781s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a4b9ca57-569c-4eeb-a86d-babd14a84c0a tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2.2d1c1697-795d-4c07-b98e-2a7a9d56a915 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:02 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2.2d1c1697-795d-4c07-b98e-2a7a9d56a915 Sep 10 16:49:02 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:02 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d0d19d5e-ca46-4198-8702-d30805b06544 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d.3cfe1ffd-ca5b-45ce-9b0f-748ec7f716d7" returned: 0 in 0.305s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d0d19d5e-ca46-4198-8702-d30805b06544 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:02 devstack sudo[100513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d.info Sep 10 16:49:02 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:03 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a4b9ca57-569c-4eeb-a86d-babd14a84c0a tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2.2d1c1697-795d-4c07-b98e-2a7a9d56a915" returned: 0 in 0.467s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a4b9ca57-569c-4eeb-a86d-babd14a84c0a tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2.2d1c1697-795d-4c07-b98e-2a7a9d56a915 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:03 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d0d19d5e-ca46-4198-8702-d30805b06544 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d.info" returned: 0 in 0.340s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:03 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-d0d19d5e-ca46-4198-8702-d30805b06544 tempest-GroupSnapshotsTest-816808975 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d.info is being set with open permissions: ugo+rw: NotImplementedError Sep 10 16:49:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d0d19d5e-ca46-4198-8702-d30805b06544 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:03 devstack sudo[100519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2.2d1c1697-795d-4c07-b98e-2a7a9d56a915 Sep 10 16:49:03 devstack sudo[100519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:03 devstack sudo[100521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d.info Sep 10 16:49:03 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:03 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d0d19d5e-ca46-4198-8702-d30805b06544 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d.info" returned: 0 in 0.314s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:03 devstack sudo[100519]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d0d19d5e-ca46-4198-8702-d30805b06544 tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.580s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a4b9ca57-569c-4eeb-a86d-babd14a84c0a tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2.2d1c1697-795d-4c07-b98e-2a7a9d56a915" returned: 0 in 0.379s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a4b9ca57-569c-4eeb-a86d-babd14a84c0a tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-quobyte-2d1c1697-795d-4c07-b98e-2a7a9d56a915" released by "_delete_snapshot" :: held 2.223s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a4b9ca57-569c-4eeb-a86d-babd14a84c0a tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-quobyte-a7eec27c-9c98-4bad-b5d8-bef3792026c2" released by "delete_snapshot" :: held 2.254s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:03 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-d0d19d5e-ca46-4198-8702-d30805b06544 tempest-GroupSnapshotsTest-816808975 None] group_snapshot 3b9031a7-f180-4c94-86c0-ce1fc0e4e717: created successfully Sep 10 16:49:03 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-a4b9ca57-569c-4eeb-a86d-babd14a84c0a tempest-VolumesSnapshotTestJSON-623931556 None] Created reservations ['8c90cf1f-4e33-4542-9a45-8210c2d75a06', 'e8873014-f72d-4d58-bf6e-e5ad11987d8c', '578215cb-0c09-4411-a16d-4cd127f26ae2', '848da466-c262-4e33-9506-17285bcbf07d'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:49:03 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-a4b9ca57-569c-4eeb-a86d-babd14a84c0a tempest-VolumesSnapshotTestJSON-623931556 None] Delete snapshot completed successfully. Sep 10 16:49:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a4b9ca57-569c-4eeb-a86d-babd14a84c0a tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-2d1c1697-795d-4c07-b98e-2a7a9d56a915-delete_snapshot" released by "delete_snapshot" :: held 2.455s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:04 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-e9a337bf-e155-407d-a15b-0eef5243d7ef tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "cinder-a7eec27c-9c98-4bad-b5d8-bef3792026c2-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:49:04 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-e9a337bf-e155-407d-a15b-0eef5243d7ef tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-a7eec27c-9c98-4bad-b5d8-bef3792026c2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:49:04 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-e9a337bf-e155-407d-a15b-0eef5243d7ef tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "cinder-quobyte-a7eec27c-9c98-4bad-b5d8-bef3792026c2" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:49:04 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-e9a337bf-e155-407d-a15b-0eef5243d7ef tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-quobyte-a7eec27c-9c98-4bad-b5d8-bef3792026c2" acquired by "delete_volume" :: waited 0.016s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:49:04 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0263c1d-632b-454e-8da0-0c9d059d2ece]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e9a337bf-e155-407d-a15b-0eef5243d7ef tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:04 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] Acquiring lock "cinder-quobyte-3cfe1ffd-ca5b-45ce-9b0f-748ec7f716d7-f6bdb8bb-57b9-46a1-af33-e5ac0e9149bd" by "_create_volume_from_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:49:04 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] Lock "cinder-quobyte-3cfe1ffd-ca5b-45ce-9b0f-748ec7f716d7-f6bdb8bb-57b9-46a1-af33-e5ac0e9149bd" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:49:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] Creating volume f6bdb8bb-57b9-46a1-af33-e5ac0e9149bd from snapshot 3cfe1ffd-ca5b-45ce-9b0f-748ec7f716d7 {{(pid=88189) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 10 16:49:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:49:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:49:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:49:04 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2 Sep 10 16:49:04 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:04 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] Acquiring lock "cinder-quobyte-f6bdb8bb-57b9-46a1-af33-e5ac0e9149bd" by "_copy_volume_from_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:49:04 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] Lock "cinder-quobyte-f6bdb8bb-57b9-46a1-af33-e5ac0e9149bd" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:49:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] snapshot: 3cfe1ffd-ca5b-45ce-9b0f-748ec7f716d7, volume: f6bdb8bb-57b9-46a1-af33-e5ac0e9149bd, {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 16:49:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:49:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:49:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:05 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8590e0b1-d1de-4752-b8f3-e34b7eb3ddd6]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d.3cfe1ffd-ca5b-45ce-9b0f-748ec7f716d7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:05 devstack sudo[100527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d.3cfe1ffd-ca5b-45ce-9b0f-748ec7f716d7 Sep 10 16:49:05 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:05 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e9a337bf-e155-407d-a15b-0eef5243d7ef tempest-VolumesSnapshotTestJSON-623931556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2" returned: 0 in 0.644s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e9a337bf-e155-407d-a15b-0eef5243d7ef tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:05 devstack sudo[100532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2 Sep 10 16:49:05 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:05 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d.3cfe1ffd-ca5b-45ce-9b0f-748ec7f716d7" returned: 0 in 0.473s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-948a0a77-c42f-4a97-a28b-232a4db0979d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:49:05 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6472c551-5831-4a16-bf2e-14dfe4ae2c88]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:05 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d Sep 10 16:49:05 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:05 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e9a337bf-e155-407d-a15b-0eef5243d7ef tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a7eec27c-9c98-4bad-b5d8-bef3792026c2" returned: 0 in 0.316s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:05 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-e9a337bf-e155-407d-a15b-0eef5243d7ef tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-quobyte-a7eec27c-9c98-4bad-b5d8-bef3792026c2" released by "delete_volume" :: held 1.046s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:05 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-e9a337bf-e155-407d-a15b-0eef5243d7ef tempest-VolumesSnapshotTestJSON-623931556 None] Created reservations ['522f9ba7-506c-4027-acda-c891d0eb59a1', '20af63fd-8990-4223-a6a1-4a352e36d5dc', '857a6058-ac98-4b57-8768-4c37a6274042', 'cf994806-eb41-45bf-a2b5-3217eeb93192'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:49:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e9a337bf-e155-407d-a15b-0eef5243d7ef tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e9a337bf-e155-407d-a15b-0eef5243d7ef tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-e9a337bf-e155-407d-a15b-0eef5243d7ef tempest-VolumesSnapshotTestJSON-623931556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:49:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-e9a337bf-e155-407d-a15b-0eef5243d7ef tempest-VolumesSnapshotTestJSON-623931556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:49:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e9a337bf-e155-407d-a15b-0eef5243d7ef tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e9a337bf-e155-407d-a15b-0eef5243d7ef tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:05 devstack sudo[100541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:49:05 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:06 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d" returned: 0 in 0.495s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:06 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] will copy from snapshot at /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 16:49:06 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] Creating direct copy from snapshot {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 16:49:06 devstack cinder-volume[88189]: DEBUG cinder.utils [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] Path /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f6bdb8bb-57b9-46a1-af33-e5ac0e9149bd not found in is_blk_device check {{(pid=88189) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 16:49:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f6bdb8bb-57b9-46a1-af33-e5ac0e9149bd {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:06 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f6bdb8bb-57b9-46a1-af33-e5ac0e9149bd Sep 10 16:49:06 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:06 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e9a337bf-e155-407d-a15b-0eef5243d7ef tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.289s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:06 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-e9a337bf-e155-407d-a15b-0eef5243d7ef tempest-VolumesSnapshotTestJSON-623931556 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:49:06 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-e9a337bf-e155-407d-a15b-0eef5243d7ef tempest-VolumesSnapshotTestJSON-623931556 None] Deleted volume successfully. Sep 10 16:49:06 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-e9a337bf-e155-407d-a15b-0eef5243d7ef tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-a7eec27c-9c98-4bad-b5d8-bef3792026c2-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:06 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c45c885-56f8-4943-94de-7e9417e7c13f tempest-VolumesMetadataTest-1718597424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:49:06 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6c45c885-56f8-4943-94de-7e9417e7c13f tempest-VolumesMetadataTest-1718597424 None] Flow 'volume_create_manager' (8451c936-96f5-4167-a2e7-5455ae17885e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:49:06 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6c45c885-56f8-4943-94de-7e9417e7c13f tempest-VolumesMetadataTest-1718597424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (548ecce2-21c5-424f-9e2a-71b1dc101190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6c45c885-56f8-4943-94de-7e9417e7c13f tempest-VolumesMetadataTest-1718597424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (548ecce2-21c5-424f-9e2a-71b1dc101190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-134015863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94a57a0a-a551-4e6d-b4f9-84c5b908b681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4597cc8128f485c979e6c9ecdb3435c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:49:07Z,use_quota=True,user_id='342103dd779b422e838c6b2971bdbfa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6c45c885-56f8-4943-94de-7e9417e7c13f tempest-VolumesMetadataTest-1718597424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54bd6b56-7da4-4021-b8d9-a5b438d5cc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6c45c885-56f8-4943-94de-7e9417e7c13f tempest-VolumesMetadataTest-1718597424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54bd6b56-7da4-4021-b8d9-a5b438d5cc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6c45c885-56f8-4943-94de-7e9417e7c13f tempest-VolumesMetadataTest-1718597424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a6225b-9bf6-49eb-a841-24b83df87754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6c45c885-56f8-4943-94de-7e9417e7c13f tempest-VolumesMetadataTest-1718597424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a6225b-9bf6-49eb-a841-24b83df87754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94a57a0a-a551-4e6d-b4f9-84c5b908b681', 'volume_name': 'volume-94a57a0a-a551-4e6d-b4f9-84c5b908b681', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6c45c885-56f8-4943-94de-7e9417e7c13f tempest-VolumesMetadataTest-1718597424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588d3efa-8a41-48f5-b283-7e3fdbed5d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6c45c885-56f8-4943-94de-7e9417e7c13f tempest-VolumesMetadataTest-1718597424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588d3efa-8a41-48f5-b283-7e3fdbed5d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6c45c885-56f8-4943-94de-7e9417e7c13f tempest-VolumesMetadataTest-1718597424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fede8b63-8939-44e3-80ee-450dcb364581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:07 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-6c45c885-56f8-4943-94de-7e9417e7c13f tempest-VolumesMetadataTest-1718597424 None] Volume 94a57a0a-a551-4e6d-b4f9-84c5b908b681: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94a57a0a-a551-4e6d-b4f9-84c5b908b681', 'volume_size': 1} Sep 10 16:49:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6c45c885-56f8-4943-94de-7e9417e7c13f tempest-VolumesMetadataTest-1718597424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:08 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5389bec-8be5-468d-87de-42c98935755c tempest-VolumesSnapshotTestJSON-623931556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:49:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d5389bec-8be5-468d-87de-42c98935755c tempest-VolumesSnapshotTestJSON-623931556 None] Flow 'volume_create_manager' (1ee33b6a-35dd-4460-9f47-58f093cb528a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:49:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d5389bec-8be5-468d-87de-42c98935755c tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a0d5ef5-f949-4237-96f5-163fe55b772a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d5389bec-8be5-468d-87de-42c98935755c tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a0d5ef5-f949-4237-96f5-163fe55b772a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1130459863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57469620-a163-4893-a513-db44591fad2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0294cc0ede470b950accb5d195d50e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:49:08Z,use_quota=True,user_id='2c50e2a2615142c586667b4535fb0307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d5389bec-8be5-468d-87de-42c98935755c tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c202a328-7663-423f-b279-0f32ead8c944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d5389bec-8be5-468d-87de-42c98935755c tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c202a328-7663-423f-b279-0f32ead8c944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d5389bec-8be5-468d-87de-42c98935755c tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f621b51-2f61-4951-ad25-1e83a1a7c7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d5389bec-8be5-468d-87de-42c98935755c tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f621b51-2f61-4951-ad25-1e83a1a7c7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57469620-a163-4893-a513-db44591fad2a', 'volume_name': 'volume-57469620-a163-4893-a513-db44591fad2a', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d5389bec-8be5-468d-87de-42c98935755c tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e8d214f-5f0d-49c8-8ce1-0c4aed7db636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d5389bec-8be5-468d-87de-42c98935755c tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e8d214f-5f0d-49c8-8ce1-0c4aed7db636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d5389bec-8be5-468d-87de-42c98935755c tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5a8d165-8258-4026-b654-5519e9371597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:08 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-d5389bec-8be5-468d-87de-42c98935755c tempest-VolumesSnapshotTestJSON-623931556 None] Volume 57469620-a163-4893-a513-db44591fad2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57469620-a163-4893-a513-db44591fad2a', 'volume_size': 1} Sep 10 16:49:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d5389bec-8be5-468d-87de-42c98935755c tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:11 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f6bdb8bb-57b9-46a1-af33-e5ac0e9149bd" returned: 0 in 5.826s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:11 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] Image conversion details: src /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d, size 1024.00 MB, duration 5.83 sec, destination /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f6bdb8bb-57b9-46a1-af33-e5ac0e9149bd {{(pid=88189) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 16:49:11 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] Converted 1024.00 MB image at 175.72 MB/s Sep 10 16:49:11 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f6bdb8bb-57b9-46a1-af33-e5ac0e9149bd is being set with open permissions: ugo+rw: NotImplementedError Sep 10 16:49:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f6bdb8bb-57b9-46a1-af33-e5ac0e9149bd {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:11 devstack sudo[100564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f6bdb8bb-57b9-46a1-af33-e5ac0e9149bd Sep 10 16:49:11 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:12 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f6bdb8bb-57b9-46a1-af33-e5ac0e9149bd" returned: 0 in 0.278s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:12 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] Lock "cinder-quobyte-f6bdb8bb-57b9-46a1-af33-e5ac0e9149bd" released by "_copy_volume_from_snapshot" :: held 7.218s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:12 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] Lock "cinder-quobyte-3cfe1ffd-ca5b-45ce-9b0f-748ec7f716d7-f6bdb8bb-57b9-46a1-af33-e5ac0e9149bd" released by "_create_volume_from_snapshot" :: held 7.311s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.339s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6c45c885-56f8-4943-94de-7e9417e7c13f tempest-VolumesMetadataTest-1718597424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.163s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:12 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6c45c885-56f8-4943-94de-7e9417e7c13f tempest-VolumesMetadataTest-1718597424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-134015863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94a57a0a-a551-4e6d-b4f9-84c5b908b681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4597cc8128f485c979e6c9ecdb3435c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:49:07Z,use_quota=True,user_id='342103dd779b422e838c6b2971bdbfa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:49:12 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-6c45c885-56f8-4943-94de-7e9417e7c13f tempest-VolumesMetadataTest-1718597424 None] Creating volume 94a57a0a-a551-4e6d-b4f9-84c5b908b681 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:49:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6c45c885-56f8-4943-94de-7e9417e7c13f tempest-VolumesMetadataTest-1718597424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6c45c885-56f8-4943-94de-7e9417e7c13f tempest-VolumesMetadataTest-1718597424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:12 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6c45c885-56f8-4943-94de-7e9417e7c13f tempest-VolumesMetadataTest-1718597424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:49:12 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6c45c885-56f8-4943-94de-7e9417e7c13f tempest-VolumesMetadataTest-1718597424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:49:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6c45c885-56f8-4943-94de-7e9417e7c13f tempest-VolumesMetadataTest-1718597424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:12 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6c45c885-56f8-4943-94de-7e9417e7c13f tempest-VolumesMetadataTest-1718597424 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:49:12 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-6c45c885-56f8-4943-94de-7e9417e7c13f tempest-VolumesMetadataTest-1718597424 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:49:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6c45c885-56f8-4943-94de-7e9417e7c13f tempest-VolumesMetadataTest-1718597424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94a57a0a-a551-4e6d-b4f9-84c5b908b681 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:12 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94a57a0a-a551-4e6d-b4f9-84c5b908b681 1073741824 Sep 10 16:49:12 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:12 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-ecca2fa2-8b45-4182-8c22-b5c8afd5cba5 tempest-GroupSnapshotsTest-816808975 None] Create group from source-snapshot-3b9031a7-f180-4c94-86c0-ce1fc0e4e717 completed successfully. Sep 10 16:49:12 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6c45c885-56f8-4943-94de-7e9417e7c13f tempest-VolumesMetadataTest-1718597424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94a57a0a-a551-4e6d-b4f9-84c5b908b681 1073741824" returned: 0 in 0.461s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6c45c885-56f8-4943-94de-7e9417e7c13f tempest-VolumesMetadataTest-1718597424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94a57a0a-a551-4e6d-b4f9-84c5b908b681 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:12 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94a57a0a-a551-4e6d-b4f9-84c5b908b681 Sep 10 16:49:12 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:13 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6c45c885-56f8-4943-94de-7e9417e7c13f tempest-VolumesMetadataTest-1718597424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94a57a0a-a551-4e6d-b4f9-84c5b908b681" returned: 0 in 0.266s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:13 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6c45c885-56f8-4943-94de-7e9417e7c13f tempest-VolumesMetadataTest-1718597424 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:49:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6c45c885-56f8-4943-94de-7e9417e7c13f tempest-VolumesMetadataTest-1718597424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d5389bec-8be5-468d-87de-42c98935755c tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.253s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:13 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d5389bec-8be5-468d-87de-42c98935755c tempest-VolumesSnapshotTestJSON-623931556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1130459863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57469620-a163-4893-a513-db44591fad2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0294cc0ede470b950accb5d195d50e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:49:08Z,use_quota=True,user_id='2c50e2a2615142c586667b4535fb0307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:49:13 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-d5389bec-8be5-468d-87de-42c98935755c tempest-VolumesSnapshotTestJSON-623931556 None] Creating volume 57469620-a163-4893-a513-db44591fad2a {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:49:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d5389bec-8be5-468d-87de-42c98935755c tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d5389bec-8be5-468d-87de-42c98935755c tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:13 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d5389bec-8be5-468d-87de-42c98935755c tempest-VolumesSnapshotTestJSON-623931556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:49:13 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d5389bec-8be5-468d-87de-42c98935755c tempest-VolumesSnapshotTestJSON-623931556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:49:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d5389bec-8be5-468d-87de-42c98935755c tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:13 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d5389bec-8be5-468d-87de-42c98935755c tempest-VolumesSnapshotTestJSON-623931556 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:49:13 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-d5389bec-8be5-468d-87de-42c98935755c tempest-VolumesSnapshotTestJSON-623931556 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:49:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d5389bec-8be5-468d-87de-42c98935755c tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:13 devstack sudo[100612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a 1073741824 Sep 10 16:49:13 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6c45c885-56f8-4943-94de-7e9417e7c13f tempest-VolumesMetadataTest-1718597424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fede8b63-8939-44e3-80ee-450dcb364581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94a57a0a-a551-4e6d-b4f9-84c5b908b681', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:13 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:13 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6c45c885-56f8-4943-94de-7e9417e7c13f tempest-VolumesMetadataTest-1718597424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b945e4-9fb7-4729-a7ca-8e424795532a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:13 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-6c45c885-56f8-4943-94de-7e9417e7c13f tempest-VolumesMetadataTest-1718597424 None] Volume volume-94a57a0a-a551-4e6d-b4f9-84c5b908b681 (94a57a0a-a551-4e6d-b4f9-84c5b908b681): created successfully Sep 10 16:49:13 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6c45c885-56f8-4943-94de-7e9417e7c13f tempest-VolumesMetadataTest-1718597424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b945e4-9fb7-4729-a7ca-8e424795532a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:13 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6c45c885-56f8-4943-94de-7e9417e7c13f tempest-VolumesMetadataTest-1718597424 None] Flow 'volume_create_manager' (8451c936-96f5-4167-a2e7-5455ae17885e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:49:13 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-6c45c885-56f8-4943-94de-7e9417e7c13f tempest-VolumesMetadataTest-1718597424 None] Created volume successfully. Sep 10 16:49:13 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d5389bec-8be5-468d-87de-42c98935755c tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a 1073741824" returned: 0 in 0.613s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d5389bec-8be5-468d-87de-42c98935755c tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:13 devstack sudo[100618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a Sep 10 16:49:13 devstack sudo[100618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:13 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c4d20ef6-4038-4fad-b543-54b338a8e252 tempest-GroupSnapshotsTest-816808975 None] Acquiring lock "cinder-quobyte-f6bdb8bb-57b9-46a1-af33-e5ac0e9149bd" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:49:13 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c4d20ef6-4038-4fad-b543-54b338a8e252 tempest-GroupSnapshotsTest-816808975 None] Lock "cinder-quobyte-f6bdb8bb-57b9-46a1-af33-e5ac0e9149bd" acquired by "delete_volume" :: waited 0.062s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:49:14 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba6be9c-bdc5-4fef-9500-880cdf348f83]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c4d20ef6-4038-4fad-b543-54b338a8e252 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f6bdb8bb-57b9-46a1-af33-e5ac0e9149bd {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:14 devstack sudo[100618]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d5389bec-8be5-468d-87de-42c98935755c tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a" returned: 0 in 0.394s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:14 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d5389bec-8be5-468d-87de-42c98935755c tempest-VolumesSnapshotTestJSON-623931556 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:49:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d5389bec-8be5-468d-87de-42c98935755c tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:14 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d5389bec-8be5-468d-87de-42c98935755c tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5a8d165-8258-4026-b654-5519e9371597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57469620-a163-4893-a513-db44591fad2a', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:14 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d5389bec-8be5-468d-87de-42c98935755c tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f912c391-ea07-4f96-ad64-eb01aa789b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:14 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f6bdb8bb-57b9-46a1-af33-e5ac0e9149bd Sep 10 16:49:14 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:14 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-d5389bec-8be5-468d-87de-42c98935755c tempest-VolumesSnapshotTestJSON-623931556 None] Volume volume-57469620-a163-4893-a513-db44591fad2a (57469620-a163-4893-a513-db44591fad2a): created successfully Sep 10 16:49:14 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d5389bec-8be5-468d-87de-42c98935755c tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f912c391-ea07-4f96-ad64-eb01aa789b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:14 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d5389bec-8be5-468d-87de-42c98935755c tempest-VolumesSnapshotTestJSON-623931556 None] Flow 'volume_create_manager' (1ee33b6a-35dd-4460-9f47-58f093cb528a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:49:14 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-d5389bec-8be5-468d-87de-42c98935755c tempest-VolumesSnapshotTestJSON-623931556 None] Created volume successfully. Sep 10 16:49:14 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c4d20ef6-4038-4fad-b543-54b338a8e252 tempest-GroupSnapshotsTest-816808975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f6bdb8bb-57b9-46a1-af33-e5ac0e9149bd" returned: 0 in 0.477s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c4d20ef6-4038-4fad-b543-54b338a8e252 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f6bdb8bb-57b9-46a1-af33-e5ac0e9149bd {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:14 devstack sudo[100626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f6bdb8bb-57b9-46a1-af33-e5ac0e9149bd Sep 10 16:49:14 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:14 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2c20f78e-c388-4c04-9174-a49c96875d53 tempest-VolumesMetadataTest-1718597424 None] Acquiring lock "cinder-94a57a0a-a551-4e6d-b4f9-84c5b908b681-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:49:14 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2c20f78e-c388-4c04-9174-a49c96875d53 tempest-VolumesMetadataTest-1718597424 None] Lock "cinder-94a57a0a-a551-4e6d-b4f9-84c5b908b681-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:49:14 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2c20f78e-c388-4c04-9174-a49c96875d53 tempest-VolumesMetadataTest-1718597424 None] Acquiring lock "cinder-quobyte-94a57a0a-a551-4e6d-b4f9-84c5b908b681" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:49:14 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2c20f78e-c388-4c04-9174-a49c96875d53 tempest-VolumesMetadataTest-1718597424 None] Lock "cinder-quobyte-94a57a0a-a551-4e6d-b4f9-84c5b908b681" acquired by "delete_volume" :: waited 0.026s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:49:14 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2308ba-e8fb-42dd-8bf3-0cfbf32d4461]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2c20f78e-c388-4c04-9174-a49c96875d53 tempest-VolumesMetadataTest-1718597424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94a57a0a-a551-4e6d-b4f9-84c5b908b681 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:14 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c4d20ef6-4038-4fad-b543-54b338a8e252 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f6bdb8bb-57b9-46a1-af33-e5ac0e9149bd" returned: 0 in 0.357s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:14 devstack sudo[100628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94a57a0a-a551-4e6d-b4f9-84c5b908b681 Sep 10 16:49:14 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:14 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c4d20ef6-4038-4fad-b543-54b338a8e252 tempest-GroupSnapshotsTest-816808975 None] Lock "cinder-quobyte-f6bdb8bb-57b9-46a1-af33-e5ac0e9149bd" released by "delete_volume" :: held 0.926s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:15 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-c4d20ef6-4038-4fad-b543-54b338a8e252 tempest-GroupSnapshotsTest-816808975 None] Created reservations ['76dc539f-f5cb-40d0-80ff-8a118fec0aa6'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:49:15 devstack cinder-volume[88189]: WARNING cinder.quota [None req-c4d20ef6-4038-4fad-b543-54b338a8e252 tempest-GroupSnapshotsTest-816808975 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1100741687 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1100741687, it is now deprecated. Please use the default quota class for default quota. Sep 10 16:49:15 devstack cinder-volume[88189]: WARNING cinder.quota [None req-c4d20ef6-4038-4fad-b543-54b338a8e252 tempest-GroupSnapshotsTest-816808975 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1100741687 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1100741687, it is now deprecated. Please use the default quota class for default quota. Sep 10 16:49:15 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-c4d20ef6-4038-4fad-b543-54b338a8e252 tempest-GroupSnapshotsTest-816808975 None] Created reservations ['eb27225d-7799-43ea-a77b-628fe670c03d', '7b312b66-4cfe-4b26-a792-3d1d371018d2', 'cd983114-82a6-497e-a3ad-508936407d0d', '538b85dd-8be8-4ba1-a046-a1a364fb0813'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:49:15 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2c20f78e-c388-4c04-9174-a49c96875d53 tempest-VolumesMetadataTest-1718597424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94a57a0a-a551-4e6d-b4f9-84c5b908b681" returned: 0 in 0.587s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2c20f78e-c388-4c04-9174-a49c96875d53 tempest-VolumesMetadataTest-1718597424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94a57a0a-a551-4e6d-b4f9-84c5b908b681 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-52ef45dc-f23d-4d29-b8ac-0a7527e20f9c tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-52ef45dc-f23d-4d29-b8ac-0a7527e20f9c tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:15 devstack sudo[100634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94a57a0a-a551-4e6d-b4f9-84c5b908b681 Sep 10 16:49:15 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c4d20ef6-4038-4fad-b543-54b338a8e252 tempest-GroupSnapshotsTest-816808975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c4d20ef6-4038-4fad-b543-54b338a8e252 tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c4d20ef6-4038-4fad-b543-54b338a8e252 tempest-GroupSnapshotsTest-816808975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:49:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c4d20ef6-4038-4fad-b543-54b338a8e252 tempest-GroupSnapshotsTest-816808975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:49:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c4d20ef6-4038-4fad-b543-54b338a8e252 tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c4d20ef6-4038-4fad-b543-54b338a8e252 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-52ef45dc-f23d-4d29-b8ac-0a7527e20f9c tempest-VolumesSnapshotTestJSON-623931556 None] Creating offline snapshot 8e070002-7ee9-416a-a8da-9447cae0b0b0 of volume 57469620-a163-4893-a513-db44591fad2a {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:49:15 devstack sudo[100636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:49:15 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[509247ab-61cd-4aff-9f38-c78c7cd775b6]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-52ef45dc-f23d-4d29-b8ac-0a7527e20f9c tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:15 devstack sudo[100636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:15 devstack sudo[100638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a Sep 10 16:49:15 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:15 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2c20f78e-c388-4c04-9174-a49c96875d53 tempest-VolumesMetadataTest-1718597424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94a57a0a-a551-4e6d-b4f9-84c5b908b681" returned: 0 in 0.325s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:15 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2c20f78e-c388-4c04-9174-a49c96875d53 tempest-VolumesMetadataTest-1718597424 None] Lock "cinder-quobyte-94a57a0a-a551-4e6d-b4f9-84c5b908b681" released by "delete_volume" :: held 0.976s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:15 devstack sudo[100636]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c4d20ef6-4038-4fad-b543-54b338a8e252 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.349s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:15 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-c4d20ef6-4038-4fad-b543-54b338a8e252 tempest-GroupSnapshotsTest-816808975 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:49:15 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-2c20f78e-c388-4c04-9174-a49c96875d53 tempest-VolumesMetadataTest-1718597424 None] Created reservations ['7b69eb92-0496-408b-a9ce-dcd97701092d', 'a97b83c5-01ec-42f6-a934-12da14cc59ec', '0c9d2693-3553-4d04-aa98-2595f1def3e6', 'ce44768f-d2e8-4f49-b8c7-33d186fc4b1b'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:49:15 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-c4d20ef6-4038-4fad-b543-54b338a8e252 tempest-GroupSnapshotsTest-816808975 None] Delete group completed successfully. Sep 10 16:49:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2c20f78e-c388-4c04-9174-a49c96875d53 tempest-VolumesMetadataTest-1718597424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2c20f78e-c388-4c04-9174-a49c96875d53 tempest-VolumesMetadataTest-1718597424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-2c20f78e-c388-4c04-9174-a49c96875d53 tempest-VolumesMetadataTest-1718597424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:49:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-2c20f78e-c388-4c04-9174-a49c96875d53 tempest-VolumesMetadataTest-1718597424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:49:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2c20f78e-c388-4c04-9174-a49c96875d53 tempest-VolumesMetadataTest-1718597424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2c20f78e-c388-4c04-9174-a49c96875d53 tempest-VolumesMetadataTest-1718597424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:15 devstack sudo[100642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:49:15 devstack sudo[100642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:15 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-52ef45dc-f23d-4d29-b8ac-0a7527e20f9c tempest-VolumesSnapshotTestJSON-623931556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a" returned: 0 in 0.473s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-52ef45dc-f23d-4d29-b8ac-0a7527e20f9c tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a.8e070002-7ee9-416a-a8da-9447cae0b0b0 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:15 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a.8e070002-7ee9-416a-a8da-9447cae0b0b0 1G Sep 10 16:49:15 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:16 devstack sudo[100642]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2c20f78e-c388-4c04-9174-a49c96875d53 tempest-VolumesMetadataTest-1718597424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.289s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:16 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-2c20f78e-c388-4c04-9174-a49c96875d53 tempest-VolumesMetadataTest-1718597424 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:49:16 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-2c20f78e-c388-4c04-9174-a49c96875d53 tempest-VolumesMetadataTest-1718597424 None] Deleted volume successfully. Sep 10 16:49:16 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2c20f78e-c388-4c04-9174-a49c96875d53 tempest-VolumesMetadataTest-1718597424 None] Lock "cinder-94a57a0a-a551-4e6d-b4f9-84c5b908b681-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:16 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-52ef45dc-f23d-4d29-b8ac-0a7527e20f9c tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a.8e070002-7ee9-416a-a8da-9447cae0b0b0 1G" returned: 0 in 0.426s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-52ef45dc-f23d-4d29-b8ac-0a7527e20f9c tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57469620-a163-4893-a513-db44591fad2a -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a.8e070002-7ee9-416a-a8da-9447cae0b0b0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:16 devstack sudo[100654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57469620-a163-4893-a513-db44591fad2a -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a.8e070002-7ee9-416a-a8da-9447cae0b0b0 Sep 10 16:49:16 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:16 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-6ebf1510-ef0c-4e67-bb1a-0713e6dba0f9 tempest-GroupSnapshotsTest-816808975 None] group_snapshot 3b9031a7-f180-4c94-86c0-ce1fc0e4e717: deleting Sep 10 16:49:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6ebf1510-ef0c-4e67-bb1a-0713e6dba0f9 tempest-GroupSnapshotsTest-816808975 None] group_snapshot 3b9031a7-f180-4c94-86c0-ce1fc0e4e717: deleting {{(pid=88189) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 10 16:49:16 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6ebf1510-ef0c-4e67-bb1a-0713e6dba0f9 tempest-GroupSnapshotsTest-816808975 None] Acquiring lock "cinder-quobyte-948a0a77-c42f-4a97-a28b-232a4db0979d" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:49:16 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6ebf1510-ef0c-4e67-bb1a-0713e6dba0f9 tempest-GroupSnapshotsTest-816808975 None] Lock "cinder-quobyte-948a0a77-c42f-4a97-a28b-232a4db0979d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:49:16 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6ebf1510-ef0c-4e67-bb1a-0713e6dba0f9 tempest-GroupSnapshotsTest-816808975 None] Acquiring lock "cinder-quobyte-3cfe1ffd-ca5b-45ce-9b0f-748ec7f716d7" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:49:16 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6ebf1510-ef0c-4e67-bb1a-0713e6dba0f9 tempest-GroupSnapshotsTest-816808975 None] Lock "cinder-quobyte-3cfe1ffd-ca5b-45ce-9b0f-748ec7f716d7" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:49:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-6ebf1510-ef0c-4e67-bb1a-0713e6dba0f9 tempest-GroupSnapshotsTest-816808975 None] Deleting offline snapshot 3cfe1ffd-ca5b-45ce-9b0f-748ec7f716d7 of volume 948a0a77-c42f-4a97-a28b-232a4db0979d {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:49:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-6ebf1510-ef0c-4e67-bb1a-0713e6dba0f9 tempest-GroupSnapshotsTest-816808975 None] snapshot_file for this snap is: volume-948a0a77-c42f-4a97-a28b-232a4db0979d.3cfe1ffd-ca5b-45ce-9b0f-748ec7f716d7 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:49:16 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2f6204-bed6-4893-b701-00463775eee4]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ebf1510-ef0c-4e67-bb1a-0713e6dba0f9 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d.3cfe1ffd-ca5b-45ce-9b0f-748ec7f716d7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:16 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-52ef45dc-f23d-4d29-b8ac-0a7527e20f9c tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57469620-a163-4893-a513-db44591fad2a -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a.8e070002-7ee9-416a-a8da-9447cae0b0b0" returned: 0 in 0.371s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:16 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-52ef45dc-f23d-4d29-b8ac-0a7527e20f9c tempest-VolumesSnapshotTestJSON-623931556 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a.8e070002-7ee9-416a-a8da-9447cae0b0b0 is being set with open permissions: ugo+rw Sep 10 16:49:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-52ef45dc-f23d-4d29-b8ac-0a7527e20f9c tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a.8e070002-7ee9-416a-a8da-9447cae0b0b0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:16 devstack sudo[100658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d.3cfe1ffd-ca5b-45ce-9b0f-748ec7f716d7 Sep 10 16:49:16 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:16 devstack sudo[100660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a.8e070002-7ee9-416a-a8da-9447cae0b0b0 Sep 10 16:49:16 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:17 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-52ef45dc-f23d-4d29-b8ac-0a7527e20f9c tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a.8e070002-7ee9-416a-a8da-9447cae0b0b0" returned: 0 in 0.282s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:17 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ebf1510-ef0c-4e67-bb1a-0713e6dba0f9 tempest-GroupSnapshotsTest-816808975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d.3cfe1ffd-ca5b-45ce-9b0f-748ec7f716d7" returned: 0 in 0.440s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-6ebf1510-ef0c-4e67-bb1a-0713e6dba0f9 tempest-GroupSnapshotsTest-816808975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-948a0a77-c42f-4a97-a28b-232a4db0979d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:49:17 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f33f10-2beb-4080-bd64-fdfb728088a9]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ebf1510-ef0c-4e67-bb1a-0713e6dba0f9 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-52ef45dc-f23d-4d29-b8ac-0a7527e20f9c tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:17 devstack sudo[100669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a.info Sep 10 16:49:17 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:17 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d Sep 10 16:49:17 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:17 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-52ef45dc-f23d-4d29-b8ac-0a7527e20f9c tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a.info" returned: 0 in 0.332s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:17 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-52ef45dc-f23d-4d29-b8ac-0a7527e20f9c tempest-VolumesSnapshotTestJSON-623931556 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a.info is being set with open permissions: ugo+rw Sep 10 16:49:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-52ef45dc-f23d-4d29-b8ac-0a7527e20f9c tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:17 devstack sudo[100675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a.info Sep 10 16:49:17 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:17 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ebf1510-ef0c-4e67-bb1a-0713e6dba0f9 tempest-GroupSnapshotsTest-816808975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d" returned: 0 in 0.649s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ebf1510-ef0c-4e67-bb1a-0713e6dba0f9 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d.3cfe1ffd-ca5b-45ce-9b0f-748ec7f716d7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:17 devstack sudo[100679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d.3cfe1ffd-ca5b-45ce-9b0f-748ec7f716d7 Sep 10 16:49:17 devstack sudo[100679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:17 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-52ef45dc-f23d-4d29-b8ac-0a7527e20f9c tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a.info" returned: 0 in 0.338s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-52ef45dc-f23d-4d29-b8ac-0a7527e20f9c tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.418s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:17 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:UPDATE=161,cinder:SELECT=136,cinder:DELETE=12,cinder:INSERT=41 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:49:17 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-52ef45dc-f23d-4d29-b8ac-0a7527e20f9c tempest-VolumesSnapshotTestJSON-623931556 None] Create snapshot completed successfully Sep 10 16:49:18 devstack sudo[100679]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ebf1510-ef0c-4e67-bb1a-0713e6dba0f9 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d.3cfe1ffd-ca5b-45ce-9b0f-748ec7f716d7" returned: 0 in 0.424s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ebf1510-ef0c-4e67-bb1a-0713e6dba0f9 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d.3cfe1ffd-ca5b-45ce-9b0f-748ec7f716d7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:18 devstack sudo[100684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d.3cfe1ffd-ca5b-45ce-9b0f-748ec7f716d7 Sep 10 16:49:18 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:18 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6ebf1510-ef0c-4e67-bb1a-0713e6dba0f9 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d.3cfe1ffd-ca5b-45ce-9b0f-748ec7f716d7" returned: 0 in 0.285s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:18 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6ebf1510-ef0c-4e67-bb1a-0713e6dba0f9 tempest-GroupSnapshotsTest-816808975 None] Lock "cinder-quobyte-3cfe1ffd-ca5b-45ce-9b0f-748ec7f716d7" released by "_delete_snapshot" :: held 1.934s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:18 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6ebf1510-ef0c-4e67-bb1a-0713e6dba0f9 tempest-GroupSnapshotsTest-816808975 None] Lock "cinder-quobyte-948a0a77-c42f-4a97-a28b-232a4db0979d" released by "delete_snapshot" :: held 1.964s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:18 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=150,cinder:UPDATE=160,cinder:INSERT=36,cinder:DELETE=12 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:49:18 devstack cinder-volume[88189]: WARNING cinder.quota [None req-6ebf1510-ef0c-4e67-bb1a-0713e6dba0f9 tempest-GroupSnapshotsTest-816808975 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1100741687 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1100741687, it is now deprecated. Please use the default quota class for default quota. Sep 10 16:49:18 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-6ebf1510-ef0c-4e67-bb1a-0713e6dba0f9 tempest-GroupSnapshotsTest-816808975 None] Created reservations ['4a18a15d-297c-4af2-88bc-407ea85a0acb', '4b359de9-ce28-4213-a87c-b997dfe508f6', 'e4269397-0732-445d-bca3-3cb7b3dac6c1', 'e0de76ca-873c-4f88-8327-c924a8efa180'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:49:18 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-6ebf1510-ef0c-4e67-bb1a-0713e6dba0f9 tempest-GroupSnapshotsTest-816808975 None] group_snapshot 3b9031a7-f180-4c94-86c0-ce1fc0e4e717: deleted successfully Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Flow 'volume_create_manager' (993a239b-eac6-405c-aa1d-d36e196c82a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c33890f-e205-400c-97e7-a22f05655edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-485ce904-65ad-4c6f-a5af-80a8012d5222 tempest-GroupSnapshotsTest-816808975 None] Acquiring lock "cinder-quobyte-948a0a77-c42f-4a97-a28b-232a4db0979d" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c33890f-e205-400c-97e7-a22f05655edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1560855936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=654f481e-2a14-4228-8e7b-c2a3dd88ed5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0294cc0ede470b950accb5d195d50e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8e070002-7ee9-416a-a8da-9447cae0b0b0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:49:19Z,use_quota=True,user_id='2c50e2a2615142c586667b4535fb0307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a124b2f-c272-46cd-96d2-ac8d3dbe867e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a124b2f-c272-46cd-96d2-ac8d3dbe867e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c09991d6-ab38-4776-aacb-056c0e64a69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c09991d6-ab38-4776-aacb-056c0e64a69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '654f481e-2a14-4228-8e7b-c2a3dd88ed5d', 'volume_name': 'volume-654f481e-2a14-4228-8e7b-c2a3dd88ed5d', 'volume_size': 1, 'snapshot_id': '8e070002-7ee9-416a-a8da-9447cae0b0b0'}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd3b2f6-6b3c-45c2-8966-97dce8789340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd3b2f6-6b3c-45c2-8966-97dce8789340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c713b71-b9d4-489f-9359-21ef802b7398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:19 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Volume 654f481e-2a14-4228-8e7b-c2a3dd88ed5d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-654f481e-2a14-4228-8e7b-c2a3dd88ed5d', 'volume_size': 1, 'snapshot_id': '8e070002-7ee9-416a-a8da-9447cae0b0b0'} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "cinder-quobyte-8e070002-7ee9-416a-a8da-9447cae0b0b0-654f481e-2a14-4228-8e7b-c2a3dd88ed5d" by "_create_volume_from_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-485ce904-65ad-4c6f-a5af-80a8012d5222 tempest-GroupSnapshotsTest-816808975 None] Lock "cinder-quobyte-948a0a77-c42f-4a97-a28b-232a4db0979d" acquired by "delete_volume" :: waited 0.066s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-quobyte-8e070002-7ee9-416a-a8da-9447cae0b0b0-654f481e-2a14-4228-8e7b-c2a3dd88ed5d" acquired by "_create_volume_from_snapshot" :: waited 0.058s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Creating volume 654f481e-2a14-4228-8e7b-c2a3dd88ed5d from snapshot 8e070002-7ee9-416a-a8da-9447cae0b0b0 {{(pid=88189) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "cinder-quobyte-654f481e-2a14-4228-8e7b-c2a3dd88ed5d" by "_copy_volume_from_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9336c342-a28f-4206-95c8-466d3202fc7c]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-485ce904-65ad-4c6f-a5af-80a8012d5222 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-quobyte-654f481e-2a14-4228-8e7b-c2a3dd88ed5d" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] snapshot: 8e070002-7ee9-416a-a8da-9447cae0b0b0, volume: 654f481e-2a14-4228-8e7b-c2a3dd88ed5d, {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f84a61a-9ec1-422d-a68f-9857e7ea3e25]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a.8e070002-7ee9-416a-a8da-9447cae0b0b0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:19 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d Sep 10 16:49:19 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:19 devstack sudo[100688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a.8e070002-7ee9-416a-a8da-9447cae0b0b0 Sep 10 16:49:19 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:19 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-485ce904-65ad-4c6f-a5af-80a8012d5222 tempest-GroupSnapshotsTest-816808975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d" returned: 0 in 0.455s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-485ce904-65ad-4c6f-a5af-80a8012d5222 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:19 devstack sudo[100696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d Sep 10 16:49:19 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:19 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a.8e070002-7ee9-416a-a8da-9447cae0b0b0" returned: 0 in 0.464s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57469620-a163-4893-a513-db44591fad2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e04e6e-9897-499c-86e4-9ec002620241]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:20 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a Sep 10 16:49:20 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:20 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-485ce904-65ad-4c6f-a5af-80a8012d5222 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-948a0a77-c42f-4a97-a28b-232a4db0979d" returned: 0 in 0.315s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:20 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-485ce904-65ad-4c6f-a5af-80a8012d5222 tempest-GroupSnapshotsTest-816808975 None] Lock "cinder-quobyte-948a0a77-c42f-4a97-a28b-232a4db0979d" released by "delete_volume" :: held 0.870s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:20 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-485ce904-65ad-4c6f-a5af-80a8012d5222 tempest-GroupSnapshotsTest-816808975 None] Created reservations ['52619d74-4218-4fd5-ab87-5cf619c2d9e3'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:49:20 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:49:20 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Flow 'volume_create_manager' (d65fdb20-1d53-4019-909b-c26b58c59ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:49:20 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (212e6be7-42fd-4f15-b1d0-7ea9220e1ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:20 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (212e6be7-42fd-4f15-b1d0-7ea9220e1ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1267316135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98fadc22-cde4-49bd-9fc0-28a2bf681692,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e40242705d46402e9fba5da1d4abd71c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:49:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:49:20Z,use_quota=True,user_id='84413e2c1e104252bd0e593fc017c912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:20 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab570982-6de0-4269-ae37-33589b2e1d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:20 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab570982-6de0-4269-ae37-33589b2e1d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:20 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (924b7aa5-8fc0-4ce7-89b2-cf5379b29722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:20 devstack cinder-volume[88189]: DEBUG cinder.image.glance [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Creating Keystone auth plugin from conf {{(pid=88189) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 16:49:20 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a" returned: 0 in 0.435s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:20 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] will copy from snapshot at /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 16:49:20 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Creating direct copy from snapshot {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 16:49:20 devstack cinder-volume[88189]: DEBUG cinder.utils [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Path /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-654f481e-2a14-4228-8e7b-c2a3dd88ed5d not found in is_blk_device check {{(pid=88189) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 16:49:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-654f481e-2a14-4228-8e7b-c2a3dd88ed5d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:20 devstack sudo[100707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-654f481e-2a14-4228-8e7b-c2a3dd88ed5d Sep 10 16:49:20 devstack sudo[100707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:20 devstack cinder-volume[88189]: WARNING cinder.db.api [None req-485ce904-65ad-4c6f-a5af-80a8012d5222 tempest-GroupSnapshotsTest-816808975 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1100741687'] Sep 10 16:49:20 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-485ce904-65ad-4c6f-a5af-80a8012d5222 tempest-GroupSnapshotsTest-816808975 None] Created reservations ['023a775d-6a5a-46ff-baec-aaf16a5b2041', 'c7720d1f-2841-492b-bb58-47148a543156', '9aac634e-64f6-4fb9-90bd-7699d830192c', '80974518-91e4-4e16-b288-fc58b52a82a2'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:49:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-485ce904-65ad-4c6f-a5af-80a8012d5222 tempest-GroupSnapshotsTest-816808975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-485ce904-65ad-4c6f-a5af-80a8012d5222 tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:20 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-485ce904-65ad-4c6f-a5af-80a8012d5222 tempest-GroupSnapshotsTest-816808975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:49:20 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-485ce904-65ad-4c6f-a5af-80a8012d5222 tempest-GroupSnapshotsTest-816808975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:49:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-485ce904-65ad-4c6f-a5af-80a8012d5222 tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-485ce904-65ad-4c6f-a5af-80a8012d5222 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:20 devstack sudo[100709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:49:20 devstack sudo[100709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:20 devstack sudo[100709]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-485ce904-65ad-4c6f-a5af-80a8012d5222 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.323s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:20 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-485ce904-65ad-4c6f-a5af-80a8012d5222 tempest-GroupSnapshotsTest-816808975 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:49:20 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-485ce904-65ad-4c6f-a5af-80a8012d5222 tempest-GroupSnapshotsTest-816808975 None] Delete group completed successfully. Sep 10 16:49:21 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (924b7aa5-8fc0-4ce7-89b2-cf5379b29722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '98fadc22-cde4-49bd-9fc0-28a2bf681692', 'volume_name': 'volume-98fadc22-cde4-49bd-9fc0-28a2bf681692', 'volume_size': 1, 'image_id': '5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dbb77788940a4d64b2cf7dbf5431f2a1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'created_at': datetime.datetime(2026, 9, 10, 14, 32, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 14, 32, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:21 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d386887-683d-48cc-922e-a242e3aeafab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:21 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d386887-683d-48cc-922e-a242e3aeafab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:21 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b586950a-f022-4f79-a02d-93b3703d9f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:21 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Volume 98fadc22-cde4-49bd-9fc0-28a2bf681692: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-98fadc22-cde4-49bd-9fc0-28a2bf681692', 'volume_size': 1, 'image_id': '5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dbb77788940a4d64b2cf7dbf5431f2a1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'created_at': datetime.datetime(2026, 9, 10, 14, 32, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 14, 32, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 16:49:21 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Trying to clone 98fadc22-cde4-49bd-9fc0-28a2bf681692 from image 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'metadata': {}}]). {{(pid=88189) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 16:49:21 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_js_whx8zdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88189) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 16:49:21 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Image download 20.69 MB at 20.69 MB/s Sep 10 16:49:21 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3244f60-60e8-4b35-b066-2f4e159ea1c3]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_js_whx8zdevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:22 devstack sudo[100723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_js_whx8zdevstack@QuobyteHD Sep 10 16:49:22 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:22 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-b102c464-1cbd-4e11-9d74-7dc10ba22094 tempest-GroupSnapshotsTest-816808975 None] Group tempest-GroupSnapshotsTest-Group-1438715698: creating Sep 10 16:49:23 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-b102c464-1cbd-4e11-9d74-7dc10ba22094 tempest-GroupSnapshotsTest-816808975 None] Group tempest-GroupSnapshotsTest-Group-1438715698: created successfully Sep 10 16:49:23 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-b102c464-1cbd-4e11-9d74-7dc10ba22094 tempest-GroupSnapshotsTest-816808975 None] Create group completed successfully. Sep 10 16:49:23 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_js_whx8zdevstack@QuobyteHD" returned: 0 in 1.160s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:23 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Temporary image 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 is fetched for user 84413e2c1e104252bd0e593fc017c912. {{(pid=88189) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 16:49:23 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42a1f24-927e-42bb-9d58-c0c35421949f]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_js_whx8zdevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:23 devstack sudo[100728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_js_whx8zdevstack@QuobyteHD Sep 10 16:49:23 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:24 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_js_whx8zdevstack@QuobyteHD" returned: 0 in 1.271s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:25 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-809abf64-0cfa-4282-aa1a-7c8d1bfaac1a tempest-GroupSnapshotsTest-816808975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:49:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-809abf64-0cfa-4282-aa1a-7c8d1bfaac1a tempest-GroupSnapshotsTest-816808975 None] Flow 'volume_create_manager' (685a2c0c-3234-468c-aaa6-4e6b53fece10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:49:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-809abf64-0cfa-4282-aa1a-7c8d1bfaac1a tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c80df9e7-ac49-42ca-af52-79550a3feb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-809abf64-0cfa-4282-aa1a-7c8d1bfaac1a tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c80df9e7-ac49-42ca-af52-79550a3feb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-887250788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=29103afa-6f2a-4fea-b499-9db642f8160b,host='devstack@QuobyteHD#QuobyteHD',id=cde73cca-af08-4ec9-aa08-98a7eab674b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db7640a88dee43a0adaf652df2e8f4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:49:26Z,use_quota=True,user_id='db5cc2cff9be401f8716a3989358ac94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1329a701-0d2c-42fb-8d07-b72af3828050),volume_type_id=1329a701-0d2c-42fb-8d07-b72af3828050)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-809abf64-0cfa-4282-aa1a-7c8d1bfaac1a tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4c8aab-7cbc-403d-ad9b-eda8d13b2b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-809abf64-0cfa-4282-aa1a-7c8d1bfaac1a tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4c8aab-7cbc-403d-ad9b-eda8d13b2b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-809abf64-0cfa-4282-aa1a-7c8d1bfaac1a tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5ee775c-910f-4526-8721-6a72d722843b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-809abf64-0cfa-4282-aa1a-7c8d1bfaac1a tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5ee775c-910f-4526-8721-6a72d722843b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cde73cca-af08-4ec9-aa08-98a7eab674b9', 'volume_name': 'volume-cde73cca-af08-4ec9-aa08-98a7eab674b9', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-809abf64-0cfa-4282-aa1a-7c8d1bfaac1a tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f92aa5-2aea-4986-a4a1-8e95604fe1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-809abf64-0cfa-4282-aa1a-7c8d1bfaac1a tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f92aa5-2aea-4986-a4a1-8e95604fe1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-809abf64-0cfa-4282-aa1a-7c8d1bfaac1a tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (209eae81-494b-468c-9da1-a83fd0a9709f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:26 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-809abf64-0cfa-4282-aa1a-7c8d1bfaac1a tempest-GroupSnapshotsTest-816808975 None] Volume cde73cca-af08-4ec9-aa08-98a7eab674b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cde73cca-af08-4ec9-aa08-98a7eab674b9', 'volume_size': 1} Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-809abf64-0cfa-4282-aa1a-7c8d1bfaac1a tempest-GroupSnapshotsTest-816808975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:26 devstack sudo[100707]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-654f481e-2a14-4228-8e7b-c2a3dd88ed5d" returned: 0 in 5.775s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Image conversion details: src /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a, size 1024.00 MB, duration 5.78 sec, destination /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-654f481e-2a14-4228-8e7b-c2a3dd88ed5d {{(pid=88189) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 16:49:26 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Converted 1024.00 MB image at 177.29 MB/s Sep 10 16:49:26 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-654f481e-2a14-4228-8e7b-c2a3dd88ed5d is being set with open permissions: ugo+rw Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-654f481e-2a14-4228-8e7b-c2a3dd88ed5d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:26 devstack sudo[100741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-654f481e-2a14-4228-8e7b-c2a3dd88ed5d Sep 10 16:49:26 devstack sudo[100741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:26 devstack sudo[100741]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-654f481e-2a14-4228-8e7b-c2a3dd88ed5d" returned: 0 in 0.249s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-quobyte-654f481e-2a14-4228-8e7b-c2a3dd88ed5d" released by "_copy_volume_from_snapshot" :: held 7.030s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-quobyte-8e070002-7ee9-416a-a8da-9447cae0b0b0-654f481e-2a14-4228-8e7b-c2a3dd88ed5d" released by "_create_volume_from_snapshot" :: held 7.129s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.188s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.953s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1267316135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98fadc22-cde4-49bd-9fc0-28a2bf681692,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e40242705d46402e9fba5da1d4abd71c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:49:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:49:20Z,use_quota=True,user_id='84413e2c1e104252bd0e593fc017c912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Creating volume 98fadc22-cde4-49bd-9fc0-28a2bf681692 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:49:26 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-98fadc22-cde4-49bd-9fc0-28a2bf681692 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:26 devstack sudo[100744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-98fadc22-cde4-49bd-9fc0-28a2bf681692 1073741824 Sep 10 16:49:26 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c713b71-b9d4-489f-9359-21ef802b7398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-654f481e-2a14-4228-8e7b-c2a3dd88ed5d', 'volume_size': 1, 'snapshot_id': '8e070002-7ee9-416a-a8da-9447cae0b0b0'}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd19e96-e8e5-4bc7-b9dd-f06e5620550a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:26 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Volume volume-654f481e-2a14-4228-8e7b-c2a3dd88ed5d (654f481e-2a14-4228-8e7b-c2a3dd88ed5d): created successfully Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd19e96-e8e5-4bc7-b9dd-f06e5620550a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Flow 'volume_create_manager' (993a239b-eac6-405c-aa1d-d36e196c82a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:49:26 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-f826fc01-d603-4d53-89fc-caf46262fb8b tempest-VolumesSnapshotTestJSON-623931556 None] Created volume successfully. Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-5de320fb-48a2-4279-9e02-ac8b9b4004c2 tempest-VolumesTransfersV357Test-707676210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5de320fb-48a2-4279-9e02-ac8b9b4004c2 tempest-VolumesTransfersV357Test-707676210 None] Flow 'volume_create_manager' (d2fb2b75-ba18-4c9c-9351-c1a669bc0c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5de320fb-48a2-4279-9e02-ac8b9b4004c2 tempest-VolumesTransfersV357Test-707676210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c68f6ad9-be38-4e51-945b-5b2c5ad3232c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5de320fb-48a2-4279-9e02-ac8b9b4004c2 tempest-VolumesTransfersV357Test-707676210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c68f6ad9-be38-4e51-945b-5b2c5ad3232c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-934061511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bf48dea-e414-4b4f-bd9e-5e0bb4517ab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14232d9aa05f4581a2d5c0a76c39c92a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:49:27Z,use_quota=True,user_id='bfe8337f5e1540c28c2471afcf8237c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5de320fb-48a2-4279-9e02-ac8b9b4004c2 tempest-VolumesTransfersV357Test-707676210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (543ee80b-1828-4c15-be58-6e87d37a6ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5de320fb-48a2-4279-9e02-ac8b9b4004c2 tempest-VolumesTransfersV357Test-707676210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (543ee80b-1828-4c15-be58-6e87d37a6ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5de320fb-48a2-4279-9e02-ac8b9b4004c2 tempest-VolumesTransfersV357Test-707676210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (505eafc0-f1f1-42bd-acca-101b0df4b72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5de320fb-48a2-4279-9e02-ac8b9b4004c2 tempest-VolumesTransfersV357Test-707676210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (505eafc0-f1f1-42bd-acca-101b0df4b72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bf48dea-e414-4b4f-bd9e-5e0bb4517ab3', 'volume_name': 'volume-6bf48dea-e414-4b4f-bd9e-5e0bb4517ab3', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5de320fb-48a2-4279-9e02-ac8b9b4004c2 tempest-VolumesTransfersV357Test-707676210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a40e6ff-cc11-472d-b77e-c454330d5cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5de320fb-48a2-4279-9e02-ac8b9b4004c2 tempest-VolumesTransfersV357Test-707676210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a40e6ff-cc11-472d-b77e-c454330d5cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5de320fb-48a2-4279-9e02-ac8b9b4004c2 tempest-VolumesTransfersV357Test-707676210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b68a15c-a7a0-4b02-9c5f-a9fdea130bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:26 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-5de320fb-48a2-4279-9e02-ac8b9b4004c2 tempest-VolumesTransfersV357Test-707676210 None] Volume 6bf48dea-e414-4b4f-bd9e-5e0bb4517ab3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bf48dea-e414-4b4f-bd9e-5e0bb4517ab3', 'volume_size': 1} Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5de320fb-48a2-4279-9e02-ac8b9b4004c2 tempest-VolumesTransfersV357Test-707676210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:26 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-98fadc22-cde4-49bd-9fc0-28a2bf681692 1073741824" returned: 0 in 0.410s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-98fadc22-cde4-49bd-9fc0-28a2bf681692 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:26 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-98fadc22-cde4-49bd-9fc0-28a2bf681692 Sep 10 16:49:26 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-951e3c66-4170-4367-beb1-f3e1a4bffa0a tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "cinder-654f481e-2a14-4228-8e7b-c2a3dd88ed5d-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-951e3c66-4170-4367-beb1-f3e1a4bffa0a tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-654f481e-2a14-4228-8e7b-c2a3dd88ed5d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-951e3c66-4170-4367-beb1-f3e1a4bffa0a tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "cinder-quobyte-654f481e-2a14-4228-8e7b-c2a3dd88ed5d" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-951e3c66-4170-4367-beb1-f3e1a4bffa0a tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-quobyte-654f481e-2a14-4228-8e7b-c2a3dd88ed5d" acquired by "delete_volume" :: waited 0.015s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[488d2ff2-8ce1-45cc-8348-7dc19c6de0ae]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-951e3c66-4170-4367-beb1-f3e1a4bffa0a tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-654f481e-2a14-4228-8e7b-c2a3dd88ed5d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:27 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-98fadc22-cde4-49bd-9fc0-28a2bf681692" returned: 0 in 0.247s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-809abf64-0cfa-4282-aa1a-7c8d1bfaac1a tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.134s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-809abf64-0cfa-4282-aa1a-7c8d1bfaac1a tempest-GroupSnapshotsTest-816808975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=29103afa-6f2a-4fea-b499-9db642f8160b,created_at=2026-09-10T14:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-887250788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=29103afa-6f2a-4fea-b499-9db642f8160b,host='devstack@QuobyteHD#QuobyteHD',id=cde73cca-af08-4ec9-aa08-98a7eab674b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db7640a88dee43a0adaf652df2e8f4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:49:26Z,use_quota=True,user_id='db5cc2cff9be401f8716a3989358ac94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1329a701-0d2c-42fb-8d07-b72af3828050),volume_type_id=1329a701-0d2c-42fb-8d07-b72af3828050)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-809abf64-0cfa-4282-aa1a-7c8d1bfaac1a tempest-GroupSnapshotsTest-816808975 None] Creating volume cde73cca-af08-4ec9-aa08-98a7eab674b9 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-809abf64-0cfa-4282-aa1a-7c8d1bfaac1a tempest-GroupSnapshotsTest-816808975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-809abf64-0cfa-4282-aa1a-7c8d1bfaac1a tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-809abf64-0cfa-4282-aa1a-7c8d1bfaac1a tempest-GroupSnapshotsTest-816808975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-809abf64-0cfa-4282-aa1a-7c8d1bfaac1a tempest-GroupSnapshotsTest-816808975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-809abf64-0cfa-4282-aa1a-7c8d1bfaac1a tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-809abf64-0cfa-4282-aa1a-7c8d1bfaac1a tempest-GroupSnapshotsTest-816808975 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:49:27 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-809abf64-0cfa-4282-aa1a-7c8d1bfaac1a tempest-GroupSnapshotsTest-816808975 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-809abf64-0cfa-4282-aa1a-7c8d1bfaac1a tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:27 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-654f481e-2a14-4228-8e7b-c2a3dd88ed5d Sep 10 16:49:27 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:27 devstack sudo[100754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9 1073741824 Sep 10 16:49:27 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG cinder.volume.volume_utils [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Attempting download of 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'metadata': {}}])) to volume 98fadc22-cde4-49bd-9fc0-28a2bf681692. {{(pid=88189) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e887ad-42cd-40e2-a8ea-a5131b797ed2]: (4, 'raw') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_3ij5_265 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:27 devstack sudo[100757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_3ij5_265 Sep 10 16:49:27 devstack sudo[100757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:27 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-951e3c66-4170-4367-beb1-f3e1a4bffa0a tempest-VolumesSnapshotTestJSON-623931556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-654f481e-2a14-4228-8e7b-c2a3dd88ed5d" returned: 0 in 0.382s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-951e3c66-4170-4367-beb1-f3e1a4bffa0a tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-654f481e-2a14-4228-8e7b-c2a3dd88ed5d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:27 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-654f481e-2a14-4228-8e7b-c2a3dd88ed5d Sep 10 16:49:27 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:27 devstack sudo[100757]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_3ij5_265" returned: 0 in 0.353s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_3ij5_265 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:27 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-809abf64-0cfa-4282-aa1a-7c8d1bfaac1a tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9 1073741824" returned: 0 in 0.484s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-809abf64-0cfa-4282-aa1a-7c8d1bfaac1a tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:27 devstack sudo[100772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9 Sep 10 16:49:27 devstack sudo[100772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:27 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-951e3c66-4170-4367-beb1-f3e1a4bffa0a tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-654f481e-2a14-4228-8e7b-c2a3dd88ed5d" returned: 0 in 0.284s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-951e3c66-4170-4367-beb1-f3e1a4bffa0a tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-quobyte-654f481e-2a14-4228-8e7b-c2a3dd88ed5d" released by "delete_volume" :: held 0.709s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:27 devstack sudo[100770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_3ij5_265 Sep 10 16:49:27 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-951e3c66-4170-4367-beb1-f3e1a4bffa0a tempest-VolumesSnapshotTestJSON-623931556 None] Created reservations ['78fc0223-4a62-4fec-b608-3e5543b6eabc', '1e9b9120-ce52-4ab0-aa14-8fa25df4ce93', 'b6c05ef1-0ec5-48b9-a938-4450d3f137cb', 'aa3ccc3b-29e8-456d-b836-5529b4b75c5f'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-951e3c66-4170-4367-beb1-f3e1a4bffa0a tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-951e3c66-4170-4367-beb1-f3e1a4bffa0a tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-951e3c66-4170-4367-beb1-f3e1a4bffa0a tempest-VolumesSnapshotTestJSON-623931556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-951e3c66-4170-4367-beb1-f3e1a4bffa0a tempest-VolumesSnapshotTestJSON-623931556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-951e3c66-4170-4367-beb1-f3e1a4bffa0a tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-951e3c66-4170-4367-beb1-f3e1a4bffa0a tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:27 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:49:27 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:28 devstack sudo[100772]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-809abf64-0cfa-4282-aa1a-7c8d1bfaac1a tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9" returned: 0 in 0.277s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-809abf64-0cfa-4282-aa1a-7c8d1bfaac1a tempest-GroupSnapshotsTest-816808975 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-809abf64-0cfa-4282-aa1a-7c8d1bfaac1a tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5de320fb-48a2-4279-9e02-ac8b9b4004c2 tempest-VolumesTransfersV357Test-707676210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.317s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-5de320fb-48a2-4279-9e02-ac8b9b4004c2 tempest-VolumesTransfersV357Test-707676210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-934061511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bf48dea-e414-4b4f-bd9e-5e0bb4517ab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14232d9aa05f4581a2d5c0a76c39c92a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:49:27Z,use_quota=True,user_id='bfe8337f5e1540c28c2471afcf8237c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-5de320fb-48a2-4279-9e02-ac8b9b4004c2 tempest-VolumesTransfersV357Test-707676210 None] Creating volume 6bf48dea-e414-4b4f-bd9e-5e0bb4517ab3 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5de320fb-48a2-4279-9e02-ac8b9b4004c2 tempest-VolumesTransfersV357Test-707676210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5de320fb-48a2-4279-9e02-ac8b9b4004c2 tempest-VolumesTransfersV357Test-707676210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-5de320fb-48a2-4279-9e02-ac8b9b4004c2 tempest-VolumesTransfersV357Test-707676210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-5de320fb-48a2-4279-9e02-ac8b9b4004c2 tempest-VolumesTransfersV357Test-707676210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5de320fb-48a2-4279-9e02-ac8b9b4004c2 tempest-VolumesTransfersV357Test-707676210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-5de320fb-48a2-4279-9e02-ac8b9b4004c2 tempest-VolumesTransfersV357Test-707676210 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:49:28 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-5de320fb-48a2-4279-9e02-ac8b9b4004c2 tempest-VolumesTransfersV357Test-707676210 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5de320fb-48a2-4279-9e02-ac8b9b4004c2 tempest-VolumesTransfersV357Test-707676210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6bf48dea-e414-4b4f-bd9e-5e0bb4517ab3 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:28 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_3ij5_265" returned: 1 in 0.362s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_3ij5_265' failed. Not Retrying. {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-809abf64-0cfa-4282-aa1a-7c8d1bfaac1a tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (209eae81-494b-468c-9da1-a83fd0a9709f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cde73cca-af08-4ec9-aa08-98a7eab674b9', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:28 devstack sudo[100780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6bf48dea-e414-4b4f-bd9e-5e0bb4517ab3 1073741824 Sep 10 16:49:28 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-809abf64-0cfa-4282-aa1a-7c8d1bfaac1a tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f073a3ae-c97e-4c1f-88f8-d00596e322ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1234fc66-8875-4c73-bb99-32b752d5f452]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_js_whx8zdevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:28 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-809abf64-0cfa-4282-aa1a-7c8d1bfaac1a tempest-GroupSnapshotsTest-816808975 None] Volume volume-cde73cca-af08-4ec9-aa08-98a7eab674b9 (cde73cca-af08-4ec9-aa08-98a7eab674b9): created successfully Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-809abf64-0cfa-4282-aa1a-7c8d1bfaac1a tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f073a3ae-c97e-4c1f-88f8-d00596e322ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-809abf64-0cfa-4282-aa1a-7c8d1bfaac1a tempest-GroupSnapshotsTest-816808975 None] Flow 'volume_create_manager' (685a2c0c-3234-468c-aaa6-4e6b53fece10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:49:28 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-809abf64-0cfa-4282-aa1a-7c8d1bfaac1a tempest-GroupSnapshotsTest-816808975 None] Created volume successfully. Sep 10 16:49:28 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:28 devstack sudo[100782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_js_whx8zdevstack@QuobyteHD Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-951e3c66-4170-4367-beb1-f3e1a4bffa0a tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.267s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:28 devstack sudo[100782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-951e3c66-4170-4367-beb1-f3e1a4bffa0a tempest-VolumesSnapshotTestJSON-623931556 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:49:28 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-951e3c66-4170-4367-beb1-f3e1a4bffa0a tempest-VolumesSnapshotTestJSON-623931556 None] Deleted volume successfully. Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-951e3c66-4170-4367-beb1-f3e1a4bffa0a tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-654f481e-2a14-4228-8e7b-c2a3dd88ed5d-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c7e5f37a-f08f-4f73-adb7-a10de458b699 tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "cinder-8e070002-7ee9-416a-a8da-9447cae0b0b0-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c7e5f37a-f08f-4f73-adb7-a10de458b699 tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-8e070002-7ee9-416a-a8da-9447cae0b0b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c7e5f37a-f08f-4f73-adb7-a10de458b699 tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "cinder-quobyte-57469620-a163-4893-a513-db44591fad2a" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c7e5f37a-f08f-4f73-adb7-a10de458b699 tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-quobyte-57469620-a163-4893-a513-db44591fad2a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c7e5f37a-f08f-4f73-adb7-a10de458b699 tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "cinder-quobyte-8e070002-7ee9-416a-a8da-9447cae0b0b0" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c7e5f37a-f08f-4f73-adb7-a10de458b699 tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-quobyte-8e070002-7ee9-416a-a8da-9447cae0b0b0" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-c7e5f37a-f08f-4f73-adb7-a10de458b699 tempest-VolumesSnapshotTestJSON-623931556 None] Deleting offline snapshot 8e070002-7ee9-416a-a8da-9447cae0b0b0 of volume 57469620-a163-4893-a513-db44591fad2a {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-c7e5f37a-f08f-4f73-adb7-a10de458b699 tempest-VolumesSnapshotTestJSON-623931556 None] snapshot_file for this snap is: volume-57469620-a163-4893-a513-db44591fad2a.8e070002-7ee9-416a-a8da-9447cae0b0b0 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a0045d-61ce-402b-8084-5a9447c7666c]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c7e5f37a-f08f-4f73-adb7-a10de458b699 tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a.8e070002-7ee9-416a-a8da-9447cae0b0b0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:28 devstack sudo[100782]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_js_whx8zdevstack@QuobyteHD" returned: 0 in 0.426s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 was qcow2, converting to qcow2 {{(pid=88189) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_js_whx8zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-98fadc22-cde4-49bd-9fc0-28a2bf681692 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:28 devstack sudo[100794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_js_whx8zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-98fadc22-cde4-49bd-9fc0-28a2bf681692 Sep 10 16:49:28 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:28 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a.8e070002-7ee9-416a-a8da-9447cae0b0b0 Sep 10 16:49:28 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:28 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5de320fb-48a2-4279-9e02-ac8b9b4004c2 tempest-VolumesTransfersV357Test-707676210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6bf48dea-e414-4b4f-bd9e-5e0bb4517ab3 1073741824" returned: 0 in 0.547s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5de320fb-48a2-4279-9e02-ac8b9b4004c2 tempest-VolumesTransfersV357Test-707676210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6bf48dea-e414-4b4f-bd9e-5e0bb4517ab3 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:28 devstack sudo[100797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6bf48dea-e414-4b4f-bd9e-5e0bb4517ab3 Sep 10 16:49:28 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:28 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c7e5f37a-f08f-4f73-adb7-a10de458b699 tempest-VolumesSnapshotTestJSON-623931556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a.8e070002-7ee9-416a-a8da-9447cae0b0b0" returned: 0 in 0.456s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-c7e5f37a-f08f-4f73-adb7-a10de458b699 tempest-VolumesSnapshotTestJSON-623931556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57469620-a163-4893-a513-db44591fad2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3db495-d65d-4c7c-96a3-381a56f9dd6f]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c7e5f37a-f08f-4f73-adb7-a10de458b699 tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:29 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5de320fb-48a2-4279-9e02-ac8b9b4004c2 tempest-VolumesTransfersV357Test-707676210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6bf48dea-e414-4b4f-bd9e-5e0bb4517ab3" returned: 0 in 0.356s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:29 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-5de320fb-48a2-4279-9e02-ac8b9b4004c2 tempest-VolumesTransfersV357Test-707676210 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:49:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5de320fb-48a2-4279-9e02-ac8b9b4004c2 tempest-VolumesTransfersV357Test-707676210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5de320fb-48a2-4279-9e02-ac8b9b4004c2 tempest-VolumesTransfersV357Test-707676210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b68a15c-a7a0-4b02-9c5f-a9fdea130bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bf48dea-e414-4b4f-bd9e-5e0bb4517ab3', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5de320fb-48a2-4279-9e02-ac8b9b4004c2 tempest-VolumesTransfersV357Test-707676210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69eaa3fd-3049-4175-9483-2af3632e1403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:29 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-5de320fb-48a2-4279-9e02-ac8b9b4004c2 tempest-VolumesTransfersV357Test-707676210 None] Volume volume-6bf48dea-e414-4b4f-bd9e-5e0bb4517ab3 (6bf48dea-e414-4b4f-bd9e-5e0bb4517ab3): created successfully Sep 10 16:49:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5de320fb-48a2-4279-9e02-ac8b9b4004c2 tempest-VolumesTransfersV357Test-707676210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69eaa3fd-3049-4175-9483-2af3632e1403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:29 devstack sudo[100807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a Sep 10 16:49:29 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5de320fb-48a2-4279-9e02-ac8b9b4004c2 tempest-VolumesTransfersV357Test-707676210 None] Flow 'volume_create_manager' (d2fb2b75-ba18-4c9c-9351-c1a669bc0c2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:49:29 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-5de320fb-48a2-4279-9e02-ac8b9b4004c2 tempest-VolumesTransfersV357Test-707676210 None] Created volume successfully. Sep 10 16:49:29 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-80cd467d-9468-4126-b80c-9b14de4c7419 tempest-GroupSnapshotsTest-816808975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:49:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-80cd467d-9468-4126-b80c-9b14de4c7419 tempest-GroupSnapshotsTest-816808975 None] Flow 'volume_create_manager' (89e75558-0d60-4ce3-9060-6abebc246040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:49:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-80cd467d-9468-4126-b80c-9b14de4c7419 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72bed49f-2d67-4085-9bac-25702fbae047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-80cd467d-9468-4126-b80c-9b14de4c7419 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72bed49f-2d67-4085-9bac-25702fbae047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-214592777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=29103afa-6f2a-4fea-b499-9db642f8160b,host='devstack@QuobyteHD#QuobyteHD',id=a885b334-4872-4211-93d0-92e44ac64185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db7640a88dee43a0adaf652df2e8f4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:49:29Z,use_quota=True,user_id='db5cc2cff9be401f8716a3989358ac94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1329a701-0d2c-42fb-8d07-b72af3828050),volume_type_id=1329a701-0d2c-42fb-8d07-b72af3828050)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-80cd467d-9468-4126-b80c-9b14de4c7419 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7551b272-a0aa-429d-adb8-89ca393f57aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-80cd467d-9468-4126-b80c-9b14de4c7419 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7551b272-a0aa-429d-adb8-89ca393f57aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-80cd467d-9468-4126-b80c-9b14de4c7419 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b9d2690-c2dd-4b09-b171-658b58ac2d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-80cd467d-9468-4126-b80c-9b14de4c7419 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b9d2690-c2dd-4b09-b171-658b58ac2d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a885b334-4872-4211-93d0-92e44ac64185', 'volume_name': 'volume-a885b334-4872-4211-93d0-92e44ac64185', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-80cd467d-9468-4126-b80c-9b14de4c7419 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff019918-c3bd-4d35-b49f-0cd7672b2de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-80cd467d-9468-4126-b80c-9b14de4c7419 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff019918-c3bd-4d35-b49f-0cd7672b2de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-80cd467d-9468-4126-b80c-9b14de4c7419 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc2b304-7c8e-4fc9-8f60-2ffd16d53c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:29 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-80cd467d-9468-4126-b80c-9b14de4c7419 tempest-GroupSnapshotsTest-816808975 None] Volume a885b334-4872-4211-93d0-92e44ac64185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a885b334-4872-4211-93d0-92e44ac64185', 'volume_size': 1} Sep 10 16:49:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-80cd467d-9468-4126-b80c-9b14de4c7419 tempest-GroupSnapshotsTest-816808975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-80cd467d-9468-4126-b80c-9b14de4c7419 tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:29 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-80cd467d-9468-4126-b80c-9b14de4c7419 tempest-GroupSnapshotsTest-816808975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=29103afa-6f2a-4fea-b499-9db642f8160b,created_at=2026-09-10T14:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-214592777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=29103afa-6f2a-4fea-b499-9db642f8160b,host='devstack@QuobyteHD#QuobyteHD',id=a885b334-4872-4211-93d0-92e44ac64185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db7640a88dee43a0adaf652df2e8f4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:49:29Z,use_quota=True,user_id='db5cc2cff9be401f8716a3989358ac94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1329a701-0d2c-42fb-8d07-b72af3828050),volume_type_id=1329a701-0d2c-42fb-8d07-b72af3828050)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:49:29 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-80cd467d-9468-4126-b80c-9b14de4c7419 tempest-GroupSnapshotsTest-816808975 None] Creating volume a885b334-4872-4211-93d0-92e44ac64185 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:49:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-80cd467d-9468-4126-b80c-9b14de4c7419 tempest-GroupSnapshotsTest-816808975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-80cd467d-9468-4126-b80c-9b14de4c7419 tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:29 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-80cd467d-9468-4126-b80c-9b14de4c7419 tempest-GroupSnapshotsTest-816808975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:49:29 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-80cd467d-9468-4126-b80c-9b14de4c7419 tempest-GroupSnapshotsTest-816808975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:49:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-80cd467d-9468-4126-b80c-9b14de4c7419 tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:29 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-80cd467d-9468-4126-b80c-9b14de4c7419 tempest-GroupSnapshotsTest-816808975 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:49:29 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-80cd467d-9468-4126-b80c-9b14de4c7419 tempest-GroupSnapshotsTest-816808975 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:49:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-80cd467d-9468-4126-b80c-9b14de4c7419 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:29 devstack sudo[100822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185 1073741824 Sep 10 16:49:29 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:29 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c7e5f37a-f08f-4f73-adb7-a10de458b699 tempest-VolumesSnapshotTestJSON-623931556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a" returned: 0 in 0.687s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c7e5f37a-f08f-4f73-adb7-a10de458b699 tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a.8e070002-7ee9-416a-a8da-9447cae0b0b0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:29 devstack sudo[100828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a.8e070002-7ee9-416a-a8da-9447cae0b0b0 Sep 10 16:49:29 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:29 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-80cd467d-9468-4126-b80c-9b14de4c7419 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185 1073741824" returned: 0 in 0.562s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-80cd467d-9468-4126-b80c-9b14de4c7419 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:29 devstack sudo[100835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185 Sep 10 16:49:29 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:30 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c7e5f37a-f08f-4f73-adb7-a10de458b699 tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a.8e070002-7ee9-416a-a8da-9447cae0b0b0" returned: 0 in 0.487s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c7e5f37a-f08f-4f73-adb7-a10de458b699 tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a.8e070002-7ee9-416a-a8da-9447cae0b0b0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:30 devstack sudo[100837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a.8e070002-7ee9-416a-a8da-9447cae0b0b0 Sep 10 16:49:30 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:30 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-80cd467d-9468-4126-b80c-9b14de4c7419 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185" returned: 0 in 0.319s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-80cd467d-9468-4126-b80c-9b14de4c7419 tempest-GroupSnapshotsTest-816808975 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:49:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-80cd467d-9468-4126-b80c-9b14de4c7419 tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-80cd467d-9468-4126-b80c-9b14de4c7419 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc2b304-7c8e-4fc9-8f60-2ffd16d53c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a885b334-4872-4211-93d0-92e44ac64185', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-80cd467d-9468-4126-b80c-9b14de4c7419 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47912991-fa8b-41b9-bd2a-6d791e1b71dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:30 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-80cd467d-9468-4126-b80c-9b14de4c7419 tempest-GroupSnapshotsTest-816808975 None] Volume volume-a885b334-4872-4211-93d0-92e44ac64185 (a885b334-4872-4211-93d0-92e44ac64185): created successfully Sep 10 16:49:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-80cd467d-9468-4126-b80c-9b14de4c7419 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47912991-fa8b-41b9-bd2a-6d791e1b71dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-80cd467d-9468-4126-b80c-9b14de4c7419 tempest-GroupSnapshotsTest-816808975 None] Flow 'volume_create_manager' (89e75558-0d60-4ce3-9060-6abebc246040) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:49:30 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-80cd467d-9468-4126-b80c-9b14de4c7419 tempest-GroupSnapshotsTest-816808975 None] Created volume successfully. Sep 10 16:49:30 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c7e5f37a-f08f-4f73-adb7-a10de458b699 tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a.8e070002-7ee9-416a-a8da-9447cae0b0b0" returned: 0 in 0.379s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:30 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c7e5f37a-f08f-4f73-adb7-a10de458b699 tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-quobyte-8e070002-7ee9-416a-a8da-9447cae0b0b0" released by "_delete_snapshot" :: held 2.137s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:30 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c7e5f37a-f08f-4f73-adb7-a10de458b699 tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-quobyte-57469620-a163-4893-a513-db44591fad2a" released by "delete_snapshot" :: held 2.172s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:30 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-c7e5f37a-f08f-4f73-adb7-a10de458b699 tempest-VolumesSnapshotTestJSON-623931556 None] Created reservations ['d3fefea1-8c16-4c2c-b603-adeea8f5d809', '47537375-dcf7-4f3a-a829-7a3ae679d151', '2f3881ba-078c-4ccf-97e0-44216d292412', '39f8e85f-5f72-4e68-ab0c-590efb53bb65'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:49:30 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-c7e5f37a-f08f-4f73-adb7-a10de458b699 tempest-VolumesSnapshotTestJSON-623931556 None] Delete snapshot completed successfully. Sep 10 16:49:30 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_js_whx8zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-98fadc22-cde4-49bd-9fc0-28a2bf681692" returned: 0 in 2.204s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:30 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_js_whx8zdevstack@QuobyteHD, size 112.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-98fadc22-cde4-49bd-9fc0-28a2bf681692 {{(pid=88189) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 16:49:30 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Converted 112.00 MB image at 50.76 MB/s Sep 10 16:49:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-98fadc22-cde4-49bd-9fc0-28a2bf681692 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:30 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c7e5f37a-f08f-4f73-adb7-a10de458b699 tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-8e070002-7ee9-416a-a8da-9447cae0b0b0-delete_snapshot" released by "delete_snapshot" :: held 2.399s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:30 devstack sudo[100842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-98fadc22-cde4-49bd-9fc0-28a2bf681692 1G Sep 10 16:49:30 devstack sudo[100842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:30 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-4d6b6bb9-1530-4726-878c-f564c20fba53 tempest-GroupSnapshotsTest-816808975 None] Update group completed successfully. Sep 10 16:49:30 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-56a895ed-be80-443a-9b4b-8684233c5153 tempest-VolumesTransfersV357Test-286944224 None] Transfer volume completed successfully. Sep 10 16:49:31 devstack sudo[100842]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-98fadc22-cde4-49bd-9fc0-28a2bf681692 1G" returned: 0 in 0.339s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:31 devstack cinder-volume[88189]: DEBUG cinder.volume.volume_utils [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Downloaded image 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'metadata': {}}])) to volume 98fadc22-cde4-49bd-9fc0-28a2bf681692 successfully. {{(pid=88189) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 16:49:31 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Temporary image 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 for user 84413e2c1e104252bd0e593fc017c912 is deleted. {{(pid=88189) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 16:49:31 devstack cinder-volume[88189]: DEBUG cinder.volume.volume_utils [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Marking volume 98fadc22-cde4-49bd-9fc0-28a2bf681692 as bootable. {{(pid=88189) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 16:49:31 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Copying metadata from image 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 to 98fadc22-cde4-49bd-9fc0-28a2bf681692. {{(pid=88189) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 16:49:31 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Creating volume glance metadata for volume 98fadc22-cde4-49bd-9fc0-28a2bf681692 backed by image 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88189) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 16:49:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b586950a-f022-4f79-a02d-93b3703d9f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98fadc22-cde4-49bd-9fc0-28a2bf681692', 'volume_size': 1, 'image_id': '5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dbb77788940a4d64b2cf7dbf5431f2a1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'created_at': datetime.datetime(2026, 9, 10, 14, 32, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 14, 32, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c00123-6ea8-4189-bbc8-3a20c38c2935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:31 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Volume volume-98fadc22-cde4-49bd-9fc0-28a2bf681692 (98fadc22-cde4-49bd-9fc0-28a2bf681692): created successfully Sep 10 16:49:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c00123-6ea8-4189-bbc8-3a20c38c2935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Flow 'volume_create_manager' (d65fdb20-1d53-4019-909b-c26b58c59ee1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:49:31 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-90aaf179-7844-4981-bcb2-53b5fbd6fa12 tempest-TestShelveInstance-182807223 None] Created volume successfully. Sep 10 16:49:31 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f99a7efc-1d5f-4966-9abc-d4f4fa7fe03d tempest-VolumesTransfersV357Test-962557893 None] Acquiring lock "cinder-6bf48dea-e414-4b4f-bd9e-5e0bb4517ab3-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:49:31 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f99a7efc-1d5f-4966-9abc-d4f4fa7fe03d tempest-VolumesTransfersV357Test-962557893 None] Lock "cinder-6bf48dea-e414-4b4f-bd9e-5e0bb4517ab3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:49:31 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f99a7efc-1d5f-4966-9abc-d4f4fa7fe03d tempest-VolumesTransfersV357Test-962557893 None] Acquiring lock "cinder-quobyte-6bf48dea-e414-4b4f-bd9e-5e0bb4517ab3" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:49:31 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f99a7efc-1d5f-4966-9abc-d4f4fa7fe03d tempest-VolumesTransfersV357Test-962557893 None] Lock "cinder-quobyte-6bf48dea-e414-4b4f-bd9e-5e0bb4517ab3" acquired by "delete_volume" :: waited 0.013s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:49:31 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[162a13c8-7f33-4212-a258-491afbb3bffc]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f99a7efc-1d5f-4966-9abc-d4f4fa7fe03d tempest-VolumesTransfersV357Test-962557893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6bf48dea-e414-4b4f-bd9e-5e0bb4517ab3 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:31 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6bf48dea-e414-4b4f-bd9e-5e0bb4517ab3 Sep 10 16:49:31 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:31 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-18082cc6-7b41-4113-b27b-a35850fbce0c tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "cinder-57469620-a163-4893-a513-db44591fad2a-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:49:31 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-18082cc6-7b41-4113-b27b-a35850fbce0c tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-57469620-a163-4893-a513-db44591fad2a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:49:31 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-18082cc6-7b41-4113-b27b-a35850fbce0c tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "cinder-quobyte-57469620-a163-4893-a513-db44591fad2a" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:49:31 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-18082cc6-7b41-4113-b27b-a35850fbce0c tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-quobyte-57469620-a163-4893-a513-db44591fad2a" acquired by "delete_volume" :: waited 0.018s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:49:31 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[551f23fa-0e54-44b0-948a-e35ee06d00bc]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-18082cc6-7b41-4113-b27b-a35850fbce0c tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:31 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f99a7efc-1d5f-4966-9abc-d4f4fa7fe03d tempest-VolumesTransfersV357Test-962557893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6bf48dea-e414-4b4f-bd9e-5e0bb4517ab3" returned: 0 in 0.406s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f99a7efc-1d5f-4966-9abc-d4f4fa7fe03d tempest-VolumesTransfersV357Test-962557893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6bf48dea-e414-4b4f-bd9e-5e0bb4517ab3 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:31 devstack sudo[100853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6bf48dea-e414-4b4f-bd9e-5e0bb4517ab3 Sep 10 16:49:31 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:31 devstack sudo[100852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a Sep 10 16:49:31 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:32 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-65ce4402-2281-41ba-bf8f-df83647be384 tempest-GroupSnapshotsTest-816808975 None] Update group completed successfully. Sep 10 16:49:32 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f99a7efc-1d5f-4966-9abc-d4f4fa7fe03d tempest-VolumesTransfersV357Test-962557893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6bf48dea-e414-4b4f-bd9e-5e0bb4517ab3" returned: 0 in 0.293s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:32 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f99a7efc-1d5f-4966-9abc-d4f4fa7fe03d tempest-VolumesTransfersV357Test-962557893 None] Lock "cinder-quobyte-6bf48dea-e414-4b4f-bd9e-5e0bb4517ab3" released by "delete_volume" :: held 0.740s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:32 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-f99a7efc-1d5f-4966-9abc-d4f4fa7fe03d tempest-VolumesTransfersV357Test-962557893 None] Created reservations ['521ddbf7-08b4-4319-af3f-297fdf07f063', '57d4ef76-46f3-4e5c-a4bb-1d64dadc534a', '0cff642b-5e49-44de-b0ea-8a41addadf6d', '5c9bb889-029a-4b2f-8e82-6411507d8485'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:49:32 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-18082cc6-7b41-4113-b27b-a35850fbce0c tempest-VolumesSnapshotTestJSON-623931556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a" returned: 0 in 0.425s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-18082cc6-7b41-4113-b27b-a35850fbce0c tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:32 devstack sudo[100860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a Sep 10 16:49:32 devstack sudo[100860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f99a7efc-1d5f-4966-9abc-d4f4fa7fe03d tempest-VolumesTransfersV357Test-962557893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f99a7efc-1d5f-4966-9abc-d4f4fa7fe03d tempest-VolumesTransfersV357Test-962557893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f99a7efc-1d5f-4966-9abc-d4f4fa7fe03d tempest-VolumesTransfersV357Test-962557893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:49:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f99a7efc-1d5f-4966-9abc-d4f4fa7fe03d tempest-VolumesTransfersV357Test-962557893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:49:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f99a7efc-1d5f-4966-9abc-d4f4fa7fe03d tempest-VolumesTransfersV357Test-962557893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f99a7efc-1d5f-4966-9abc-d4f4fa7fe03d tempest-VolumesTransfersV357Test-962557893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:32 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:49:32 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:32 devstack sudo[100860]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-18082cc6-7b41-4113-b27b-a35850fbce0c tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57469620-a163-4893-a513-db44591fad2a" returned: 0 in 0.296s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:32 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-18082cc6-7b41-4113-b27b-a35850fbce0c tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-quobyte-57469620-a163-4893-a513-db44591fad2a" released by "delete_volume" :: held 0.812s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:32 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f99a7efc-1d5f-4966-9abc-d4f4fa7fe03d tempest-VolumesTransfersV357Test-962557893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.291s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:32 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-f99a7efc-1d5f-4966-9abc-d4f4fa7fe03d tempest-VolumesTransfersV357Test-962557893 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:49:32 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-f99a7efc-1d5f-4966-9abc-d4f4fa7fe03d tempest-VolumesTransfersV357Test-962557893 None] Deleted volume successfully. Sep 10 16:49:32 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f99a7efc-1d5f-4966-9abc-d4f4fa7fe03d tempest-VolumesTransfersV357Test-962557893 None] Lock "cinder-6bf48dea-e414-4b4f-bd9e-5e0bb4517ab3-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:32 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-18082cc6-7b41-4113-b27b-a35850fbce0c tempest-VolumesSnapshotTestJSON-623931556 None] Created reservations ['5e1e14bd-0584-4bbd-9313-436faa013868', 'bb877847-2575-41ff-ad43-4af0298432a0', '0d39e56c-0252-4446-95ee-69213259ba4f', '7838daba-9583-4fa8-8723-152134f3bf71'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:49:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-18082cc6-7b41-4113-b27b-a35850fbce0c tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-18082cc6-7b41-4113-b27b-a35850fbce0c tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-18082cc6-7b41-4113-b27b-a35850fbce0c tempest-VolumesSnapshotTestJSON-623931556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:49:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-18082cc6-7b41-4113-b27b-a35850fbce0c tempest-VolumesSnapshotTestJSON-623931556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:49:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-18082cc6-7b41-4113-b27b-a35850fbce0c tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-18082cc6-7b41-4113-b27b-a35850fbce0c tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:32 devstack sudo[100866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:49:32 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-45764d4a-e83e-4d91-ba81-6501895fd009 tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "cinder-9c8b00b5-f814-4479-8416-468bff417462-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-45764d4a-e83e-4d91-ba81-6501895fd009 tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-9c8b00b5-f814-4479-8416-468bff417462-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:49:33 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-18082cc6-7b41-4113-b27b-a35850fbce0c tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.312s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-18082cc6-7b41-4113-b27b-a35850fbce0c tempest-VolumesSnapshotTestJSON-623931556 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:49:33 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-18082cc6-7b41-4113-b27b-a35850fbce0c tempest-VolumesSnapshotTestJSON-623931556 None] Deleted volume successfully. Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-45764d4a-e83e-4d91-ba81-6501895fd009 tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "cinder-quobyte-9c8b00b5-f814-4479-8416-468bff417462" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-18082cc6-7b41-4113-b27b-a35850fbce0c tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-57469620-a163-4893-a513-db44591fad2a-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-45764d4a-e83e-4d91-ba81-6501895fd009 tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-quobyte-9c8b00b5-f814-4479-8416-468bff417462" acquired by "delete_volume" :: waited 0.038s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9392eaf-0143-47e2-b7ff-d046f86a5f45]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-45764d4a-e83e-4d91-ba81-6501895fd009 tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aad718f-b010-4cbf-a131-a476ac848594 tempest-VolumesTransfersV357Test-707676210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0aad718f-b010-4cbf-a131-a476ac848594 tempest-VolumesTransfersV357Test-707676210 None] Flow 'volume_create_manager' (3ff709b2-eae9-4789-83a1-0f69c3323b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0aad718f-b010-4cbf-a131-a476ac848594 tempest-VolumesTransfersV357Test-707676210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f245d9cb-df28-4b24-881d-55275984f868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0aad718f-b010-4cbf-a131-a476ac848594 tempest-VolumesTransfersV357Test-707676210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f245d9cb-df28-4b24-881d-55275984f868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-653382783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bff29e2a-52d5-4dca-835d-4ff27c4b9ce2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14232d9aa05f4581a2d5c0a76c39c92a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:49:33Z,use_quota=True,user_id='bfe8337f5e1540c28c2471afcf8237c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0aad718f-b010-4cbf-a131-a476ac848594 tempest-VolumesTransfersV357Test-707676210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f968ca-1751-4f81-a567-fb6ddf9d1967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0aad718f-b010-4cbf-a131-a476ac848594 tempest-VolumesTransfersV357Test-707676210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f968ca-1751-4f81-a567-fb6ddf9d1967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0aad718f-b010-4cbf-a131-a476ac848594 tempest-VolumesTransfersV357Test-707676210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (401a06b0-e999-4707-8ff7-7f00ed9c9c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:33 devstack sudo[100869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462 Sep 10 16:49:33 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0aad718f-b010-4cbf-a131-a476ac848594 tempest-VolumesTransfersV357Test-707676210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (401a06b0-e999-4707-8ff7-7f00ed9c9c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bff29e2a-52d5-4dca-835d-4ff27c4b9ce2', 'volume_name': 'volume-bff29e2a-52d5-4dca-835d-4ff27c4b9ce2', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0aad718f-b010-4cbf-a131-a476ac848594 tempest-VolumesTransfersV357Test-707676210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa56960-1056-4072-af4d-a503bc8a6e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0aad718f-b010-4cbf-a131-a476ac848594 tempest-VolumesTransfersV357Test-707676210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa56960-1056-4072-af4d-a503bc8a6e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0aad718f-b010-4cbf-a131-a476ac848594 tempest-VolumesTransfersV357Test-707676210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (582379e0-bab2-43ff-972e-4a8fdb0ac69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:33 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-0aad718f-b010-4cbf-a131-a476ac848594 tempest-VolumesTransfersV357Test-707676210 None] Volume bff29e2a-52d5-4dca-835d-4ff27c4b9ce2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bff29e2a-52d5-4dca-835d-4ff27c4b9ce2', 'volume_size': 1} Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0aad718f-b010-4cbf-a131-a476ac848594 tempest-VolumesTransfersV357Test-707676210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0aad718f-b010-4cbf-a131-a476ac848594 tempest-VolumesTransfersV357Test-707676210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0aad718f-b010-4cbf-a131-a476ac848594 tempest-VolumesTransfersV357Test-707676210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-653382783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bff29e2a-52d5-4dca-835d-4ff27c4b9ce2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14232d9aa05f4581a2d5c0a76c39c92a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:49:33Z,use_quota=True,user_id='bfe8337f5e1540c28c2471afcf8237c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-0aad718f-b010-4cbf-a131-a476ac848594 tempest-VolumesTransfersV357Test-707676210 None] Creating volume bff29e2a-52d5-4dca-835d-4ff27c4b9ce2 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0aad718f-b010-4cbf-a131-a476ac848594 tempest-VolumesTransfersV357Test-707676210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0aad718f-b010-4cbf-a131-a476ac848594 tempest-VolumesTransfersV357Test-707676210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0aad718f-b010-4cbf-a131-a476ac848594 tempest-VolumesTransfersV357Test-707676210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0aad718f-b010-4cbf-a131-a476ac848594 tempest-VolumesTransfersV357Test-707676210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0aad718f-b010-4cbf-a131-a476ac848594 tempest-VolumesTransfersV357Test-707676210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0aad718f-b010-4cbf-a131-a476ac848594 tempest-VolumesTransfersV357Test-707676210 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:49:33 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-0aad718f-b010-4cbf-a131-a476ac848594 tempest-VolumesTransfersV357Test-707676210 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0aad718f-b010-4cbf-a131-a476ac848594 tempest-VolumesTransfersV357Test-707676210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bff29e2a-52d5-4dca-835d-4ff27c4b9ce2 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:33 devstack sudo[100874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bff29e2a-52d5-4dca-835d-4ff27c4b9ce2 1073741824 Sep 10 16:49:33 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:33 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-bbea4ce8-a8e0-4db6-9586-9066699cd855 tempest-GroupSnapshotsTest-816808975 None] Update group completed successfully. Sep 10 16:49:33 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-45764d4a-e83e-4d91-ba81-6501895fd009 tempest-VolumesSnapshotTestJSON-623931556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462" returned: 0 in 0.421s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-45764d4a-e83e-4d91-ba81-6501895fd009 tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:33 devstack sudo[100881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462 Sep 10 16:49:33 devstack sudo[100881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:33 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0aad718f-b010-4cbf-a131-a476ac848594 tempest-VolumesTransfersV357Test-707676210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bff29e2a-52d5-4dca-835d-4ff27c4b9ce2 1073741824" returned: 0 in 0.525s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:33 devstack sudo[100881]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-45764d4a-e83e-4d91-ba81-6501895fd009 tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9c8b00b5-f814-4479-8416-468bff417462" returned: 0 in 0.293s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-45764d4a-e83e-4d91-ba81-6501895fd009 tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-quobyte-9c8b00b5-f814-4479-8416-468bff417462" released by "delete_volume" :: held 0.806s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0aad718f-b010-4cbf-a131-a476ac848594 tempest-VolumesTransfersV357Test-707676210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bff29e2a-52d5-4dca-835d-4ff27c4b9ce2 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:34 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bff29e2a-52d5-4dca-835d-4ff27c4b9ce2 Sep 10 16:49:34 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:34 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-45764d4a-e83e-4d91-ba81-6501895fd009 tempest-VolumesSnapshotTestJSON-623931556 None] Created reservations ['5e266616-4a8c-4995-8336-9f2b43ca0064', 'd83892ff-5d19-4042-95b1-09c89d397bbe', 'ec245cd4-8d2e-4ca5-afa4-3ccb8e3d2638', 'b15fdac8-afa5-4255-8d4d-482a4ba199e0'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:49:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-45764d4a-e83e-4d91-ba81-6501895fd009 tempest-VolumesSnapshotTestJSON-623931556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-45764d4a-e83e-4d91-ba81-6501895fd009 tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:34 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-45764d4a-e83e-4d91-ba81-6501895fd009 tempest-VolumesSnapshotTestJSON-623931556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:49:34 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-45764d4a-e83e-4d91-ba81-6501895fd009 tempest-VolumesSnapshotTestJSON-623931556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:49:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-45764d4a-e83e-4d91-ba81-6501895fd009 tempest-VolumesSnapshotTestJSON-623931556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-45764d4a-e83e-4d91-ba81-6501895fd009 tempest-VolumesSnapshotTestJSON-623931556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:34 devstack sudo[100888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:49:34 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:34 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0aad718f-b010-4cbf-a131-a476ac848594 tempest-VolumesTransfersV357Test-707676210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bff29e2a-52d5-4dca-835d-4ff27c4b9ce2" returned: 0 in 0.351s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:34 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0aad718f-b010-4cbf-a131-a476ac848594 tempest-VolumesTransfersV357Test-707676210 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:49:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0aad718f-b010-4cbf-a131-a476ac848594 tempest-VolumesTransfersV357Test-707676210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0aad718f-b010-4cbf-a131-a476ac848594 tempest-VolumesTransfersV357Test-707676210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (582379e0-bab2-43ff-972e-4a8fdb0ac69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bff29e2a-52d5-4dca-835d-4ff27c4b9ce2', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0aad718f-b010-4cbf-a131-a476ac848594 tempest-VolumesTransfersV357Test-707676210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca31472-deaa-4b74-bbf9-ddf167b80af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:34 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-0aad718f-b010-4cbf-a131-a476ac848594 tempest-VolumesTransfersV357Test-707676210 None] Volume volume-bff29e2a-52d5-4dca-835d-4ff27c4b9ce2 (bff29e2a-52d5-4dca-835d-4ff27c4b9ce2): created successfully Sep 10 16:49:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0aad718f-b010-4cbf-a131-a476ac848594 tempest-VolumesTransfersV357Test-707676210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca31472-deaa-4b74-bbf9-ddf167b80af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0aad718f-b010-4cbf-a131-a476ac848594 tempest-VolumesTransfersV357Test-707676210 None] Flow 'volume_create_manager' (3ff709b2-eae9-4789-83a1-0f69c3323b33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:49:34 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-0aad718f-b010-4cbf-a131-a476ac848594 tempest-VolumesTransfersV357Test-707676210 None] Created volume successfully. Sep 10 16:49:34 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-45764d4a-e83e-4d91-ba81-6501895fd009 tempest-VolumesSnapshotTestJSON-623931556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.379s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:34 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-45764d4a-e83e-4d91-ba81-6501895fd009 tempest-VolumesSnapshotTestJSON-623931556 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:49:34 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-45764d4a-e83e-4d91-ba81-6501895fd009 tempest-VolumesSnapshotTestJSON-623931556 None] Deleted volume successfully. Sep 10 16:49:34 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-45764d4a-e83e-4d91-ba81-6501895fd009 tempest-VolumesSnapshotTestJSON-623931556 None] Lock "cinder-9c8b00b5-f814-4479-8416-468bff417462-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:34 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-c154bf0e-59db-48a6-9d48-f908378135c8 tempest-GroupSnapshotsTest-816808975 None] Update group completed successfully. Sep 10 16:49:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-b29d4c21-da61-4860-9a71-9b4a0d75619d req-757e364d-f724-47f6-a54f-e7e21f10494d tempest-TestShelveInstance-182807223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-b29d4c21-da61-4860-9a71-9b4a0d75619d req-757e364d-f724-47f6-a54f-e7e21f10494d tempest-TestShelveInstance-182807223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-b29d4c21-da61-4860-9a71-9b4a0d75619d req-757e364d-f724-47f6-a54f-e7e21f10494d tempest-TestShelveInstance-182807223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-b29d4c21-da61-4860-9a71-9b4a0d75619d req-757e364d-f724-47f6-a54f-e7e21f10494d tempest-TestShelveInstance-182807223 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8', 'name': 'volume-98fadc22-cde4-49bd-9fc0-28a2bf681692', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '47b183ae-7e39-43e0-bc3a-a9de41cd0ce1', 'enforce_multipath': True} {{(pid=88189) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 16:49:35 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-b29d4c21-da61-4860-9a71-9b4a0d75619d req-757e364d-f724-47f6-a54f-e7e21f10494d tempest-TestShelveInstance-182807223 None] attachment_update completed successfully. Sep 10 16:49:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-483d03aa-3602-4a99-856b-bf72c03c5739 tempest-VolumesTransfersV357Test-962557893 None] Acquiring lock "cinder-bff29e2a-52d5-4dca-835d-4ff27c4b9ce2-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:49:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-483d03aa-3602-4a99-856b-bf72c03c5739 tempest-VolumesTransfersV357Test-962557893 None] Lock "cinder-bff29e2a-52d5-4dca-835d-4ff27c4b9ce2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:49:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-483d03aa-3602-4a99-856b-bf72c03c5739 tempest-VolumesTransfersV357Test-962557893 None] Acquiring lock "cinder-quobyte-bff29e2a-52d5-4dca-835d-4ff27c4b9ce2" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:49:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-483d03aa-3602-4a99-856b-bf72c03c5739 tempest-VolumesTransfersV357Test-962557893 None] Lock "cinder-quobyte-bff29e2a-52d5-4dca-835d-4ff27c4b9ce2" acquired by "delete_volume" :: waited 0.023s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:49:35 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10da45d-a896-4831-8454-788478b32ae8]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-483d03aa-3602-4a99-856b-bf72c03c5739 tempest-VolumesTransfersV357Test-962557893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bff29e2a-52d5-4dca-835d-4ff27c4b9ce2 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:36 devstack sudo[100900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bff29e2a-52d5-4dca-835d-4ff27c4b9ce2 Sep 10 16:49:36 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:36 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-483d03aa-3602-4a99-856b-bf72c03c5739 tempest-VolumesTransfersV357Test-962557893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bff29e2a-52d5-4dca-835d-4ff27c4b9ce2" returned: 0 in 0.618s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-483d03aa-3602-4a99-856b-bf72c03c5739 tempest-VolumesTransfersV357Test-962557893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bff29e2a-52d5-4dca-835d-4ff27c4b9ce2 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:36 devstack sudo[100906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bff29e2a-52d5-4dca-835d-4ff27c4b9ce2 Sep 10 16:49:36 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:36 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] GroupSnapshot a243925e-bc04-499f-9dff-cbfd58f01a9c: creating. Sep 10 16:49:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] Group snapshot a243925e-bc04-499f-9dff-cbfd58f01a9c: creating. {{(pid=88189) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 10 16:49:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:36 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] Creating offline snapshot b71c84e9-4834-427a-93a0-b4b2a2c0215d of volume a885b334-4872-4211-93d0-92e44ac64185 {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:49:36 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[80219cc4-a529-4d02-bea2-61754d1fadc7]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:36 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185 Sep 10 16:49:36 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:36 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-483d03aa-3602-4a99-856b-bf72c03c5739 tempest-VolumesTransfersV357Test-962557893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bff29e2a-52d5-4dca-835d-4ff27c4b9ce2" returned: 0 in 0.311s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-483d03aa-3602-4a99-856b-bf72c03c5739 tempest-VolumesTransfersV357Test-962557893 None] Lock "cinder-quobyte-bff29e2a-52d5-4dca-835d-4ff27c4b9ce2" released by "delete_volume" :: held 1.002s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:36 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-483d03aa-3602-4a99-856b-bf72c03c5739 tempest-VolumesTransfersV357Test-962557893 None] Created reservations ['9c3bae7d-ed44-4396-b59e-0d7e8181251b', '05b7d957-952c-4643-a8ef-65bd1a02f664', 'cf69c57e-abdf-49c7-a2d9-06402abbed90', '13eab18f-d869-46f2-a794-f5b7b4e138f2'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:49:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-483d03aa-3602-4a99-856b-bf72c03c5739 tempest-VolumesTransfersV357Test-962557893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-483d03aa-3602-4a99-856b-bf72c03c5739 tempest-VolumesTransfersV357Test-962557893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:36 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-483d03aa-3602-4a99-856b-bf72c03c5739 tempest-VolumesTransfersV357Test-962557893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:49:36 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-483d03aa-3602-4a99-856b-bf72c03c5739 tempest-VolumesTransfersV357Test-962557893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:49:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-483d03aa-3602-4a99-856b-bf72c03c5739 tempest-VolumesTransfersV357Test-962557893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-483d03aa-3602-4a99-856b-bf72c03c5739 tempest-VolumesTransfersV357Test-962557893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:36 devstack sudo[100913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:49:36 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:37 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185" returned: 0 in 0.450s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185.b71c84e9-4834-427a-93a0-b4b2a2c0215d 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:37 devstack sudo[100916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185.b71c84e9-4834-427a-93a0-b4b2a2c0215d 1G Sep 10 16:49:37 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:37 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-483d03aa-3602-4a99-856b-bf72c03c5739 tempest-VolumesTransfersV357Test-962557893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.351s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:37 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-483d03aa-3602-4a99-856b-bf72c03c5739 tempest-VolumesTransfersV357Test-962557893 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:49:37 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-483d03aa-3602-4a99-856b-bf72c03c5739 tempest-VolumesTransfersV357Test-962557893 None] Deleted volume successfully. Sep 10 16:49:37 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-483d03aa-3602-4a99-856b-bf72c03c5739 tempest-VolumesTransfersV357Test-962557893 None] Lock "cinder-bff29e2a-52d5-4dca-835d-4ff27c4b9ce2-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:37 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185.b71c84e9-4834-427a-93a0-b4b2a2c0215d 1G" returned: 0 in 0.547s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a885b334-4872-4211-93d0-92e44ac64185 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185.b71c84e9-4834-427a-93a0-b4b2a2c0215d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:37 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a885b334-4872-4211-93d0-92e44ac64185 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185.b71c84e9-4834-427a-93a0-b4b2a2c0215d Sep 10 16:49:37 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:37 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a885b334-4872-4211-93d0-92e44ac64185 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185.b71c84e9-4834-427a-93a0-b4b2a2c0215d" returned: 0 in 0.421s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:37 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185.b71c84e9-4834-427a-93a0-b4b2a2c0215d is being set with open permissions: ugo+rw: NotImplementedError Sep 10 16:49:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185.b71c84e9-4834-427a-93a0-b4b2a2c0215d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:38 devstack sudo[100929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185.b71c84e9-4834-427a-93a0-b4b2a2c0215d Sep 10 16:49:38 devstack sudo[100929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:38 devstack sudo[100929]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185.b71c84e9-4834-427a-93a0-b4b2a2c0215d" returned: 0 in 0.314s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:38 devstack sudo[100932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185.info Sep 10 16:49:38 devstack sudo[100932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:38 devstack sudo[100932]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185.info" returned: 0 in 0.351s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:38 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185.info is being set with open permissions: ugo+rw: NotImplementedError Sep 10 16:49:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:38 devstack sudo[101002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185.info Sep 10 16:49:38 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:39 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185.info" returned: 0 in 0.659s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.909s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:39 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] Creating offline snapshot fa113358-1085-40e2-9599-ca43c8d6d0cc of volume cde73cca-af08-4ec9-aa08-98a7eab674b9 {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:49:39 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[456a6dc7-2709-44d1-960a-7b5482338e26]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:39 devstack sudo[101355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9 Sep 10 16:49:39 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:40 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9" returned: 0 in 0.756s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9.fa113358-1085-40e2-9599-ca43c8d6d0cc 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:40 devstack sudo[101386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9.fa113358-1085-40e2-9599-ca43c8d6d0cc 1G Sep 10 16:49:40 devstack sudo[101386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:41 devstack sudo[101386]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9.fa113358-1085-40e2-9599-ca43c8d6d0cc 1G" returned: 0 in 0.785s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cde73cca-af08-4ec9-aa08-98a7eab674b9 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9.fa113358-1085-40e2-9599-ca43c8d6d0cc {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:41 devstack sudo[101396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cde73cca-af08-4ec9-aa08-98a7eab674b9 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9.fa113358-1085-40e2-9599-ca43c8d6d0cc Sep 10 16:49:41 devstack sudo[101396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:41 devstack sudo[101396]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cde73cca-af08-4ec9-aa08-98a7eab674b9 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9.fa113358-1085-40e2-9599-ca43c8d6d0cc" returned: 0 in 0.724s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:41 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9.fa113358-1085-40e2-9599-ca43c8d6d0cc is being set with open permissions: ugo+rw: NotImplementedError Sep 10 16:49:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9.fa113358-1085-40e2-9599-ca43c8d6d0cc {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:41 devstack sudo[101403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9.fa113358-1085-40e2-9599-ca43c8d6d0cc Sep 10 16:49:41 devstack sudo[101403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:42 devstack sudo[101403]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9.fa113358-1085-40e2-9599-ca43c8d6d0cc" returned: 0 in 0.418s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:42 devstack sudo[101406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9.info Sep 10 16:49:42 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:42 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9.info" returned: 0 in 0.371s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:42 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9.info is being set with open permissions: ugo+rw: NotImplementedError Sep 10 16:49:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:42 devstack sudo[101409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9.info Sep 10 16:49:42 devstack sudo[101409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:43 devstack sudo[101409]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9.info" returned: 0 in 0.431s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.721s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:43 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-ed4a615e-c882-4262-b311-d008182b1525 tempest-GroupSnapshotsTest-816808975 None] group_snapshot a243925e-bc04-499f-9dff-cbfd58f01a9c: created successfully Sep 10 16:49:44 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] group_snapshot a243925e-bc04-499f-9dff-cbfd58f01a9c: deleting Sep 10 16:49:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] group_snapshot a243925e-bc04-499f-9dff-cbfd58f01a9c: deleting {{(pid=88189) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 10 16:49:44 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] Acquiring lock "cinder-quobyte-a885b334-4872-4211-93d0-92e44ac64185" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:49:44 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] Lock "cinder-quobyte-a885b334-4872-4211-93d0-92e44ac64185" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:49:44 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] Acquiring lock "cinder-quobyte-b71c84e9-4834-427a-93a0-b4b2a2c0215d" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:49:44 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] Lock "cinder-quobyte-b71c84e9-4834-427a-93a0-b4b2a2c0215d" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:49:44 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] Deleting offline snapshot b71c84e9-4834-427a-93a0-b4b2a2c0215d of volume a885b334-4872-4211-93d0-92e44ac64185 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:49:44 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] snapshot_file for this snap is: volume-a885b334-4872-4211-93d0-92e44ac64185.b71c84e9-4834-427a-93a0-b4b2a2c0215d {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:49:44 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2600ed58-b9af-4209-9769-d280cafbbdb5]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185.b71c84e9-4834-427a-93a0-b4b2a2c0215d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:44 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185.b71c84e9-4834-427a-93a0-b4b2a2c0215d Sep 10 16:49:44 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:45 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185.b71c84e9-4834-427a-93a0-b4b2a2c0215d" returned: 0 in 0.699s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:45 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a885b334-4872-4211-93d0-92e44ac64185(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:49:45 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91703c8-bf99-4d74-a16d-f74880dcd75d]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:45 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185 Sep 10 16:49:45 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:45 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185" returned: 0 in 0.542s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185.b71c84e9-4834-427a-93a0-b4b2a2c0215d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:45 devstack sudo[101422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185.b71c84e9-4834-427a-93a0-b4b2a2c0215d Sep 10 16:49:45 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:46 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185.b71c84e9-4834-427a-93a0-b4b2a2c0215d" returned: 0 in 0.589s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185.b71c84e9-4834-427a-93a0-b4b2a2c0215d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:46 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185.b71c84e9-4834-427a-93a0-b4b2a2c0215d Sep 10 16:49:46 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:46 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185.b71c84e9-4834-427a-93a0-b4b2a2c0215d" returned: 0 in 0.395s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:46 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] Lock "cinder-quobyte-b71c84e9-4834-427a-93a0-b4b2a2c0215d" released by "_delete_snapshot" :: held 2.409s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:46 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] Lock "cinder-quobyte-a885b334-4872-4211-93d0-92e44ac64185" released by "delete_snapshot" :: held 2.475s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:46 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] Acquiring lock "cinder-quobyte-cde73cca-af08-4ec9-aa08-98a7eab674b9" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:49:46 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] Lock "cinder-quobyte-cde73cca-af08-4ec9-aa08-98a7eab674b9" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:49:46 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] Acquiring lock "cinder-quobyte-fa113358-1085-40e2-9599-ca43c8d6d0cc" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:49:46 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] Lock "cinder-quobyte-fa113358-1085-40e2-9599-ca43c8d6d0cc" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:49:47 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] Deleting offline snapshot fa113358-1085-40e2-9599-ca43c8d6d0cc of volume cde73cca-af08-4ec9-aa08-98a7eab674b9 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:49:47 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] snapshot_file for this snap is: volume-cde73cca-af08-4ec9-aa08-98a7eab674b9.fa113358-1085-40e2-9599-ca43c8d6d0cc {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:49:47 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b68ea0-5c5c-4606-8791-2dc44dc68f9b]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9.fa113358-1085-40e2-9599-ca43c8d6d0cc {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:47 devstack sudo[101430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9.fa113358-1085-40e2-9599-ca43c8d6d0cc Sep 10 16:49:47 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:47 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9.fa113358-1085-40e2-9599-ca43c8d6d0cc" returned: 0 in 0.553s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:47 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cde73cca-af08-4ec9-aa08-98a7eab674b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:49:47 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[228a1231-1a52-4cce-bbe8-9644b1c5d20d]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:47 devstack sudo[101436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9 Sep 10 16:49:47 devstack sudo[101436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:48 devstack sudo[101436]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9" returned: 0 in 0.570s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9.fa113358-1085-40e2-9599-ca43c8d6d0cc {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:48 devstack sudo[101443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9.fa113358-1085-40e2-9599-ca43c8d6d0cc Sep 10 16:49:48 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:48 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9.fa113358-1085-40e2-9599-ca43c8d6d0cc" returned: 0 in 0.602s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9.fa113358-1085-40e2-9599-ca43c8d6d0cc {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:48 devstack sudo[101449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9.fa113358-1085-40e2-9599-ca43c8d6d0cc Sep 10 16:49:48 devstack sudo[101449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:49 devstack sudo[101449]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9.fa113358-1085-40e2-9599-ca43c8d6d0cc" returned: 0 in 0.461s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:49 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] Lock "cinder-quobyte-fa113358-1085-40e2-9599-ca43c8d6d0cc" released by "_delete_snapshot" :: held 2.353s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:49 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] Lock "cinder-quobyte-cde73cca-af08-4ec9-aa08-98a7eab674b9" released by "delete_snapshot" :: held 2.405s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:49 devstack cinder-volume[88189]: WARNING cinder.quota [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1023169866 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1023169866, it is now deprecated. Please use the default quota class for default quota. Sep 10 16:49:49 devstack cinder-volume[88189]: WARNING cinder.quota [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1023169866 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1023169866, it is now deprecated. Please use the default quota class for default quota. Sep 10 16:49:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:49:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:49:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:49:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:49 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] Created reservations ['f4c855e5-efe4-47d1-a3ce-c879634c026e', 'bca93612-d0f8-4591-b02c-c0206bf5ccc7', 'fa4d7ed5-cf39-44ed-b396-e521cfe1a6de', '47d73ddc-c802-4991-8874-987b60d4b9e8'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:49:49 devstack sudo[101452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:49:49 devstack sudo[101452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:49 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] Created reservations ['6ad3963e-bc0e-4aaf-aa6e-a865b9e3cfc9', '65e869ce-8131-409d-a9da-64944c27dc8f', '3e6e6314-9286-4316-8ef0-b6392f4feb4b', 'f9afbe82-9bbc-4ad3-990d-87d526df7558'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:49:49 devstack sudo[101452]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.382s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:49 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:49:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager._thread_info {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:49:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread count: 28 {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 16:49:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread info: [<_MainThread(MainThread, started 125792070905984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 16:49:49 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-4e2a7a6e-5830-476d-94ac-7aa136a19659 tempest-GroupSnapshotsTest-816808975 None] group_snapshot a243925e-bc04-499f-9dff-cbfd58f01a9c: deleted successfully Sep 10 16:49:51 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-af61dec3-05e6-4cc1-8924-a17ee992e64d tempest-GroupSnapshotsTest-816808975 None] Acquiring lock "cinder-quobyte-a885b334-4872-4211-93d0-92e44ac64185" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:49:51 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-af61dec3-05e6-4cc1-8924-a17ee992e64d tempest-GroupSnapshotsTest-816808975 None] Lock "cinder-quobyte-a885b334-4872-4211-93d0-92e44ac64185" acquired by "delete_volume" :: waited 0.034s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:49:51 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[73714d83-8564-4e7c-8334-f0990468a73e]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-af61dec3-05e6-4cc1-8924-a17ee992e64d tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:51 devstack sudo[101456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185 Sep 10 16:49:51 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:51 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:49:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Flow 'volume_create_manager' (55e371fc-64a9-4bd3-8afe-d34e36c993ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:49:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a928e984-c67c-4cf5-b471-847ac31a47ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a928e984-c67c-4cf5-b471-847ac31a47ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1663754593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8955915e-6128-491f-b1a6-7418a6a6f32f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f15f3299b6f3490da848995cf21b7e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:49:52Z,use_quota=True,user_id='1081a08efcbe422d87814dfccf6f2fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2f87a14-fa45-4b03-9ead-ff3e62cf01aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2f87a14-fa45-4b03-9ead-ff3e62cf01aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (415966c8-3db1-4cfc-b22e-d94fa22de37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:51 devstack cinder-volume[88189]: DEBUG cinder.image.glance [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Creating Keystone auth plugin from conf {{(pid=88189) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 16:49:51 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-af61dec3-05e6-4cc1-8924-a17ee992e64d tempest-GroupSnapshotsTest-816808975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185" returned: 0 in 0.576s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-af61dec3-05e6-4cc1-8924-a17ee992e64d tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:51 devstack sudo[101461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185 Sep 10 16:49:51 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (415966c8-3db1-4cfc-b22e-d94fa22de37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8955915e-6128-491f-b1a6-7418a6a6f32f', 'volume_name': 'volume-8955915e-6128-491f-b1a6-7418a6a6f32f', 'volume_size': 1, 'image_id': '5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dbb77788940a4d64b2cf7dbf5431f2a1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'created_at': datetime.datetime(2026, 9, 10, 14, 32, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 14, 32, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7600d3b-7e09-491a-aca9-135663923aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7600d3b-7e09-491a-aca9-135663923aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41176037-a713-41cd-9f88-5413709b7f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:52 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Volume 8955915e-6128-491f-b1a6-7418a6a6f32f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8955915e-6128-491f-b1a6-7418a6a6f32f', 'volume_size': 1, 'image_id': '5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dbb77788940a4d64b2cf7dbf5431f2a1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'created_at': datetime.datetime(2026, 9, 10, 14, 32, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 14, 32, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 16:49:52 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Trying to clone 8955915e-6128-491f-b1a6-7418a6a6f32f from image 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'metadata': {}}]). {{(pid=88189) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 16:49:52 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-af61dec3-05e6-4cc1-8924-a17ee992e64d tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a885b334-4872-4211-93d0-92e44ac64185" returned: 0 in 0.500s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:52 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-af61dec3-05e6-4cc1-8924-a17ee992e64d tempest-GroupSnapshotsTest-816808975 None] Lock "cinder-quobyte-a885b334-4872-4211-93d0-92e44ac64185" released by "delete_volume" :: held 1.246s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:52 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-af61dec3-05e6-4cc1-8924-a17ee992e64d tempest-GroupSnapshotsTest-816808975 None] Acquiring lock "cinder-quobyte-cde73cca-af08-4ec9-aa08-98a7eab674b9" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:49:52 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-af61dec3-05e6-4cc1-8924-a17ee992e64d tempest-GroupSnapshotsTest-816808975 None] Lock "cinder-quobyte-cde73cca-af08-4ec9-aa08-98a7eab674b9" acquired by "delete_volume" :: waited 0.102s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:49:52 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e04e9c2-d7d7-4eb6-972e-8e5aae2f839d]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-af61dec3-05e6-4cc1-8924-a17ee992e64d tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:52 devstack sudo[101466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9 Sep 10 16:49:52 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:53 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_29boswqtdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88189) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 16:49:53 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Image download 20.69 MB at 20.69 MB/s Sep 10 16:49:53 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[25002da8-5777-4ce9-a546-d2a67f825d7e]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_29boswqtdevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:53 devstack sudo[101469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_29boswqtdevstack@QuobyteHD Sep 10 16:49:53 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:53 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-af61dec3-05e6-4cc1-8924-a17ee992e64d tempest-GroupSnapshotsTest-816808975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9" returned: 0 in 0.799s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-af61dec3-05e6-4cc1-8924-a17ee992e64d tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:53 devstack sudo[101474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9 Sep 10 16:49:53 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:53 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_29boswqtdevstack@QuobyteHD" returned: 0 in 0.492s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:53 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Temporary image 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 is fetched for user 1081a08efcbe422d87814dfccf6f2fa5. {{(pid=88189) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 16:49:53 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9beb8fc5-3962-41c0-a6cc-72e4f65989ed]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_29boswqtdevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:53 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-af61dec3-05e6-4cc1-8924-a17ee992e64d tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cde73cca-af08-4ec9-aa08-98a7eab674b9" returned: 0 in 0.458s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:53 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-af61dec3-05e6-4cc1-8924-a17ee992e64d tempest-GroupSnapshotsTest-816808975 None] Lock "cinder-quobyte-cde73cca-af08-4ec9-aa08-98a7eab674b9" released by "delete_volume" :: held 1.434s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:49:54 devstack sudo[101479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_29boswqtdevstack@QuobyteHD Sep 10 16:49:54 devstack sudo[101479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:54 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-af61dec3-05e6-4cc1-8924-a17ee992e64d tempest-GroupSnapshotsTest-816808975 None] Created reservations ['8902b369-0114-4d9d-a53c-40db5312c09e'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:49:54 devstack cinder-volume[88189]: WARNING cinder.quota [None req-af61dec3-05e6-4cc1-8924-a17ee992e64d tempest-GroupSnapshotsTest-816808975 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1023169866 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1023169866, it is now deprecated. Please use the default quota class for default quota. Sep 10 16:49:54 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-af61dec3-05e6-4cc1-8924-a17ee992e64d tempest-GroupSnapshotsTest-816808975 None] Created reservations ['ef96733d-c7d9-451f-9c9a-788f5959e534', '6c6a2a8f-6791-4f2e-a851-ead149e98a0b', 'c955b334-452d-43f7-943d-2f5e21c520b5', '71144593-b29d-4c41-a8d1-19581cfde58c'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:49:54 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-af61dec3-05e6-4cc1-8924-a17ee992e64d tempest-GroupSnapshotsTest-816808975 None] Created reservations ['0a10a3b8-a6d0-4810-9211-df8880d9d13d', '07c08ef8-22df-4518-a317-e6f7f2ffc9d0', '68aba88e-bb9c-4499-b003-7f7d594dd181', 'c734d766-1098-43bc-a97b-48406326f2a9'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:49:54 devstack sudo[101479]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_29boswqtdevstack@QuobyteHD" returned: 0 in 0.660s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:54 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1663754593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8955915e-6128-491f-b1a6-7418a6a6f32f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f15f3299b6f3490da848995cf21b7e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:49:52Z,use_quota=True,user_id='1081a08efcbe422d87814dfccf6f2fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:49:54 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Creating volume 8955915e-6128-491f-b1a6-7418a6a6f32f {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:49:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:54 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:49:54 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:49:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:54 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:49:54 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:49:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8955915e-6128-491f-b1a6-7418a6a6f32f 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:54 devstack sudo[101485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8955915e-6128-491f-b1a6-7418a6a6f32f 1073741824 Sep 10 16:49:54 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-af61dec3-05e6-4cc1-8924-a17ee992e64d tempest-GroupSnapshotsTest-816808975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-af61dec3-05e6-4cc1-8924-a17ee992e64d tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:54 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-af61dec3-05e6-4cc1-8924-a17ee992e64d tempest-GroupSnapshotsTest-816808975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:49:54 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-af61dec3-05e6-4cc1-8924-a17ee992e64d tempest-GroupSnapshotsTest-816808975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:49:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-af61dec3-05e6-4cc1-8924-a17ee992e64d tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-af61dec3-05e6-4cc1-8924-a17ee992e64d tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:54 devstack sudo[101487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:49:54 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:55 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-af61dec3-05e6-4cc1-8924-a17ee992e64d tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.525s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:55 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-af61dec3-05e6-4cc1-8924-a17ee992e64d tempest-GroupSnapshotsTest-816808975 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:49:55 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-af61dec3-05e6-4cc1-8924-a17ee992e64d tempest-GroupSnapshotsTest-816808975 None] Delete group completed successfully. Sep 10 16:49:55 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8955915e-6128-491f-b1a6-7418a6a6f32f 1073741824" returned: 0 in 0.768s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8955915e-6128-491f-b1a6-7418a6a6f32f {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:55 devstack sudo[101494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8955915e-6128-491f-b1a6-7418a6a6f32f Sep 10 16:49:55 devstack sudo[101494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:55 devstack sudo[101494]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8955915e-6128-491f-b1a6-7418a6a6f32f" returned: 0 in 0.461s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:55 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:49:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:55 devstack cinder-volume[88189]: DEBUG cinder.volume.volume_utils [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Attempting download of 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'metadata': {}}])) to volume 8955915e-6128-491f-b1a6-7418a6a6f32f. {{(pid=88189) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 16:49:55 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6797adef-8293-4e47-b021-6e86c20355cd]: (4, 'raw') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_htnr8hoh {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:56 devstack sudo[101498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_htnr8hoh Sep 10 16:49:56 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:56 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-3044a57d-a3e6-4aff-b47b-9ac0e0cc4930 tempest-GroupSnapshotsTest-816808975 None] Group tempest-GroupSnapshotsTest-Group-612839679: creating Sep 10 16:49:56 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-3044a57d-a3e6-4aff-b47b-9ac0e0cc4930 tempest-GroupSnapshotsTest-816808975 None] Group tempest-GroupSnapshotsTest-Group-612839679: created successfully Sep 10 16:49:56 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-3044a57d-a3e6-4aff-b47b-9ac0e0cc4930 tempest-GroupSnapshotsTest-816808975 None] Create group completed successfully. Sep 10 16:49:56 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_htnr8hoh" returned: 0 in 0.552s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_htnr8hoh {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:56 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_htnr8hoh Sep 10 16:49:56 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:56 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_htnr8hoh" returned: 1 in 0.375s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_htnr8hoh' failed. Not Retrying. {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 16:49:56 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41e2178-30f6-4b5a-9737-8331da989e99]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:49:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_29boswqtdevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:56 devstack sudo[101506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_29boswqtdevstack@QuobyteHD Sep 10 16:49:56 devstack sudo[101506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:57 devstack sudo[101506]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_29boswqtdevstack@QuobyteHD" returned: 0 in 0.414s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:57 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 was qcow2, converting to qcow2 {{(pid=88189) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 16:49:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_29boswqtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8955915e-6128-491f-b1a6-7418a6a6f32f {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:57 devstack sudo[101514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_29boswqtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8955915e-6128-491f-b1a6-7418a6a6f32f Sep 10 16:49:57 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:58 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-b826acc4-5a0c-4783-9ec5-c717051511b7 tempest-GroupSnapshotsTest-816808975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:49:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b826acc4-5a0c-4783-9ec5-c717051511b7 tempest-GroupSnapshotsTest-816808975 None] Flow 'volume_create_manager' (4256a858-4926-4c6a-ae44-d54b828db1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:49:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b826acc4-5a0c-4783-9ec5-c717051511b7 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (996b2497-3ba9-40dd-982f-5cb6c3928495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b826acc4-5a0c-4783-9ec5-c717051511b7 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (996b2497-3ba9-40dd-982f-5cb6c3928495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:49:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2026324791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1a5e3fe1-3e5d-489d-98ad-7b19c8eb388a,host='devstack@QuobyteHD#QuobyteHD',id=8ff67525-a201-4e21-a6f6-4129c486a583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db7640a88dee43a0adaf652df2e8f4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:49:58Z,use_quota=True,user_id='db5cc2cff9be401f8716a3989358ac94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3046d949-8c45-4030-972a-16a2e7f480bc),volume_type_id=3046d949-8c45-4030-972a-16a2e7f480bc)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b826acc4-5a0c-4783-9ec5-c717051511b7 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (967d5103-9853-437a-a5fa-9d6404249bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b826acc4-5a0c-4783-9ec5-c717051511b7 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (967d5103-9853-437a-a5fa-9d6404249bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b826acc4-5a0c-4783-9ec5-c717051511b7 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35e43ce3-b333-4154-b939-91e700866783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b826acc4-5a0c-4783-9ec5-c717051511b7 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35e43ce3-b333-4154-b939-91e700866783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ff67525-a201-4e21-a6f6-4129c486a583', 'volume_name': 'volume-8ff67525-a201-4e21-a6f6-4129c486a583', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b826acc4-5a0c-4783-9ec5-c717051511b7 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f487c4-f50a-4189-85b2-6c8816a0d873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b826acc4-5a0c-4783-9ec5-c717051511b7 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f487c4-f50a-4189-85b2-6c8816a0d873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b826acc4-5a0c-4783-9ec5-c717051511b7 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (330c690d-d761-44c8-bd9c-673b7a2efb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:58 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-b826acc4-5a0c-4783-9ec5-c717051511b7 tempest-GroupSnapshotsTest-816808975 None] Volume 8ff67525-a201-4e21-a6f6-4129c486a583: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ff67525-a201-4e21-a6f6-4129c486a583', 'volume_size': 1} Sep 10 16:49:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b826acc4-5a0c-4783-9ec5-c717051511b7 tempest-GroupSnapshotsTest-816808975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b826acc4-5a0c-4783-9ec5-c717051511b7 tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:58 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b826acc4-5a0c-4783-9ec5-c717051511b7 tempest-GroupSnapshotsTest-816808975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1a5e3fe1-3e5d-489d-98ad-7b19c8eb388a,created_at=2026-09-10T14:49:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2026324791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1a5e3fe1-3e5d-489d-98ad-7b19c8eb388a,host='devstack@QuobyteHD#QuobyteHD',id=8ff67525-a201-4e21-a6f6-4129c486a583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db7640a88dee43a0adaf652df2e8f4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:49:58Z,use_quota=True,user_id='db5cc2cff9be401f8716a3989358ac94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3046d949-8c45-4030-972a-16a2e7f480bc),volume_type_id=3046d949-8c45-4030-972a-16a2e7f480bc)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:49:58 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-b826acc4-5a0c-4783-9ec5-c717051511b7 tempest-GroupSnapshotsTest-816808975 None] Creating volume 8ff67525-a201-4e21-a6f6-4129c486a583 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:49:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b826acc4-5a0c-4783-9ec5-c717051511b7 tempest-GroupSnapshotsTest-816808975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:49:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b826acc4-5a0c-4783-9ec5-c717051511b7 tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:49:58 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b826acc4-5a0c-4783-9ec5-c717051511b7 tempest-GroupSnapshotsTest-816808975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:49:58 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b826acc4-5a0c-4783-9ec5-c717051511b7 tempest-GroupSnapshotsTest-816808975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:49:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b826acc4-5a0c-4783-9ec5-c717051511b7 tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:58 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b826acc4-5a0c-4783-9ec5-c717051511b7 tempest-GroupSnapshotsTest-816808975 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:49:58 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-b826acc4-5a0c-4783-9ec5-c717051511b7 tempest-GroupSnapshotsTest-816808975 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:49:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b826acc4-5a0c-4783-9ec5-c717051511b7 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:58 devstack sudo[101521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583 1073741824 Sep 10 16:49:58 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:58 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b826acc4-5a0c-4783-9ec5-c717051511b7 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583 1073741824" returned: 0 in 0.681s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b826acc4-5a0c-4783-9ec5-c717051511b7 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:58 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583 Sep 10 16:49:58 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:49:59 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b826acc4-5a0c-4783-9ec5-c717051511b7 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583" returned: 0 in 0.394s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:59 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b826acc4-5a0c-4783-9ec5-c717051511b7 tempest-GroupSnapshotsTest-816808975 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:49:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b826acc4-5a0c-4783-9ec5-c717051511b7 tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:49:59 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b826acc4-5a0c-4783-9ec5-c717051511b7 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (330c690d-d761-44c8-bd9c-673b7a2efb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ff67525-a201-4e21-a6f6-4129c486a583', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:59 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b826acc4-5a0c-4783-9ec5-c717051511b7 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (485d3269-8a06-4ebe-b2a0-21a70365d773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:49:59 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-b826acc4-5a0c-4783-9ec5-c717051511b7 tempest-GroupSnapshotsTest-816808975 None] Volume volume-8ff67525-a201-4e21-a6f6-4129c486a583 (8ff67525-a201-4e21-a6f6-4129c486a583): created successfully Sep 10 16:49:59 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b826acc4-5a0c-4783-9ec5-c717051511b7 tempest-GroupSnapshotsTest-816808975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (485d3269-8a06-4ebe-b2a0-21a70365d773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:49:59 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b826acc4-5a0c-4783-9ec5-c717051511b7 tempest-GroupSnapshotsTest-816808975 None] Flow 'volume_create_manager' (4256a858-4926-4c6a-ae44-d54b828db1e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:49:59 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-b826acc4-5a0c-4783-9ec5-c717051511b7 tempest-GroupSnapshotsTest-816808975 None] Created volume successfully. Sep 10 16:49:59 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root Sep 10 16:49:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_29boswqtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8955915e-6128-491f-b1a6-7418a6a6f32f" returned: 0 in 2.580s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:49:59 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_29boswqtdevstack@QuobyteHD, size 112.00 MB, duration 2.58 sec, destination /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8955915e-6128-491f-b1a6-7418a6a6f32f {{(pid=88189) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 16:49:59 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Converted 112.00 MB image at 43.39 MB/s Sep 10 16:49:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8955915e-6128-491f-b1a6-7418a6a6f32f 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:49:59 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8955915e-6128-491f-b1a6-7418a6a6f32f 1G Sep 10 16:49:59 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:00 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8955915e-6128-491f-b1a6-7418a6a6f32f 1G" returned: 0 in 0.345s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:00 devstack cinder-volume[88189]: DEBUG cinder.volume.volume_utils [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Downloaded image 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'metadata': {}}])) to volume 8955915e-6128-491f-b1a6-7418a6a6f32f successfully. {{(pid=88189) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 16:50:00 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Temporary image 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 for user 1081a08efcbe422d87814dfccf6f2fa5 is deleted. {{(pid=88189) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 16:50:00 devstack cinder-volume[88189]: DEBUG cinder.volume.volume_utils [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Marking volume 8955915e-6128-491f-b1a6-7418a6a6f32f as bootable. {{(pid=88189) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 16:50:00 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Copying metadata from image 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 to 8955915e-6128-491f-b1a6-7418a6a6f32f. {{(pid=88189) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 16:50:00 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Creating volume glance metadata for volume 8955915e-6128-491f-b1a6-7418a6a6f32f backed by image 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88189) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 16:50:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41176037-a713-41cd-9f88-5413709b7f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8955915e-6128-491f-b1a6-7418a6a6f32f', 'volume_size': 1, 'image_id': '5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dbb77788940a4d64b2cf7dbf5431f2a1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'created_at': datetime.datetime(2026, 9, 10, 14, 32, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 14, 32, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3471b525-addd-42d2-8627-666d2a157fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:00 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Volume volume-8955915e-6128-491f-b1a6-7418a6a6f32f (8955915e-6128-491f-b1a6-7418a6a6f32f): created successfully Sep 10 16:50:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3471b525-addd-42d2-8627-666d2a157fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Flow 'volume_create_manager' (55e371fc-64a9-4bd3-8afe-d34e36c993ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:50:00 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-0b87ff72-31eb-4258-8f48-70469601a0b9 tempest-VolumesExtendTest-1993623185 None] Created volume successfully. Sep 10 16:50:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-cc1deedb-4d26-4d0b-9915-30c1e03129d8 tempest-VolumesExtendTest-1993623185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:50:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-cc1deedb-4d26-4d0b-9915-30c1e03129d8 tempest-VolumesExtendTest-1993623185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:50:00 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd506b8-3fdb-4572-a694-6e563e971abc]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:50:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cc1deedb-4d26-4d0b-9915-30c1e03129d8 tempest-VolumesExtendTest-1993623185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8955915e-6128-491f-b1a6-7418a6a6f32f {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:00 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-9ee797cc-166a-4494-95a0-f3facd2eae86 tempest-GroupSnapshotsTest-816808975 None] GroupSnapshot be06ad9a-d594-4e1d-8be3-18a7e4854e62: creating. Sep 10 16:50:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9ee797cc-166a-4494-95a0-f3facd2eae86 tempest-GroupSnapshotsTest-816808975 None] Group snapshot be06ad9a-d594-4e1d-8be3-18a7e4854e62: creating. {{(pid=88189) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 10 16:50:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9ee797cc-166a-4494-95a0-f3facd2eae86 tempest-GroupSnapshotsTest-816808975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:50:00 devstack sudo[101576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8955915e-6128-491f-b1a6-7418a6a6f32f Sep 10 16:50:00 devstack sudo[101576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:01 devstack sudo[101576]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cc1deedb-4d26-4d0b-9915-30c1e03129d8 tempest-VolumesExtendTest-1993623185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8955915e-6128-491f-b1a6-7418a6a6f32f" returned: 0 in 0.401s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cc1deedb-4d26-4d0b-9915-30c1e03129d8 tempest-VolumesExtendTest-1993623185 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8955915e-6128-491f-b1a6-7418a6a6f32f 2G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cc1deedb-4d26-4d0b-9915-30c1e03129d8 tempest-VolumesExtendTest-1993623185 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8955915e-6128-491f-b1a6-7418a6a6f32f 2G" returned: 0 in 0.097s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-cc1deedb-4d26-4d0b-9915-30c1e03129d8 tempest-VolumesExtendTest-1993623185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.546s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:50:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9ee797cc-166a-4494-95a0-f3facd2eae86 tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.430s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:50:01 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-9ee797cc-166a-4494-95a0-f3facd2eae86 tempest-GroupSnapshotsTest-816808975 None] Creating offline snapshot c7bb0402-16f6-4771-8eb2-516c9ebb9cb7 of volume 8ff67525-a201-4e21-a6f6-4129c486a583 {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:50:01 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[183a609d-42a2-456a-b174-489d766c0ec0]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:50:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9ee797cc-166a-4494-95a0-f3facd2eae86 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:01 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-cc1deedb-4d26-4d0b-9915-30c1e03129d8 tempest-VolumesExtendTest-1993623185 None] Extend volume completed successfully. Sep 10 16:50:01 devstack sudo[101584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583 Sep 10 16:50:01 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:01 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9ee797cc-166a-4494-95a0-f3facd2eae86 tempest-GroupSnapshotsTest-816808975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583" returned: 0 in 0.403s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9ee797cc-166a-4494-95a0-f3facd2eae86 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583.c7bb0402-16f6-4771-8eb2-516c9ebb9cb7 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:01 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583.c7bb0402-16f6-4771-8eb2-516c9ebb9cb7 1G Sep 10 16:50:01 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:02 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9ee797cc-166a-4494-95a0-f3facd2eae86 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583.c7bb0402-16f6-4771-8eb2-516c9ebb9cb7 1G" returned: 0 in 0.465s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9ee797cc-166a-4494-95a0-f3facd2eae86 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ff67525-a201-4e21-a6f6-4129c486a583 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583.c7bb0402-16f6-4771-8eb2-516c9ebb9cb7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:02 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ff67525-a201-4e21-a6f6-4129c486a583 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583.c7bb0402-16f6-4771-8eb2-516c9ebb9cb7 Sep 10 16:50:02 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-aa5613d2-ac26-4e14-9a18-6c627c3b6d00 tempest-VolumesExtendTest-1993623185 None] Acquiring lock "cinder-8955915e-6128-491f-b1a6-7418a6a6f32f-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:50:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-aa5613d2-ac26-4e14-9a18-6c627c3b6d00 tempest-VolumesExtendTest-1993623185 None] Lock "cinder-8955915e-6128-491f-b1a6-7418a6a6f32f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:50:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-aa5613d2-ac26-4e14-9a18-6c627c3b6d00 tempest-VolumesExtendTest-1993623185 None] Acquiring lock "cinder-quobyte-8955915e-6128-491f-b1a6-7418a6a6f32f" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:50:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-aa5613d2-ac26-4e14-9a18-6c627c3b6d00 tempest-VolumesExtendTest-1993623185 None] Lock "cinder-quobyte-8955915e-6128-491f-b1a6-7418a6a6f32f" acquired by "delete_volume" :: waited 0.018s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:50:02 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75867ee-ccff-47f9-9f4e-867f7bfc98ae]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:50:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-aa5613d2-ac26-4e14-9a18-6c627c3b6d00 tempest-VolumesExtendTest-1993623185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8955915e-6128-491f-b1a6-7418a6a6f32f {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:02 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9ee797cc-166a-4494-95a0-f3facd2eae86 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ff67525-a201-4e21-a6f6-4129c486a583 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583.c7bb0402-16f6-4771-8eb2-516c9ebb9cb7" returned: 0 in 0.334s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:02 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-9ee797cc-166a-4494-95a0-f3facd2eae86 tempest-GroupSnapshotsTest-816808975 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583.c7bb0402-16f6-4771-8eb2-516c9ebb9cb7 is being set with open permissions: ugo+rw: NotImplementedError Sep 10 16:50:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9ee797cc-166a-4494-95a0-f3facd2eae86 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583.c7bb0402-16f6-4771-8eb2-516c9ebb9cb7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:02 devstack sudo[101600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583.c7bb0402-16f6-4771-8eb2-516c9ebb9cb7 Sep 10 16:50:02 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:02 devstack sudo[101599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8955915e-6128-491f-b1a6-7418a6a6f32f Sep 10 16:50:02 devstack sudo[101599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:02 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9ee797cc-166a-4494-95a0-f3facd2eae86 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583.c7bb0402-16f6-4771-8eb2-516c9ebb9cb7" returned: 0 in 0.250s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9ee797cc-166a-4494-95a0-f3facd2eae86 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:02 devstack sudo[101606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583.info Sep 10 16:50:02 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:03 devstack sudo[101599]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-aa5613d2-ac26-4e14-9a18-6c627c3b6d00 tempest-VolumesExtendTest-1993623185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8955915e-6128-491f-b1a6-7418a6a6f32f" returned: 0 in 0.448s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-aa5613d2-ac26-4e14-9a18-6c627c3b6d00 tempest-VolumesExtendTest-1993623185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8955915e-6128-491f-b1a6-7418a6a6f32f {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:03 devstack sudo[101609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8955915e-6128-491f-b1a6-7418a6a6f32f Sep 10 16:50:03 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:03 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9ee797cc-166a-4494-95a0-f3facd2eae86 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583.info" returned: 0 in 0.318s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:03 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-9ee797cc-166a-4494-95a0-f3facd2eae86 tempest-GroupSnapshotsTest-816808975 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583.info is being set with open permissions: ugo+rw: NotImplementedError Sep 10 16:50:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9ee797cc-166a-4494-95a0-f3facd2eae86 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:03 devstack sudo[101612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583.info Sep 10 16:50:03 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:03 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-aa5613d2-ac26-4e14-9a18-6c627c3b6d00 tempest-VolumesExtendTest-1993623185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8955915e-6128-491f-b1a6-7418a6a6f32f" returned: 0 in 0.282s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-aa5613d2-ac26-4e14-9a18-6c627c3b6d00 tempest-VolumesExtendTest-1993623185 None] Lock "cinder-quobyte-8955915e-6128-491f-b1a6-7418a6a6f32f" released by "delete_volume" :: held 0.771s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:50:03 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-aa5613d2-ac26-4e14-9a18-6c627c3b6d00 tempest-VolumesExtendTest-1993623185 None] Created reservations ['0d6c8afd-5f50-4272-a350-20dbedce7e79', '43109266-1087-4074-a8c5-3da63b6f14e3', '1ccdef6f-e816-4d6c-9275-603964a1a65d', '8bff13b6-82d9-489f-9faa-97bd2f9c2e66'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:50:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-aa5613d2-ac26-4e14-9a18-6c627c3b6d00 tempest-VolumesExtendTest-1993623185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:50:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-aa5613d2-ac26-4e14-9a18-6c627c3b6d00 tempest-VolumesExtendTest-1993623185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:50:03 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-aa5613d2-ac26-4e14-9a18-6c627c3b6d00 tempest-VolumesExtendTest-1993623185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:50:03 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-aa5613d2-ac26-4e14-9a18-6c627c3b6d00 tempest-VolumesExtendTest-1993623185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:50:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-aa5613d2-ac26-4e14-9a18-6c627c3b6d00 tempest-VolumesExtendTest-1993623185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:50:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-aa5613d2-ac26-4e14-9a18-6c627c3b6d00 tempest-VolumesExtendTest-1993623185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:03 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:50:03 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:03 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9ee797cc-166a-4494-95a0-f3facd2eae86 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583.info" returned: 0 in 0.258s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9ee797cc-166a-4494-95a0-f3facd2eae86 tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.182s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:50:03 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-9ee797cc-166a-4494-95a0-f3facd2eae86 tempest-GroupSnapshotsTest-816808975 None] group_snapshot be06ad9a-d594-4e1d-8be3-18a7e4854e62: created successfully Sep 10 16:50:03 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-aa5613d2-ac26-4e14-9a18-6c627c3b6d00 tempest-VolumesExtendTest-1993623185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.257s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:03 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-aa5613d2-ac26-4e14-9a18-6c627c3b6d00 tempest-VolumesExtendTest-1993623185 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:50:03 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-aa5613d2-ac26-4e14-9a18-6c627c3b6d00 tempest-VolumesExtendTest-1993623185 None] Deleted volume successfully. Sep 10 16:50:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-aa5613d2-ac26-4e14-9a18-6c627c3b6d00 tempest-VolumesExtendTest-1993623185 None] Lock "cinder-8955915e-6128-491f-b1a6-7418a6a6f32f-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-446f54bd-40da-4f77-b349-0978b4202121 tempest-VolumesExtendTest-1993623185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-446f54bd-40da-4f77-b349-0978b4202121 tempest-VolumesExtendTest-1993623185 None] Flow 'volume_create_manager' (35d37792-b274-485a-86ac-d844a3bb3963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-446f54bd-40da-4f77-b349-0978b4202121 tempest-VolumesExtendTest-1993623185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97971a5-3a34-4316-bc05-eb6119351d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-446f54bd-40da-4f77-b349-0978b4202121 tempest-VolumesExtendTest-1993623185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97971a5-3a34-4316-bc05-eb6119351d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1826093056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b0ebbec-7d64-4670-b4a1-6f91a5978857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f15f3299b6f3490da848995cf21b7e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:50:04Z,use_quota=True,user_id='1081a08efcbe422d87814dfccf6f2fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-446f54bd-40da-4f77-b349-0978b4202121 tempest-VolumesExtendTest-1993623185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da31d34f-bffa-41b9-958e-8fb180824090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-446f54bd-40da-4f77-b349-0978b4202121 tempest-VolumesExtendTest-1993623185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da31d34f-bffa-41b9-958e-8fb180824090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-446f54bd-40da-4f77-b349-0978b4202121 tempest-VolumesExtendTest-1993623185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef78f0a-64ad-487f-91ff-3c39707507d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-446f54bd-40da-4f77-b349-0978b4202121 tempest-VolumesExtendTest-1993623185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef78f0a-64ad-487f-91ff-3c39707507d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b0ebbec-7d64-4670-b4a1-6f91a5978857', 'volume_name': 'volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-446f54bd-40da-4f77-b349-0978b4202121 tempest-VolumesExtendTest-1993623185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6136e4a-4833-4c66-8a28-c9d3f1a52710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-446f54bd-40da-4f77-b349-0978b4202121 tempest-VolumesExtendTest-1993623185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6136e4a-4833-4c66-8a28-c9d3f1a52710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-446f54bd-40da-4f77-b349-0978b4202121 tempest-VolumesExtendTest-1993623185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (601c1185-6731-45bf-8b0a-55358651fc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:04 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-446f54bd-40da-4f77-b349-0978b4202121 tempest-VolumesExtendTest-1993623185 None] Volume 5b0ebbec-7d64-4670-b4a1-6f91a5978857: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857', 'volume_size': 1} Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-446f54bd-40da-4f77-b349-0978b4202121 tempest-VolumesExtendTest-1993623185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-446f54bd-40da-4f77-b349-0978b4202121 tempest-VolumesExtendTest-1993623185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-446f54bd-40da-4f77-b349-0978b4202121 tempest-VolumesExtendTest-1993623185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1826093056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b0ebbec-7d64-4670-b4a1-6f91a5978857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f15f3299b6f3490da848995cf21b7e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:50:04Z,use_quota=True,user_id='1081a08efcbe422d87814dfccf6f2fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-446f54bd-40da-4f77-b349-0978b4202121 tempest-VolumesExtendTest-1993623185 None] Creating volume 5b0ebbec-7d64-4670-b4a1-6f91a5978857 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-446f54bd-40da-4f77-b349-0978b4202121 tempest-VolumesExtendTest-1993623185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-446f54bd-40da-4f77-b349-0978b4202121 tempest-VolumesExtendTest-1993623185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-446f54bd-40da-4f77-b349-0978b4202121 tempest-VolumesExtendTest-1993623185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-446f54bd-40da-4f77-b349-0978b4202121 tempest-VolumesExtendTest-1993623185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-446f54bd-40da-4f77-b349-0978b4202121 tempest-VolumesExtendTest-1993623185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-446f54bd-40da-4f77-b349-0978b4202121 tempest-VolumesExtendTest-1993623185 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:50:04 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-446f54bd-40da-4f77-b349-0978b4202121 tempest-VolumesExtendTest-1993623185 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-446f54bd-40da-4f77-b349-0978b4202121 tempest-VolumesExtendTest-1993623185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:04 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-9648de5d-a661-4c95-aa36-e7456fb7cc2b tempest-GroupSnapshotsTest-816808975 None] group_snapshot be06ad9a-d594-4e1d-8be3-18a7e4854e62: deleting Sep 10 16:50:04 devstack sudo[101619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857 1073741824 Sep 10 16:50:04 devstack sudo[101619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9648de5d-a661-4c95-aa36-e7456fb7cc2b tempest-GroupSnapshotsTest-816808975 None] group_snapshot be06ad9a-d594-4e1d-8be3-18a7e4854e62: deleting {{(pid=88189) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9648de5d-a661-4c95-aa36-e7456fb7cc2b tempest-GroupSnapshotsTest-816808975 None] Acquiring lock "cinder-quobyte-8ff67525-a201-4e21-a6f6-4129c486a583" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9648de5d-a661-4c95-aa36-e7456fb7cc2b tempest-GroupSnapshotsTest-816808975 None] Lock "cinder-quobyte-8ff67525-a201-4e21-a6f6-4129c486a583" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9648de5d-a661-4c95-aa36-e7456fb7cc2b tempest-GroupSnapshotsTest-816808975 None] Acquiring lock "cinder-quobyte-c7bb0402-16f6-4771-8eb2-516c9ebb9cb7" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9648de5d-a661-4c95-aa36-e7456fb7cc2b tempest-GroupSnapshotsTest-816808975 None] Lock "cinder-quobyte-c7bb0402-16f6-4771-8eb2-516c9ebb9cb7" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-9648de5d-a661-4c95-aa36-e7456fb7cc2b tempest-GroupSnapshotsTest-816808975 None] Deleting offline snapshot c7bb0402-16f6-4771-8eb2-516c9ebb9cb7 of volume 8ff67525-a201-4e21-a6f6-4129c486a583 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-9648de5d-a661-4c95-aa36-e7456fb7cc2b tempest-GroupSnapshotsTest-816808975 None] snapshot_file for this snap is: volume-8ff67525-a201-4e21-a6f6-4129c486a583.c7bb0402-16f6-4771-8eb2-516c9ebb9cb7 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6167df-b911-4bf9-a326-d141dd59ae81]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9648de5d-a661-4c95-aa36-e7456fb7cc2b tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583.c7bb0402-16f6-4771-8eb2-516c9ebb9cb7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:04 devstack sudo[101621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583.c7bb0402-16f6-4771-8eb2-516c9ebb9cb7 Sep 10 16:50:04 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:04 devstack sudo[101619]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-446f54bd-40da-4f77-b349-0978b4202121 tempest-VolumesExtendTest-1993623185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857 1073741824" returned: 0 in 0.505s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-446f54bd-40da-4f77-b349-0978b4202121 tempest-VolumesExtendTest-1993623185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:04 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857 Sep 10 16:50:04 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:04 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9648de5d-a661-4c95-aa36-e7456fb7cc2b tempest-GroupSnapshotsTest-816808975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583.c7bb0402-16f6-4771-8eb2-516c9ebb9cb7" returned: 0 in 0.430s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-9648de5d-a661-4c95-aa36-e7456fb7cc2b tempest-GroupSnapshotsTest-816808975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ff67525-a201-4e21-a6f6-4129c486a583(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a2c285-3d35-4075-b154-1dff5660b925]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:50:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9648de5d-a661-4c95-aa36-e7456fb7cc2b tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:05 devstack sudo[101637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583 Sep 10 16:50:05 devstack sudo[101637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:05 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-446f54bd-40da-4f77-b349-0978b4202121 tempest-VolumesExtendTest-1993623185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857" returned: 0 in 0.318s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-446f54bd-40da-4f77-b349-0978b4202121 tempest-VolumesExtendTest-1993623185 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:50:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-446f54bd-40da-4f77-b349-0978b4202121 tempest-VolumesExtendTest-1993623185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:50:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-446f54bd-40da-4f77-b349-0978b4202121 tempest-VolumesExtendTest-1993623185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (601c1185-6731-45bf-8b0a-55358651fc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-446f54bd-40da-4f77-b349-0978b4202121 tempest-VolumesExtendTest-1993623185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc02509b-697f-42c4-acac-d8c112a27c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:05 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-446f54bd-40da-4f77-b349-0978b4202121 tempest-VolumesExtendTest-1993623185 None] Volume volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857 (5b0ebbec-7d64-4670-b4a1-6f91a5978857): created successfully Sep 10 16:50:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-446f54bd-40da-4f77-b349-0978b4202121 tempest-VolumesExtendTest-1993623185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc02509b-697f-42c4-acac-d8c112a27c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-446f54bd-40da-4f77-b349-0978b4202121 tempest-VolumesExtendTest-1993623185 None] Flow 'volume_create_manager' (35d37792-b274-485a-86ac-d844a3bb3963) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:50:05 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-446f54bd-40da-4f77-b349-0978b4202121 tempest-VolumesExtendTest-1993623185 None] Created volume successfully. Sep 10 16:50:05 devstack sudo[101637]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9648de5d-a661-4c95-aa36-e7456fb7cc2b tempest-GroupSnapshotsTest-816808975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583" returned: 0 in 0.439s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9648de5d-a661-4c95-aa36-e7456fb7cc2b tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583.c7bb0402-16f6-4771-8eb2-516c9ebb9cb7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:05 devstack sudo[101643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583.c7bb0402-16f6-4771-8eb2-516c9ebb9cb7 Sep 10 16:50:05 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:05 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9648de5d-a661-4c95-aa36-e7456fb7cc2b tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583.c7bb0402-16f6-4771-8eb2-516c9ebb9cb7" returned: 0 in 0.417s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9648de5d-a661-4c95-aa36-e7456fb7cc2b tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583.c7bb0402-16f6-4771-8eb2-516c9ebb9cb7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:05 devstack sudo[101649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583.c7bb0402-16f6-4771-8eb2-516c9ebb9cb7 Sep 10 16:50:05 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:06 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9648de5d-a661-4c95-aa36-e7456fb7cc2b tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583.c7bb0402-16f6-4771-8eb2-516c9ebb9cb7" returned: 0 in 0.311s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:06 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9648de5d-a661-4c95-aa36-e7456fb7cc2b tempest-GroupSnapshotsTest-816808975 None] Lock "cinder-quobyte-c7bb0402-16f6-4771-8eb2-516c9ebb9cb7" released by "_delete_snapshot" :: held 1.736s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:50:06 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9648de5d-a661-4c95-aa36-e7456fb7cc2b tempest-GroupSnapshotsTest-816808975 None] Lock "cinder-quobyte-8ff67525-a201-4e21-a6f6-4129c486a583" released by "delete_snapshot" :: held 1.770s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:50:06 devstack cinder-volume[88189]: WARNING cinder.quota [None req-9648de5d-a661-4c95-aa36-e7456fb7cc2b tempest-GroupSnapshotsTest-816808975 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-191962280 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-191962280, it is now deprecated. Please use the default quota class for default quota. Sep 10 16:50:06 devstack cinder-volume[88189]: WARNING cinder.quota [None req-9648de5d-a661-4c95-aa36-e7456fb7cc2b tempest-GroupSnapshotsTest-816808975 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-191962280 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-191962280, it is now deprecated. Please use the default quota class for default quota. Sep 10 16:50:06 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-9648de5d-a661-4c95-aa36-e7456fb7cc2b tempest-GroupSnapshotsTest-816808975 None] Created reservations ['f0529078-59d6-44d7-853c-95c28e886bae', 'a0634a4c-b88c-4137-b1a8-6d4cc22176be', '6f8d1b30-eb91-4af9-8528-b3f165b1eb25', '19386070-64a4-433b-80e5-d02173ce4fea'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:50:06 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-9648de5d-a661-4c95-aa36-e7456fb7cc2b tempest-GroupSnapshotsTest-816808975 None] group_snapshot be06ad9a-d594-4e1d-8be3-18a7e4854e62: deleted successfully Sep 10 16:50:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f333e70c-637a-4c53-ada4-134b0673890c tempest-VolumesExtendTest-1993623185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:50:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f333e70c-637a-4c53-ada4-134b0673890c tempest-VolumesExtendTest-1993623185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:50:06 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-f333e70c-637a-4c53-ada4-134b0673890c tempest-VolumesExtendTest-1993623185 None] Creating offline snapshot afed0b02-2512-4f01-9b16-8d6af3773347 of volume 5b0ebbec-7d64-4670-b4a1-6f91a5978857 {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:50:06 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede4494f-f562-480f-bfe6-ad0d67460cf3]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:50:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f333e70c-637a-4c53-ada4-134b0673890c tempest-VolumesExtendTest-1993623185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:06 devstack sudo[101653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857 Sep 10 16:50:06 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:07 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f333e70c-637a-4c53-ada4-134b0673890c tempest-VolumesExtendTest-1993623185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857" returned: 0 in 0.627s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f333e70c-637a-4c53-ada4-134b0673890c tempest-VolumesExtendTest-1993623185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857.afed0b02-2512-4f01-9b16-8d6af3773347 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:07 devstack sudo[101658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857.afed0b02-2512-4f01-9b16-8d6af3773347 1G Sep 10 16:50:07 devstack sudo[101658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:07 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6158d353-66e0-4270-aee0-85c68c118388 tempest-GroupSnapshotsTest-816808975 None] Acquiring lock "cinder-quobyte-8ff67525-a201-4e21-a6f6-4129c486a583" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:50:07 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6158d353-66e0-4270-aee0-85c68c118388 tempest-GroupSnapshotsTest-816808975 None] Lock "cinder-quobyte-8ff67525-a201-4e21-a6f6-4129c486a583" acquired by "delete_volume" :: waited 0.051s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:50:07 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce87cf3-4ad8-4b98-9f34-ebe9db72b332]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:50:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6158d353-66e0-4270-aee0-85c68c118388 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:07 devstack sudo[101660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583 Sep 10 16:50:07 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:07 devstack sudo[101658]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f333e70c-637a-4c53-ada4-134b0673890c tempest-VolumesExtendTest-1993623185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857.afed0b02-2512-4f01-9b16-8d6af3773347 1G" returned: 0 in 0.739s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f333e70c-637a-4c53-ada4-134b0673890c tempest-VolumesExtendTest-1993623185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857.afed0b02-2512-4f01-9b16-8d6af3773347 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:08 devstack sudo[101668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857.afed0b02-2512-4f01-9b16-8d6af3773347 Sep 10 16:50:08 devstack sudo[101668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:08 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6158d353-66e0-4270-aee0-85c68c118388 tempest-GroupSnapshotsTest-816808975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583" returned: 0 in 0.579s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6158d353-66e0-4270-aee0-85c68c118388 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:08 devstack sudo[101670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583 Sep 10 16:50:08 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:08 devstack sudo[101668]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f333e70c-637a-4c53-ada4-134b0673890c tempest-VolumesExtendTest-1993623185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857.afed0b02-2512-4f01-9b16-8d6af3773347" returned: 0 in 0.517s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:08 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-f333e70c-637a-4c53-ada4-134b0673890c tempest-VolumesExtendTest-1993623185 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857.afed0b02-2512-4f01-9b16-8d6af3773347 is being set with open permissions: ugo+rw Sep 10 16:50:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f333e70c-637a-4c53-ada4-134b0673890c tempest-VolumesExtendTest-1993623185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857.afed0b02-2512-4f01-9b16-8d6af3773347 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:08 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6158d353-66e0-4270-aee0-85c68c118388 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ff67525-a201-4e21-a6f6-4129c486a583" returned: 0 in 0.453s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:08 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857.afed0b02-2512-4f01-9b16-8d6af3773347 Sep 10 16:50:08 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:08 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6158d353-66e0-4270-aee0-85c68c118388 tempest-GroupSnapshotsTest-816808975 None] Lock "cinder-quobyte-8ff67525-a201-4e21-a6f6-4129c486a583" released by "delete_volume" :: held 1.175s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:50:08 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-6158d353-66e0-4270-aee0-85c68c118388 tempest-GroupSnapshotsTest-816808975 None] Created reservations ['17fc69e8-a380-4b38-93f4-cc90785dcf30'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:50:08 devstack cinder-volume[88189]: WARNING cinder.quota [None req-6158d353-66e0-4270-aee0-85c68c118388 tempest-GroupSnapshotsTest-816808975 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-191962280 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-191962280, it is now deprecated. Please use the default quota class for default quota. Sep 10 16:50:08 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-6158d353-66e0-4270-aee0-85c68c118388 tempest-GroupSnapshotsTest-816808975 None] Created reservations ['67528ec6-3528-48a1-bb2c-8bd6869974a7', '249f822e-c0d8-4b86-881a-023dbf70cb8a', 'ed83e9e9-2ad6-4089-b66f-640df79a5e88', '7cc46476-ef43-473c-99d0-9a0f727e9769'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:50:08 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6158d353-66e0-4270-aee0-85c68c118388 tempest-GroupSnapshotsTest-816808975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:50:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6158d353-66e0-4270-aee0-85c68c118388 tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:50:08 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6158d353-66e0-4270-aee0-85c68c118388 tempest-GroupSnapshotsTest-816808975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:50:08 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6158d353-66e0-4270-aee0-85c68c118388 tempest-GroupSnapshotsTest-816808975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:50:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6158d353-66e0-4270-aee0-85c68c118388 tempest-GroupSnapshotsTest-816808975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:50:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6158d353-66e0-4270-aee0-85c68c118388 tempest-GroupSnapshotsTest-816808975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f333e70c-637a-4c53-ada4-134b0673890c tempest-VolumesExtendTest-1993623185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857.afed0b02-2512-4f01-9b16-8d6af3773347" returned: 0 in 0.429s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:08 devstack sudo[101679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:50:08 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f333e70c-637a-4c53-ada4-134b0673890c tempest-VolumesExtendTest-1993623185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:09 devstack sudo[101681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857.info Sep 10 16:50:09 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:09 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6158d353-66e0-4270-aee0-85c68c118388 tempest-GroupSnapshotsTest-816808975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.297s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:09 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-6158d353-66e0-4270-aee0-85c68c118388 tempest-GroupSnapshotsTest-816808975 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:50:09 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-6158d353-66e0-4270-aee0-85c68c118388 tempest-GroupSnapshotsTest-816808975 None] Delete group completed successfully. Sep 10 16:50:09 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f333e70c-637a-4c53-ada4-134b0673890c tempest-VolumesExtendTest-1993623185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857.info" returned: 0 in 0.368s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:09 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-f333e70c-637a-4c53-ada4-134b0673890c tempest-VolumesExtendTest-1993623185 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857.info is being set with open permissions: ugo+rw Sep 10 16:50:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f333e70c-637a-4c53-ada4-134b0673890c tempest-VolumesExtendTest-1993623185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:09 devstack sudo[101688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857.info Sep 10 16:50:09 devstack sudo[101688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:09 devstack sudo[101688]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f333e70c-637a-4c53-ada4-134b0673890c tempest-VolumesExtendTest-1993623185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857.info" returned: 0 in 0.293s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f333e70c-637a-4c53-ada4-134b0673890c tempest-VolumesExtendTest-1993623185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.110s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:50:09 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-f333e70c-637a-4c53-ada4-134b0673890c tempest-VolumesExtendTest-1993623185 None] Create snapshot completed successfully Sep 10 16:50:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-70f903fc-0701-4bff-a750-2e9e80261043 tempest-VolumesExtendTest-1993623185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:50:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-70f903fc-0701-4bff-a750-2e9e80261043 tempest-VolumesExtendTest-1993623185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:50:10 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bf4287-6027-4d96-bbf9-af105abc3547]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:50:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-70f903fc-0701-4bff-a750-2e9e80261043 tempest-VolumesExtendTest-1993623185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:11 devstack sudo[101696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857 Sep 10 16:50:11 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:11 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-70f903fc-0701-4bff-a750-2e9e80261043 tempest-VolumesExtendTest-1993623185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857" returned: 0 in 0.591s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-70f903fc-0701-4bff-a750-2e9e80261043 tempest-VolumesExtendTest-1993623185 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857.afed0b02-2512-4f01-9b16-8d6af3773347 2G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-70f903fc-0701-4bff-a750-2e9e80261043 tempest-VolumesExtendTest-1993623185 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857.afed0b02-2512-4f01-9b16-8d6af3773347 2G" returned: 0 in 0.245s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-70f903fc-0701-4bff-a750-2e9e80261043 tempest-VolumesExtendTest-1993623185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.882s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:50:11 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-70f903fc-0701-4bff-a750-2e9e80261043 tempest-VolumesExtendTest-1993623185 None] Extend volume completed successfully. Sep 10 16:50:12 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-56b1e766-86c0-4f0a-8492-d22b3bf95759 tempest-VolumesExtendTest-1993623185 None] Acquiring lock "cinder-afed0b02-2512-4f01-9b16-8d6af3773347-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:50:12 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-56b1e766-86c0-4f0a-8492-d22b3bf95759 tempest-VolumesExtendTest-1993623185 None] Lock "cinder-afed0b02-2512-4f01-9b16-8d6af3773347-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:50:12 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-56b1e766-86c0-4f0a-8492-d22b3bf95759 tempest-VolumesExtendTest-1993623185 None] Acquiring lock "cinder-quobyte-5b0ebbec-7d64-4670-b4a1-6f91a5978857" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:50:12 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-56b1e766-86c0-4f0a-8492-d22b3bf95759 tempest-VolumesExtendTest-1993623185 None] Lock "cinder-quobyte-5b0ebbec-7d64-4670-b4a1-6f91a5978857" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:50:12 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-56b1e766-86c0-4f0a-8492-d22b3bf95759 tempest-VolumesExtendTest-1993623185 None] Acquiring lock "cinder-quobyte-afed0b02-2512-4f01-9b16-8d6af3773347" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:50:12 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-56b1e766-86c0-4f0a-8492-d22b3bf95759 tempest-VolumesExtendTest-1993623185 None] Lock "cinder-quobyte-afed0b02-2512-4f01-9b16-8d6af3773347" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:50:12 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-56b1e766-86c0-4f0a-8492-d22b3bf95759 tempest-VolumesExtendTest-1993623185 None] Deleting offline snapshot afed0b02-2512-4f01-9b16-8d6af3773347 of volume 5b0ebbec-7d64-4670-b4a1-6f91a5978857 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:50:12 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-56b1e766-86c0-4f0a-8492-d22b3bf95759 tempest-VolumesExtendTest-1993623185 None] snapshot_file for this snap is: volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857.afed0b02-2512-4f01-9b16-8d6af3773347 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:50:12 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcd9a57-b8b2-45fa-9fa5-8a258bec7c9e]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:50:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56b1e766-86c0-4f0a-8492-d22b3bf95759 tempest-VolumesExtendTest-1993623185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857.afed0b02-2512-4f01-9b16-8d6af3773347 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:12 devstack sudo[101714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857.afed0b02-2512-4f01-9b16-8d6af3773347 Sep 10 16:50:12 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:12 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56b1e766-86c0-4f0a-8492-d22b3bf95759 tempest-VolumesExtendTest-1993623185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857.afed0b02-2512-4f01-9b16-8d6af3773347" returned: 0 in 0.514s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:12 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-56b1e766-86c0-4f0a-8492-d22b3bf95759 tempest-VolumesExtendTest-1993623185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:50:12 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5d29d8-b9b3-4002-b3f1-bdcd29dde6ac]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:50:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56b1e766-86c0-4f0a-8492-d22b3bf95759 tempest-VolumesExtendTest-1993623185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:13 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857 Sep 10 16:50:13 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:13 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56b1e766-86c0-4f0a-8492-d22b3bf95759 tempest-VolumesExtendTest-1993623185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857" returned: 0 in 0.942s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56b1e766-86c0-4f0a-8492-d22b3bf95759 tempest-VolumesExtendTest-1993623185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857.afed0b02-2512-4f01-9b16-8d6af3773347 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:13 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857.afed0b02-2512-4f01-9b16-8d6af3773347 Sep 10 16:50:13 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:14 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-ecac1b8d-6748-4ffc-87d9-c5f5f8fefeb0 req-5da03f71-6420-46b5-afa7-7965a74db460 tempest-TestShelveInstance-182807223 None] Terminate volume connection completed successfully. Sep 10 16:50:14 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-ecac1b8d-6748-4ffc-87d9-c5f5f8fefeb0 req-5da03f71-6420-46b5-afa7-7965a74db460 tempest-TestShelveInstance-182807223 None] Deleting attachment 47b183ae-7e39-43e0-bc3a-a9de41cd0ce1. {{(pid=88189) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 16:50:14 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56b1e766-86c0-4f0a-8492-d22b3bf95759 tempest-VolumesExtendTest-1993623185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857.afed0b02-2512-4f01-9b16-8d6af3773347" returned: 0 in 0.819s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56b1e766-86c0-4f0a-8492-d22b3bf95759 tempest-VolumesExtendTest-1993623185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857.afed0b02-2512-4f01-9b16-8d6af3773347 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:14 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857.afed0b02-2512-4f01-9b16-8d6af3773347 Sep 10 16:50:14 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:15 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56b1e766-86c0-4f0a-8492-d22b3bf95759 tempest-VolumesExtendTest-1993623185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857.afed0b02-2512-4f01-9b16-8d6af3773347" returned: 0 in 0.377s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:15 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-56b1e766-86c0-4f0a-8492-d22b3bf95759 tempest-VolumesExtendTest-1993623185 None] Lock "cinder-quobyte-afed0b02-2512-4f01-9b16-8d6af3773347" released by "_delete_snapshot" :: held 2.832s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:50:15 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-56b1e766-86c0-4f0a-8492-d22b3bf95759 tempest-VolumesExtendTest-1993623185 None] Lock "cinder-quobyte-5b0ebbec-7d64-4670-b4a1-6f91a5978857" released by "delete_snapshot" :: held 2.860s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:50:15 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-56b1e766-86c0-4f0a-8492-d22b3bf95759 tempest-VolumesExtendTest-1993623185 None] Created reservations ['88b32a59-e86a-47da-8dad-4fbbe9b56d7c', '8886a266-b976-4f43-9f3a-1c195f7cd26d', '57232e21-3c6e-4372-bc46-4f405b6379b0', 'd9c8847c-dfe8-4f0c-bde1-9ce0890c2210'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:50:15 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-56b1e766-86c0-4f0a-8492-d22b3bf95759 tempest-VolumesExtendTest-1993623185 None] Delete snapshot completed successfully. Sep 10 16:50:15 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-56b1e766-86c0-4f0a-8492-d22b3bf95759 tempest-VolumesExtendTest-1993623185 None] Lock "cinder-afed0b02-2512-4f01-9b16-8d6af3773347-delete_snapshot" released by "delete_snapshot" :: held 3.111s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:50:15 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-782aee33-6bbc-46e0-963d-7fb77b9e4496 tempest-VolumesExtendTest-1993623185 None] Acquiring lock "cinder-5b0ebbec-7d64-4670-b4a1-6f91a5978857-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:50:15 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-782aee33-6bbc-46e0-963d-7fb77b9e4496 tempest-VolumesExtendTest-1993623185 None] Lock "cinder-5b0ebbec-7d64-4670-b4a1-6f91a5978857-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:50:15 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-782aee33-6bbc-46e0-963d-7fb77b9e4496 tempest-VolumesExtendTest-1993623185 None] Acquiring lock "cinder-quobyte-5b0ebbec-7d64-4670-b4a1-6f91a5978857" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:50:15 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-782aee33-6bbc-46e0-963d-7fb77b9e4496 tempest-VolumesExtendTest-1993623185 None] Lock "cinder-quobyte-5b0ebbec-7d64-4670-b4a1-6f91a5978857" acquired by "delete_volume" :: waited 0.024s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:50:15 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b925058-04b5-4b01-8b8b-c0d5fddbcb87]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:50:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-782aee33-6bbc-46e0-963d-7fb77b9e4496 tempest-VolumesExtendTest-1993623185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-34076a99-a5d2-4ff3-a271-f4be6968e9ca tempest-TestInstancesWithCinderVolumes-1558773528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:50:16 devstack sudo[101791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857 Sep 10 16:50:16 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-34076a99-a5d2-4ff3-a271-f4be6968e9ca tempest-TestInstancesWithCinderVolumes-1558773528 None] Flow 'volume_create_manager' (588f0347-4be9-4810-9360-5dbac6d30e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-34076a99-a5d2-4ff3-a271-f4be6968e9ca tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f4054b-ec1f-4197-a559-c43e3a51bdf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-34076a99-a5d2-4ff3-a271-f4be6968e9ca tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f4054b-ec1f-4197-a559-c43e3a51bdf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-139565558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9ab3a2c-aa19-4cff-88fc-c8b2df27b269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a6b222794a14ef4ad99524cd551d1b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:50:16Z,use_quota=True,user_id='16592154e4874b4dbd44c73cb7a71dfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0046995b-210e-4f02-a2c9-4f8c4e180ebc),volume_type_id=0046995b-210e-4f02-a2c9-4f8c4e180ebc)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-34076a99-a5d2-4ff3-a271-f4be6968e9ca tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67493aa0-3cbf-414b-93fc-f27103c9529f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-34076a99-a5d2-4ff3-a271-f4be6968e9ca tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67493aa0-3cbf-414b-93fc-f27103c9529f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-34076a99-a5d2-4ff3-a271-f4be6968e9ca tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fde741c9-17ad-4705-b89a-4e85a6e92118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-34076a99-a5d2-4ff3-a271-f4be6968e9ca tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fde741c9-17ad-4705-b89a-4e85a6e92118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9ab3a2c-aa19-4cff-88fc-c8b2df27b269', 'volume_name': 'volume-c9ab3a2c-aa19-4cff-88fc-c8b2df27b269', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-34076a99-a5d2-4ff3-a271-f4be6968e9ca tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c468bb2-fb2a-44fb-8491-c18825f99981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-34076a99-a5d2-4ff3-a271-f4be6968e9ca tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c468bb2-fb2a-44fb-8491-c18825f99981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-34076a99-a5d2-4ff3-a271-f4be6968e9ca tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a56cd8eb-8c73-4485-bf17-db40b426132e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:16 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-34076a99-a5d2-4ff3-a271-f4be6968e9ca tempest-TestInstancesWithCinderVolumes-1558773528 None] Volume c9ab3a2c-aa19-4cff-88fc-c8b2df27b269: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9ab3a2c-aa19-4cff-88fc-c8b2df27b269', 'volume_size': 1} Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-34076a99-a5d2-4ff3-a271-f4be6968e9ca tempest-TestInstancesWithCinderVolumes-1558773528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-34076a99-a5d2-4ff3-a271-f4be6968e9ca tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-34076a99-a5d2-4ff3-a271-f4be6968e9ca tempest-TestInstancesWithCinderVolumes-1558773528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-139565558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9ab3a2c-aa19-4cff-88fc-c8b2df27b269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a6b222794a14ef4ad99524cd551d1b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:50:16Z,use_quota=True,user_id='16592154e4874b4dbd44c73cb7a71dfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0046995b-210e-4f02-a2c9-4f8c4e180ebc),volume_type_id=0046995b-210e-4f02-a2c9-4f8c4e180ebc)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-34076a99-a5d2-4ff3-a271-f4be6968e9ca tempest-TestInstancesWithCinderVolumes-1558773528 None] Creating volume c9ab3a2c-aa19-4cff-88fc-c8b2df27b269 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-34076a99-a5d2-4ff3-a271-f4be6968e9ca tempest-TestInstancesWithCinderVolumes-1558773528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-34076a99-a5d2-4ff3-a271-f4be6968e9ca tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-34076a99-a5d2-4ff3-a271-f4be6968e9ca tempest-TestInstancesWithCinderVolumes-1558773528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-34076a99-a5d2-4ff3-a271-f4be6968e9ca tempest-TestInstancesWithCinderVolumes-1558773528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-34076a99-a5d2-4ff3-a271-f4be6968e9ca tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-34076a99-a5d2-4ff3-a271-f4be6968e9ca tempest-TestInstancesWithCinderVolumes-1558773528 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:50:16 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-34076a99-a5d2-4ff3-a271-f4be6968e9ca tempest-TestInstancesWithCinderVolumes-1558773528 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-34076a99-a5d2-4ff3-a271-f4be6968e9ca tempest-TestInstancesWithCinderVolumes-1558773528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c9ab3a2c-aa19-4cff-88fc-c8b2df27b269 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:16 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c9ab3a2c-aa19-4cff-88fc-c8b2df27b269 1073741824 Sep 10 16:50:16 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:16 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-782aee33-6bbc-46e0-963d-7fb77b9e4496 tempest-VolumesExtendTest-1993623185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857" returned: 0 in 0.597s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-782aee33-6bbc-46e0-963d-7fb77b9e4496 tempest-VolumesExtendTest-1993623185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:16 devstack sudo[101800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857 Sep 10 16:50:16 devstack sudo[101800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-68abe2cc-eda6-4562-9091-a75d6efcca89 tempest-TestInstancesWithCinderVolumes-1558773528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-68abe2cc-eda6-4562-9091-a75d6efcca89 tempest-TestInstancesWithCinderVolumes-1558773528 None] Flow 'volume_create_manager' (454d6f01-01f9-4a92-a5f8-00eb5ad195e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-68abe2cc-eda6-4562-9091-a75d6efcca89 tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed9defd3-e8b8-4e33-9851-aaad40356b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-68abe2cc-eda6-4562-9091-a75d6efcca89 tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed9defd3-e8b8-4e33-9851-aaad40356b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1487236519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e73164a2-edae-47f1-b131-5a70597bd790,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a6b222794a14ef4ad99524cd551d1b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:50:17Z,use_quota=True,user_id='16592154e4874b4dbd44c73cb7a71dfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96fa4015-9e5c-484d-802e-2c4e103a525e),volume_type_id=96fa4015-9e5c-484d-802e-2c4e103a525e)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-68abe2cc-eda6-4562-9091-a75d6efcca89 tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a26fc99c-40a8-42d1-ab59-5a85bbdb559a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-68abe2cc-eda6-4562-9091-a75d6efcca89 tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a26fc99c-40a8-42d1-ab59-5a85bbdb559a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-68abe2cc-eda6-4562-9091-a75d6efcca89 tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5a24272-9906-4fa1-ac51-68b1e9e59d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-68abe2cc-eda6-4562-9091-a75d6efcca89 tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5a24272-9906-4fa1-ac51-68b1e9e59d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e73164a2-edae-47f1-b131-5a70597bd790', 'volume_name': 'volume-e73164a2-edae-47f1-b131-5a70597bd790', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-68abe2cc-eda6-4562-9091-a75d6efcca89 tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bf5d72e-6968-4d49-a9ef-b20428f9cfc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-68abe2cc-eda6-4562-9091-a75d6efcca89 tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bf5d72e-6968-4d49-a9ef-b20428f9cfc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-68abe2cc-eda6-4562-9091-a75d6efcca89 tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7297f33-bc62-4ffb-8db0-268d63f50eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:16 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-68abe2cc-eda6-4562-9091-a75d6efcca89 tempest-TestInstancesWithCinderVolumes-1558773528 None] Volume e73164a2-edae-47f1-b131-5a70597bd790: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e73164a2-edae-47f1-b131-5a70597bd790', 'volume_size': 1} Sep 10 16:50:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-68abe2cc-eda6-4562-9091-a75d6efcca89 tempest-TestInstancesWithCinderVolumes-1558773528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:50:17 devstack sudo[101800]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:17 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-782aee33-6bbc-46e0-963d-7fb77b9e4496 tempest-VolumesExtendTest-1993623185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b0ebbec-7d64-4670-b4a1-6f91a5978857" returned: 0 in 0.473s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-34076a99-a5d2-4ff3-a271-f4be6968e9ca tempest-TestInstancesWithCinderVolumes-1558773528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c9ab3a2c-aa19-4cff-88fc-c8b2df27b269 1073741824" returned: 0 in 0.755s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-782aee33-6bbc-46e0-963d-7fb77b9e4496 tempest-VolumesExtendTest-1993623185 None] Lock "cinder-quobyte-5b0ebbec-7d64-4670-b4a1-6f91a5978857" released by "delete_volume" :: held 1.254s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-34076a99-a5d2-4ff3-a271-f4be6968e9ca tempest-TestInstancesWithCinderVolumes-1558773528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c9ab3a2c-aa19-4cff-88fc-c8b2df27b269 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:17 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c9ab3a2c-aa19-4cff-88fc-c8b2df27b269 Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-782aee33-6bbc-46e0-963d-7fb77b9e4496 tempest-VolumesExtendTest-1993623185 None] Created reservations ['9102b474-fe0a-4b35-9290-7958e3651fbb', '268f352f-5a45-4341-95a1-6ece62e3d73c', 'e3ce8715-9468-4e98-859f-62e1b50bc13d', 'e4baf72a-d45d-4d57-be99-e5c0e988d31f'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:50:17 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-782aee33-6bbc-46e0-963d-7fb77b9e4496 tempest-VolumesExtendTest-1993623185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-782aee33-6bbc-46e0-963d-7fb77b9e4496 tempest-VolumesExtendTest-1993623185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-782aee33-6bbc-46e0-963d-7fb77b9e4496 tempest-VolumesExtendTest-1993623185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-782aee33-6bbc-46e0-963d-7fb77b9e4496 tempest-VolumesExtendTest-1993623185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-782aee33-6bbc-46e0-963d-7fb77b9e4496 tempest-VolumesExtendTest-1993623185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-782aee33-6bbc-46e0-963d-7fb77b9e4496 tempest-VolumesExtendTest-1993623185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:17 devstack sudo[101809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:50:17 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:17 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-34076a99-a5d2-4ff3-a271-f4be6968e9ca tempest-TestInstancesWithCinderVolumes-1558773528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c9ab3a2c-aa19-4cff-88fc-c8b2df27b269" returned: 0 in 0.388s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-34076a99-a5d2-4ff3-a271-f4be6968e9ca tempest-TestInstancesWithCinderVolumes-1558773528 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-34076a99-a5d2-4ff3-a271-f4be6968e9ca tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-68abe2cc-eda6-4562-9091-a75d6efcca89 tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.824s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-68abe2cc-eda6-4562-9091-a75d6efcca89 tempest-TestInstancesWithCinderVolumes-1558773528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1487236519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e73164a2-edae-47f1-b131-5a70597bd790,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a6b222794a14ef4ad99524cd551d1b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:50:17Z,use_quota=True,user_id='16592154e4874b4dbd44c73cb7a71dfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96fa4015-9e5c-484d-802e-2c4e103a525e),volume_type_id=96fa4015-9e5c-484d-802e-2c4e103a525e)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-68abe2cc-eda6-4562-9091-a75d6efcca89 tempest-TestInstancesWithCinderVolumes-1558773528 None] Creating volume e73164a2-edae-47f1-b131-5a70597bd790 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-68abe2cc-eda6-4562-9091-a75d6efcca89 tempest-TestInstancesWithCinderVolumes-1558773528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-68abe2cc-eda6-4562-9091-a75d6efcca89 tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-68abe2cc-eda6-4562-9091-a75d6efcca89 tempest-TestInstancesWithCinderVolumes-1558773528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-68abe2cc-eda6-4562-9091-a75d6efcca89 tempest-TestInstancesWithCinderVolumes-1558773528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-68abe2cc-eda6-4562-9091-a75d6efcca89 tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-68abe2cc-eda6-4562-9091-a75d6efcca89 tempest-TestInstancesWithCinderVolumes-1558773528 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:50:17 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-68abe2cc-eda6-4562-9091-a75d6efcca89 tempest-TestInstancesWithCinderVolumes-1558773528 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-68abe2cc-eda6-4562-9091-a75d6efcca89 tempest-TestInstancesWithCinderVolumes-1558773528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e73164a2-edae-47f1-b131-5a70597bd790 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-34076a99-a5d2-4ff3-a271-f4be6968e9ca tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a56cd8eb-8c73-4485-bf17-db40b426132e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9ab3a2c-aa19-4cff-88fc-c8b2df27b269', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:17 devstack sudo[101812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e73164a2-edae-47f1-b131-5a70597bd790 1073741824 Sep 10 16:50:17 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-34076a99-a5d2-4ff3-a271-f4be6968e9ca tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (268fdc2c-815b-4845-85b7-a1c61b959884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:17 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-34076a99-a5d2-4ff3-a271-f4be6968e9ca tempest-TestInstancesWithCinderVolumes-1558773528 None] Volume volume-c9ab3a2c-aa19-4cff-88fc-c8b2df27b269 (c9ab3a2c-aa19-4cff-88fc-c8b2df27b269): created successfully Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-34076a99-a5d2-4ff3-a271-f4be6968e9ca tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (268fdc2c-815b-4845-85b7-a1c61b959884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-34076a99-a5d2-4ff3-a271-f4be6968e9ca tempest-TestInstancesWithCinderVolumes-1558773528 None] Flow 'volume_create_manager' (588f0347-4be9-4810-9360-5dbac6d30e8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:50:17 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-34076a99-a5d2-4ff3-a271-f4be6968e9ca tempest-TestInstancesWithCinderVolumes-1558773528 None] Created volume successfully. Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:50:17 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Flow 'volume_create_manager' (a16b8f9d-b295-474e-ab3d-7b0ae5d0bfbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63fe7d30-b59f-4232-b1d4-fca5c9ee0ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-782aee33-6bbc-46e0-963d-7fb77b9e4496 tempest-VolumesExtendTest-1993623185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.414s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-782aee33-6bbc-46e0-963d-7fb77b9e4496 tempest-VolumesExtendTest-1993623185 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:50:17 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-782aee33-6bbc-46e0-963d-7fb77b9e4496 tempest-VolumesExtendTest-1993623185 None] Deleted volume successfully. Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63fe7d30-b59f-4232-b1d4-fca5c9ee0ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-285753188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e2be01b-2320-4f68-a1f2-6e59b735d10c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a6b222794a14ef4ad99524cd551d1b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:50:18Z,use_quota=True,user_id='16592154e4874b4dbd44c73cb7a71dfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75ed2ae9-1f03-49a3-b589-2746f3d96a92),volume_type_id=75ed2ae9-1f03-49a3-b589-2746f3d96a92)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ff5273-1338-4855-9c17-5c3c652ed34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ff5273-1338-4855-9c17-5c3c652ed34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7aea7fd-f9e2-4844-8196-29e001e04916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG cinder.image.glance [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Creating Keystone auth plugin from conf {{(pid=88189) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 16:50:17 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-782aee33-6bbc-46e0-963d-7fb77b9e4496 tempest-VolumesExtendTest-1993623185 None] Lock "cinder-5b0ebbec-7d64-4670-b4a1-6f91a5978857-delete_volume" released by "delete_volume" :: held 2.105s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:50:18 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:UPDATE=187,cinder:SELECT=190,cinder:INSERT=56,cinder:DELETE=12 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:50:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-b713f698-5067-4af8-ad5d-2e68228b8ac5 req-335305f1-0f83-4dd7-97aa-ba9c9bbd8d27 tempest-TestShelveInstance-182807223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:50:18 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-68abe2cc-eda6-4562-9091-a75d6efcca89 tempest-TestInstancesWithCinderVolumes-1558773528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e73164a2-edae-47f1-b131-5a70597bd790 1073741824" returned: 0 in 0.651s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-68abe2cc-eda6-4562-9091-a75d6efcca89 tempest-TestInstancesWithCinderVolumes-1558773528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e73164a2-edae-47f1-b131-5a70597bd790 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:18 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e73164a2-edae-47f1-b131-5a70597bd790 Sep 10 16:50:18 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7aea7fd-f9e2-4844-8196-29e001e04916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1e2be01b-2320-4f68-a1f2-6e59b735d10c', 'volume_name': 'volume-1e2be01b-2320-4f68-a1f2-6e59b735d10c', 'volume_size': 1, 'image_id': '14c6793b-f2f3-4552-837a-fadf689f712b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14c6793b-f2f3-4552-837a-fadf689f712b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1334445681', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6a6b222794a14ef4ad99524cd551d1b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '14c6793b-f2f3-4552-837a-fadf689f712b', 'created_at': datetime.datetime(2026, 9, 10, 14, 50, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 14, 50, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14c6793b-f2f3-4552-837a-fadf689f712b/file', 'properties': {}}, 'image_service': }' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33eb3403-0534-435e-9660-f3849522824b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33eb3403-0534-435e-9660-f3849522824b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067222a8-5bc8-4e4c-9ce1-5a12bb138da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:18 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Volume 1e2be01b-2320-4f68-a1f2-6e59b735d10c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1e2be01b-2320-4f68-a1f2-6e59b735d10c', 'volume_size': 1, 'image_id': '14c6793b-f2f3-4552-837a-fadf689f712b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14c6793b-f2f3-4552-837a-fadf689f712b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1334445681', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6a6b222794a14ef4ad99524cd551d1b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '14c6793b-f2f3-4552-837a-fadf689f712b', 'created_at': datetime.datetime(2026, 9, 10, 14, 50, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 14, 50, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14c6793b-f2f3-4552-837a-fadf689f712b/file', 'properties': {}}, 'image_service': } Sep 10 16:50:18 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Trying to clone 1e2be01b-2320-4f68-a1f2-6e59b735d10c from image 14c6793b-f2f3-4552-837a-fadf689f712b at location (None, [{'url': 'file:///opt/stack/data/glance/images/14c6793b-f2f3-4552-837a-fadf689f712b', 'metadata': {}}]). {{(pid=88189) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 16:50:18 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-68abe2cc-eda6-4562-9091-a75d6efcca89 tempest-TestInstancesWithCinderVolumes-1558773528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e73164a2-edae-47f1-b131-5a70597bd790" returned: 0 in 0.358s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:18 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-68abe2cc-eda6-4562-9091-a75d6efcca89 tempest-TestInstancesWithCinderVolumes-1558773528 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:50:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-68abe2cc-eda6-4562-9091-a75d6efcca89 tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:50:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-b713f698-5067-4af8-ad5d-2e68228b8ac5 req-335305f1-0f83-4dd7-97aa-ba9c9bbd8d27 tempest-TestShelveInstance-182807223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.507s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:50:18 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=168,cinder:UPDATE=185,cinder:INSERT=55,cinder:DELETE=6 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:50:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-68abe2cc-eda6-4562-9091-a75d6efcca89 tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7297f33-bc62-4ffb-8db0-268d63f50eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e73164a2-edae-47f1-b131-5a70597bd790', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-68abe2cc-eda6-4562-9091-a75d6efcca89 tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c46d4e7-6600-4eeb-a4c7-f83dd46ade22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-b713f698-5067-4af8-ad5d-2e68228b8ac5 req-335305f1-0f83-4dd7-97aa-ba9c9bbd8d27 tempest-TestShelveInstance-182807223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.070s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:50:18 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-68abe2cc-eda6-4562-9091-a75d6efcca89 tempest-TestInstancesWithCinderVolumes-1558773528 None] Volume volume-e73164a2-edae-47f1-b131-5a70597bd790 (e73164a2-edae-47f1-b131-5a70597bd790): created successfully Sep 10 16:50:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-68abe2cc-eda6-4562-9091-a75d6efcca89 tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c46d4e7-6600-4eeb-a4c7-f83dd46ade22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-68abe2cc-eda6-4562-9091-a75d6efcca89 tempest-TestInstancesWithCinderVolumes-1558773528 None] Flow 'volume_create_manager' (454d6f01-01f9-4a92-a5f8-00eb5ad195e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:50:18 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-68abe2cc-eda6-4562-9091-a75d6efcca89 tempest-TestInstancesWithCinderVolumes-1558773528 None] Created volume successfully. Sep 10 16:50:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-b713f698-5067-4af8-ad5d-2e68228b8ac5 req-335305f1-0f83-4dd7-97aa-ba9c9bbd8d27 tempest-TestShelveInstance-182807223 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8', 'name': 'volume-98fadc22-cde4-49bd-9fc0-28a2bf681692', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f624649-6ee2-4908-bcfa-a8187da88c8e', 'enforce_multipath': True} {{(pid=88189) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 16:50:18 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-b713f698-5067-4af8-ad5d-2e68228b8ac5 req-335305f1-0f83-4dd7-97aa-ba9c9bbd8d27 tempest-TestShelveInstance-182807223 None] attachment_update completed successfully. Sep 10 16:50:24 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_14c6793b-f2f3-4552-837a-fadf689f712b_ezvgw3rbdevstack@QuobyteHD, size 20.69 MB, duration 6.16 sec {{(pid=88189) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 16:50:24 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Image download 20.69 MB at 3.36 MB/s Sep 10 16:50:24 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da00375-7845-4c6f-a14e-1e99f6837b77]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:50:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14c6793b-f2f3-4552-837a-fadf689f712b_ezvgw3rbdevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:24 devstack sudo[102284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14c6793b-f2f3-4552-837a-fadf689f712b_ezvgw3rbdevstack@QuobyteHD Sep 10 16:50:24 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:25 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14c6793b-f2f3-4552-837a-fadf689f712b_ezvgw3rbdevstack@QuobyteHD" returned: 0 in 0.574s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:25 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Temporary image 14c6793b-f2f3-4552-837a-fadf689f712b is fetched for user 16592154e4874b4dbd44c73cb7a71dfa. {{(pid=88189) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 16:50:25 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7b3183-e18c-416e-86fd-4b10ee773b5c]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:50:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14c6793b-f2f3-4552-837a-fadf689f712b_ezvgw3rbdevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:25 devstack sudo[102293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14c6793b-f2f3-4552-837a-fadf689f712b_ezvgw3rbdevstack@QuobyteHD Sep 10 16:50:25 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:25 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14c6793b-f2f3-4552-837a-fadf689f712b_ezvgw3rbdevstack@QuobyteHD" returned: 0 in 0.526s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:50:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:50:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-285753188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e2be01b-2320-4f68-a1f2-6e59b735d10c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a6b222794a14ef4ad99524cd551d1b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:50:18Z,use_quota=True,user_id='16592154e4874b4dbd44c73cb7a71dfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75ed2ae9-1f03-49a3-b589-2746f3d96a92),volume_type_id=75ed2ae9-1f03-49a3-b589-2746f3d96a92)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:50:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Creating volume 1e2be01b-2320-4f68-a1f2-6e59b735d10c {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:50:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:50:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:50:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:50:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:50:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:50:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:50:25 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:50:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1e2be01b-2320-4f68-a1f2-6e59b735d10c 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:26 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1e2be01b-2320-4f68-a1f2-6e59b735d10c 1073741824 Sep 10 16:50:26 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:26 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1e2be01b-2320-4f68-a1f2-6e59b735d10c 1073741824" returned: 0 in 0.835s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1e2be01b-2320-4f68-a1f2-6e59b735d10c {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:26 devstack sudo[102304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1e2be01b-2320-4f68-a1f2-6e59b735d10c Sep 10 16:50:26 devstack sudo[102304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:27 devstack sudo[102304]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1e2be01b-2320-4f68-a1f2-6e59b735d10c" returned: 0 in 0.440s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:50:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:50:27 devstack cinder-volume[88189]: DEBUG cinder.volume.volume_utils [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Attempting download of 14c6793b-f2f3-4552-837a-fadf689f712b ((None, [{'url': 'file:///opt/stack/data/glance/images/14c6793b-f2f3-4552-837a-fadf689f712b', 'metadata': {}}])) to volume 1e2be01b-2320-4f68-a1f2-6e59b735d10c. {{(pid=88189) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 16:50:27 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bbed99-2dc9-4465-aa9b-64349f3b6bfa]: (4, 'raw') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:50:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14c6793b-f2f3-4552-837a-fadf689f712b_l5bj4rik {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:27 devstack sudo[102307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14c6793b-f2f3-4552-837a-fadf689f712b_l5bj4rik Sep 10 16:50:27 devstack sudo[102307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:28 devstack sudo[102307]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14c6793b-f2f3-4552-837a-fadf689f712b_l5bj4rik" returned: 0 in 0.587s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14c6793b-f2f3-4552-837a-fadf689f712b_l5bj4rik {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:28 devstack sudo[102311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14c6793b-f2f3-4552-837a-fadf689f712b_l5bj4rik Sep 10 16:50:28 devstack sudo[102311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:28 devstack sudo[102311]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14c6793b-f2f3-4552-837a-fadf689f712b_l5bj4rik" returned: 1 in 0.476s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14c6793b-f2f3-4552-837a-fadf689f712b_l5bj4rik' failed. Not Retrying. {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 16:50:28 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0aa01fa-7a34-4065-83df-d7d08238ff95]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:50:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14c6793b-f2f3-4552-837a-fadf689f712b_ezvgw3rbdevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:28 devstack sudo[102315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14c6793b-f2f3-4552-837a-fadf689f712b_ezvgw3rbdevstack@QuobyteHD Sep 10 16:50:28 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:28 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14c6793b-f2f3-4552-837a-fadf689f712b_ezvgw3rbdevstack@QuobyteHD" returned: 0 in 0.436s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:28 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] 14c6793b-f2f3-4552-837a-fadf689f712b was qcow2, converting to qcow2 {{(pid=88189) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 16:50:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_14c6793b-f2f3-4552-837a-fadf689f712b_ezvgw3rbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1e2be01b-2320-4f68-a1f2-6e59b735d10c {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:28 devstack sudo[102321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_14c6793b-f2f3-4552-837a-fadf689f712b_ezvgw3rbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1e2be01b-2320-4f68-a1f2-6e59b735d10c Sep 10 16:50:29 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:29 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-cb77244f-850c-426d-b722-d05f4868e0bf tempest-GroupsV320Test-737664169 None] Group tempest-GroupsV320Test-Group-319868052: creating Sep 10 16:50:29 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-cb77244f-850c-426d-b722-d05f4868e0bf tempest-GroupsV320Test-737664169 None] Group tempest-GroupsV320Test-Group-319868052: created successfully Sep 10 16:50:29 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-cb77244f-850c-426d-b722-d05f4868e0bf tempest-GroupsV320Test-737664169 None] Create group completed successfully. Sep 10 16:50:31 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_14c6793b-f2f3-4552-837a-fadf689f712b_ezvgw3rbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1e2be01b-2320-4f68-a1f2-6e59b735d10c" returned: 0 in 2.764s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:31 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_14c6793b-f2f3-4552-837a-fadf689f712b_ezvgw3rbdevstack@QuobyteHD, size 112.00 MB, duration 2.76 sec, destination /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1e2be01b-2320-4f68-a1f2-6e59b735d10c {{(pid=88189) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 16:50:31 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Converted 112.00 MB image at 40.51 MB/s Sep 10 16:50:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1e2be01b-2320-4f68-a1f2-6e59b735d10c 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:31 devstack sudo[102330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1e2be01b-2320-4f68-a1f2-6e59b735d10c 1G Sep 10 16:50:31 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:31 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-f0b97c57-4660-4e24-96c5-73903121df2a tempest-GroupsV320Test-737664169 None] Created reservations ['abffb6ef-dfcf-42b6-a957-9101ee8c19ca'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:50:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f0b97c57-4660-4e24-96c5-73903121df2a tempest-GroupsV320Test-737664169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:50:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f0b97c57-4660-4e24-96c5-73903121df2a tempest-GroupsV320Test-737664169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:50:31 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f0b97c57-4660-4e24-96c5-73903121df2a tempest-GroupsV320Test-737664169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:50:31 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f0b97c57-4660-4e24-96c5-73903121df2a tempest-GroupsV320Test-737664169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:50:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f0b97c57-4660-4e24-96c5-73903121df2a tempest-GroupsV320Test-737664169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:50:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f0b97c57-4660-4e24-96c5-73903121df2a tempest-GroupsV320Test-737664169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:31 devstack sudo[102332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:50:31 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:32 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f0b97c57-4660-4e24-96c5-73903121df2a tempest-GroupsV320Test-737664169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.380s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:32 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-f0b97c57-4660-4e24-96c5-73903121df2a tempest-GroupsV320Test-737664169 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:50:32 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-f0b97c57-4660-4e24-96c5-73903121df2a tempest-GroupsV320Test-737664169 None] Delete group completed successfully. Sep 10 16:50:32 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1e2be01b-2320-4f68-a1f2-6e59b735d10c 1G" returned: 0 in 0.677s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:32 devstack cinder-volume[88189]: DEBUG cinder.volume.volume_utils [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Downloaded image 14c6793b-f2f3-4552-837a-fadf689f712b ((None, [{'url': 'file:///opt/stack/data/glance/images/14c6793b-f2f3-4552-837a-fadf689f712b', 'metadata': {}}])) to volume 1e2be01b-2320-4f68-a1f2-6e59b735d10c successfully. {{(pid=88189) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 16:50:32 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Temporary image 14c6793b-f2f3-4552-837a-fadf689f712b for user 16592154e4874b4dbd44c73cb7a71dfa is deleted. {{(pid=88189) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 16:50:32 devstack cinder-volume[88189]: DEBUG cinder.volume.volume_utils [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Marking volume 1e2be01b-2320-4f68-a1f2-6e59b735d10c as bootable. {{(pid=88189) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 16:50:32 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Copying metadata from image 14c6793b-f2f3-4552-837a-fadf689f712b to 1e2be01b-2320-4f68-a1f2-6e59b735d10c. {{(pid=88189) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 16:50:32 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Creating volume glance metadata for volume 1e2be01b-2320-4f68-a1f2-6e59b735d10c backed by image 14c6793b-f2f3-4552-837a-fadf689f712b with: {'image_id': '14c6793b-f2f3-4552-837a-fadf689f712b', 'image_name': 'tempest-scenario-img--1334445681', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88189) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 16:50:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067222a8-5bc8-4e4c-9ce1-5a12bb138da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e2be01b-2320-4f68-a1f2-6e59b735d10c', 'volume_size': 1, 'image_id': '14c6793b-f2f3-4552-837a-fadf689f712b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14c6793b-f2f3-4552-837a-fadf689f712b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1334445681', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6a6b222794a14ef4ad99524cd551d1b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '14c6793b-f2f3-4552-837a-fadf689f712b', 'created_at': datetime.datetime(2026, 9, 10, 14, 50, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 14, 50, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14c6793b-f2f3-4552-837a-fadf689f712b/file', 'properties': {}}, 'image_service': }' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7619abb2-0d5d-4637-887d-fcf918429b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:32 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Volume volume-1e2be01b-2320-4f68-a1f2-6e59b735d10c (1e2be01b-2320-4f68-a1f2-6e59b735d10c): created successfully Sep 10 16:50:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7619abb2-0d5d-4637-887d-fcf918429b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Flow 'volume_create_manager' (a16b8f9d-b295-474e-ab3d-7b0ae5d0bfbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:50:32 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-191d542d-15ad-4971-a1e1-8c575e483861 tempest-TestInstancesWithCinderVolumes-1558773528 None] Created volume successfully. Sep 10 16:50:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-c599c584-49da-484e-b20f-0e0b53e6fac1 req-828a80f1-cdf2-4f22-bb6f-9e3f46dbed06 tempest-TestInstancesWithCinderVolumes-1558773528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:50:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-c599c584-49da-484e-b20f-0e0b53e6fac1 req-828a80f1-cdf2-4f22-bb6f-9e3f46dbed06 tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:50:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-c599c584-49da-484e-b20f-0e0b53e6fac1 req-828a80f1-cdf2-4f22-bb6f-9e3f46dbed06 tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.057s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:50:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-c599c584-49da-484e-b20f-0e0b53e6fac1 req-828a80f1-cdf2-4f22-bb6f-9e3f46dbed06 tempest-TestInstancesWithCinderVolumes-1558773528 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8', 'name': 'volume-1e2be01b-2320-4f68-a1f2-6e59b735d10c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '34377c43-93ea-41ab-bbee-914143f3bec7', 'enforce_multipath': True} {{(pid=88189) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 16:50:40 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-c599c584-49da-484e-b20f-0e0b53e6fac1 req-828a80f1-cdf2-4f22-bb6f-9e3f46dbed06 tempest-TestInstancesWithCinderVolumes-1558773528 None] attachment_update completed successfully. Sep 10 16:50:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:50:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:50:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:50:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:50:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:50:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:50:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:49 devstack sudo[102455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:50:49 devstack sudo[102455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:49 devstack sudo[102455]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.396s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:49 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:50:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager._thread_info {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:50:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread count: 28 {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 16:50:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread info: [<_MainThread(MainThread, started 125792070905984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 16:50:50 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=27,cinder:UPDATE=9,cinder:INSERT=7 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:50:50 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=24,cinder:INSERT=5,cinder:UPDATE=15,cinder:DELETE=2 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:50:56 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-8becac52-63cd-46f0-91a7-c43f0eef7afb tempest-TestServerVolumeAttachmentScenario-984045012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:50:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8becac52-63cd-46f0-91a7-c43f0eef7afb tempest-TestServerVolumeAttachmentScenario-984045012 None] Flow 'volume_create_manager' (23cf4c13-0ed3-4889-a213-ae03f8c2dc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:50:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8becac52-63cd-46f0-91a7-c43f0eef7afb tempest-TestServerVolumeAttachmentScenario-984045012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42a2ed3-33db-4e47-9329-d2375bbe6025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8becac52-63cd-46f0-91a7-c43f0eef7afb tempest-TestServerVolumeAttachmentScenario-984045012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42a2ed3-33db-4e47-9329-d2375bbe6025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2122075680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2bed22-8cc6-449e-8238-76f07499ecc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a175c0940b14b349abd7c0247be7d38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:50:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:50:56Z,use_quota=True,user_id='8f19ba6d4fe74412bc28b99584f241e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8becac52-63cd-46f0-91a7-c43f0eef7afb tempest-TestServerVolumeAttachmentScenario-984045012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40187960-a74c-4c94-a5af-171e54c54003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8becac52-63cd-46f0-91a7-c43f0eef7afb tempest-TestServerVolumeAttachmentScenario-984045012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40187960-a74c-4c94-a5af-171e54c54003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8becac52-63cd-46f0-91a7-c43f0eef7afb tempest-TestServerVolumeAttachmentScenario-984045012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2362f4c1-4cfa-468b-b7ef-4f88d2d0f033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8becac52-63cd-46f0-91a7-c43f0eef7afb tempest-TestServerVolumeAttachmentScenario-984045012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2362f4c1-4cfa-468b-b7ef-4f88d2d0f033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d2bed22-8cc6-449e-8238-76f07499ecc9', 'volume_name': 'volume-9d2bed22-8cc6-449e-8238-76f07499ecc9', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8becac52-63cd-46f0-91a7-c43f0eef7afb tempest-TestServerVolumeAttachmentScenario-984045012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3856d0f6-1440-4487-8719-82bfd0da3e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8becac52-63cd-46f0-91a7-c43f0eef7afb tempest-TestServerVolumeAttachmentScenario-984045012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3856d0f6-1440-4487-8719-82bfd0da3e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8becac52-63cd-46f0-91a7-c43f0eef7afb tempest-TestServerVolumeAttachmentScenario-984045012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46cd1725-46c2-4a8d-b01b-72ec057f47a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:56 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-8becac52-63cd-46f0-91a7-c43f0eef7afb tempest-TestServerVolumeAttachmentScenario-984045012 None] Volume 9d2bed22-8cc6-449e-8238-76f07499ecc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d2bed22-8cc6-449e-8238-76f07499ecc9', 'volume_size': 1} Sep 10 16:50:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8becac52-63cd-46f0-91a7-c43f0eef7afb tempest-TestServerVolumeAttachmentScenario-984045012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:50:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8becac52-63cd-46f0-91a7-c43f0eef7afb tempest-TestServerVolumeAttachmentScenario-984045012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:50:56 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8becac52-63cd-46f0-91a7-c43f0eef7afb tempest-TestServerVolumeAttachmentScenario-984045012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2122075680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2bed22-8cc6-449e-8238-76f07499ecc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a175c0940b14b349abd7c0247be7d38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:50:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:50:56Z,use_quota=True,user_id='8f19ba6d4fe74412bc28b99584f241e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:50:56 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-8becac52-63cd-46f0-91a7-c43f0eef7afb tempest-TestServerVolumeAttachmentScenario-984045012 None] Creating volume 9d2bed22-8cc6-449e-8238-76f07499ecc9 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:50:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8becac52-63cd-46f0-91a7-c43f0eef7afb tempest-TestServerVolumeAttachmentScenario-984045012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:50:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8becac52-63cd-46f0-91a7-c43f0eef7afb tempest-TestServerVolumeAttachmentScenario-984045012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:50:56 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8becac52-63cd-46f0-91a7-c43f0eef7afb tempest-TestServerVolumeAttachmentScenario-984045012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:50:56 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8becac52-63cd-46f0-91a7-c43f0eef7afb tempest-TestServerVolumeAttachmentScenario-984045012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:50:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8becac52-63cd-46f0-91a7-c43f0eef7afb tempest-TestServerVolumeAttachmentScenario-984045012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:50:56 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8becac52-63cd-46f0-91a7-c43f0eef7afb tempest-TestServerVolumeAttachmentScenario-984045012 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:50:56 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-8becac52-63cd-46f0-91a7-c43f0eef7afb tempest-TestServerVolumeAttachmentScenario-984045012 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:50:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8becac52-63cd-46f0-91a7-c43f0eef7afb tempest-TestServerVolumeAttachmentScenario-984045012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9d2bed22-8cc6-449e-8238-76f07499ecc9 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:56 devstack sudo[102464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9d2bed22-8cc6-449e-8238-76f07499ecc9 1073741824 Sep 10 16:50:56 devstack sudo[102464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:57 devstack sudo[102464]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8becac52-63cd-46f0-91a7-c43f0eef7afb tempest-TestServerVolumeAttachmentScenario-984045012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9d2bed22-8cc6-449e-8238-76f07499ecc9 1073741824" returned: 0 in 0.820s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:57 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d4c364b-1a6d-4591-a178-eb4d3da3ceac tempest-TestServerVolumeAttachmentScenario-984045012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:50:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d4c364b-1a6d-4591-a178-eb4d3da3ceac tempest-TestServerVolumeAttachmentScenario-984045012 None] Flow 'volume_create_manager' (87b7482c-e4d0-4815-ac9a-be253bb1a9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:50:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d4c364b-1a6d-4591-a178-eb4d3da3ceac tempest-TestServerVolumeAttachmentScenario-984045012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41ff33d4-6804-41a4-aafd-ed83da8bf013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8becac52-63cd-46f0-91a7-c43f0eef7afb tempest-TestServerVolumeAttachmentScenario-984045012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9d2bed22-8cc6-449e-8238-76f07499ecc9 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d4c364b-1a6d-4591-a178-eb4d3da3ceac tempest-TestServerVolumeAttachmentScenario-984045012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41ff33d4-6804-41a4-aafd-ed83da8bf013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-749781444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1c2b441-fbd1-4be4-b682-a4a36debc3b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a175c0940b14b349abd7c0247be7d38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:50:57Z,use_quota=True,user_id='8f19ba6d4fe74412bc28b99584f241e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:57 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9d2bed22-8cc6-449e-8238-76f07499ecc9 Sep 10 16:50:57 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d4c364b-1a6d-4591-a178-eb4d3da3ceac tempest-TestServerVolumeAttachmentScenario-984045012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e4cdbc8-2c3f-4a8a-be67-046a898e5204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d4c364b-1a6d-4591-a178-eb4d3da3ceac tempest-TestServerVolumeAttachmentScenario-984045012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e4cdbc8-2c3f-4a8a-be67-046a898e5204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d4c364b-1a6d-4591-a178-eb4d3da3ceac tempest-TestServerVolumeAttachmentScenario-984045012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ab07b7b-8ece-4887-bee0-4480cb622003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d4c364b-1a6d-4591-a178-eb4d3da3ceac tempest-TestServerVolumeAttachmentScenario-984045012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ab07b7b-8ece-4887-bee0-4480cb622003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1c2b441-fbd1-4be4-b682-a4a36debc3b2', 'volume_name': 'volume-b1c2b441-fbd1-4be4-b682-a4a36debc3b2', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d4c364b-1a6d-4591-a178-eb4d3da3ceac tempest-TestServerVolumeAttachmentScenario-984045012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3efb4629-fc8c-4b1b-a330-2d9b9a21f500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d4c364b-1a6d-4591-a178-eb4d3da3ceac tempest-TestServerVolumeAttachmentScenario-984045012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3efb4629-fc8c-4b1b-a330-2d9b9a21f500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d4c364b-1a6d-4591-a178-eb4d3da3ceac tempest-TestServerVolumeAttachmentScenario-984045012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f743a75f-1108-4a6c-bd1a-a6097b0f7bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:57 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-6d4c364b-1a6d-4591-a178-eb4d3da3ceac tempest-TestServerVolumeAttachmentScenario-984045012 None] Volume b1c2b441-fbd1-4be4-b682-a4a36debc3b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1c2b441-fbd1-4be4-b682-a4a36debc3b2', 'volume_size': 1} Sep 10 16:50:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6d4c364b-1a6d-4591-a178-eb4d3da3ceac tempest-TestServerVolumeAttachmentScenario-984045012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:50:57 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8becac52-63cd-46f0-91a7-c43f0eef7afb tempest-TestServerVolumeAttachmentScenario-984045012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9d2bed22-8cc6-449e-8238-76f07499ecc9" returned: 0 in 0.391s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:57 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8becac52-63cd-46f0-91a7-c43f0eef7afb tempest-TestServerVolumeAttachmentScenario-984045012 None] <== create_volume: return (1414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:50:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8becac52-63cd-46f0-91a7-c43f0eef7afb tempest-TestServerVolumeAttachmentScenario-984045012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:50:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6d4c364b-1a6d-4591-a178-eb4d3da3ceac tempest-TestServerVolumeAttachmentScenario-984045012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.226s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:50:57 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6d4c364b-1a6d-4591-a178-eb4d3da3ceac tempest-TestServerVolumeAttachmentScenario-984045012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-749781444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1c2b441-fbd1-4be4-b682-a4a36debc3b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a175c0940b14b349abd7c0247be7d38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:50:57Z,use_quota=True,user_id='8f19ba6d4fe74412bc28b99584f241e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:50:57 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-6d4c364b-1a6d-4591-a178-eb4d3da3ceac tempest-TestServerVolumeAttachmentScenario-984045012 None] Creating volume b1c2b441-fbd1-4be4-b682-a4a36debc3b2 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:50:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6d4c364b-1a6d-4591-a178-eb4d3da3ceac tempest-TestServerVolumeAttachmentScenario-984045012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:50:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6d4c364b-1a6d-4591-a178-eb4d3da3ceac tempest-TestServerVolumeAttachmentScenario-984045012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:50:57 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6d4c364b-1a6d-4591-a178-eb4d3da3ceac tempest-TestServerVolumeAttachmentScenario-984045012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:50:57 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6d4c364b-1a6d-4591-a178-eb4d3da3ceac tempest-TestServerVolumeAttachmentScenario-984045012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:50:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6d4c364b-1a6d-4591-a178-eb4d3da3ceac tempest-TestServerVolumeAttachmentScenario-984045012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:50:57 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6d4c364b-1a6d-4591-a178-eb4d3da3ceac tempest-TestServerVolumeAttachmentScenario-984045012 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:50:57 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-6d4c364b-1a6d-4591-a178-eb4d3da3ceac tempest-TestServerVolumeAttachmentScenario-984045012 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:50:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6d4c364b-1a6d-4591-a178-eb4d3da3ceac tempest-TestServerVolumeAttachmentScenario-984045012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b1c2b441-fbd1-4be4-b682-a4a36debc3b2 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8becac52-63cd-46f0-91a7-c43f0eef7afb tempest-TestServerVolumeAttachmentScenario-984045012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46cd1725-46c2-4a8d-b01b-72ec057f47a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d2bed22-8cc6-449e-8238-76f07499ecc9', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:57 devstack sudo[102473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b1c2b441-fbd1-4be4-b682-a4a36debc3b2 1073741824 Sep 10 16:50:57 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8becac52-63cd-46f0-91a7-c43f0eef7afb tempest-TestServerVolumeAttachmentScenario-984045012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17abc67b-9dbd-4f61-93f1-b64b2c6dc70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:57 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-8becac52-63cd-46f0-91a7-c43f0eef7afb tempest-TestServerVolumeAttachmentScenario-984045012 None] Volume volume-9d2bed22-8cc6-449e-8238-76f07499ecc9 (9d2bed22-8cc6-449e-8238-76f07499ecc9): created successfully Sep 10 16:50:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8becac52-63cd-46f0-91a7-c43f0eef7afb tempest-TestServerVolumeAttachmentScenario-984045012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17abc67b-9dbd-4f61-93f1-b64b2c6dc70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8becac52-63cd-46f0-91a7-c43f0eef7afb tempest-TestServerVolumeAttachmentScenario-984045012 None] Flow 'volume_create_manager' (23cf4c13-0ed3-4889-a213-ae03f8c2dc22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:50:57 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-8becac52-63cd-46f0-91a7-c43f0eef7afb tempest-TestServerVolumeAttachmentScenario-984045012 None] Created volume successfully. Sep 10 16:50:58 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6d4c364b-1a6d-4591-a178-eb4d3da3ceac tempest-TestServerVolumeAttachmentScenario-984045012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b1c2b441-fbd1-4be4-b682-a4a36debc3b2 1073741824" returned: 0 in 0.720s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6d4c364b-1a6d-4591-a178-eb4d3da3ceac tempest-TestServerVolumeAttachmentScenario-984045012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b1c2b441-fbd1-4be4-b682-a4a36debc3b2 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:50:58 devstack sudo[102479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b1c2b441-fbd1-4be4-b682-a4a36debc3b2 Sep 10 16:50:58 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:50:59 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root Sep 10 16:50:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6d4c364b-1a6d-4591-a178-eb4d3da3ceac tempest-TestServerVolumeAttachmentScenario-984045012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b1c2b441-fbd1-4be4-b682-a4a36debc3b2" returned: 0 in 0.537s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:50:59 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6d4c364b-1a6d-4591-a178-eb4d3da3ceac tempest-TestServerVolumeAttachmentScenario-984045012 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:50:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6d4c364b-1a6d-4591-a178-eb4d3da3ceac tempest-TestServerVolumeAttachmentScenario-984045012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:50:59 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d4c364b-1a6d-4591-a178-eb4d3da3ceac tempest-TestServerVolumeAttachmentScenario-984045012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f743a75f-1108-4a6c-bd1a-a6097b0f7bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1c2b441-fbd1-4be4-b682-a4a36debc3b2', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:59 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d4c364b-1a6d-4591-a178-eb4d3da3ceac tempest-TestServerVolumeAttachmentScenario-984045012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87412216-e74f-4930-96f2-183a3c9c10b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:50:59 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-6d4c364b-1a6d-4591-a178-eb4d3da3ceac tempest-TestServerVolumeAttachmentScenario-984045012 None] Volume volume-b1c2b441-fbd1-4be4-b682-a4a36debc3b2 (b1c2b441-fbd1-4be4-b682-a4a36debc3b2): created successfully Sep 10 16:50:59 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d4c364b-1a6d-4591-a178-eb4d3da3ceac tempest-TestServerVolumeAttachmentScenario-984045012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87412216-e74f-4930-96f2-183a3c9c10b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:50:59 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d4c364b-1a6d-4591-a178-eb4d3da3ceac tempest-TestServerVolumeAttachmentScenario-984045012 None] Flow 'volume_create_manager' (87b7482c-e4d0-4815-ac9a-be253bb1a9ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:50:59 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-6d4c364b-1a6d-4591-a178-eb4d3da3ceac tempest-TestServerVolumeAttachmentScenario-984045012 None] Created volume successfully. Sep 10 16:51:00 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-8afd3ba6-4196-4f73-bbaf-2648f0d066e1 tempest-VolumeQuotasAdminTestJSON-104659352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:51:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8afd3ba6-4196-4f73-bbaf-2648f0d066e1 tempest-VolumeQuotasAdminTestJSON-104659352 None] Flow 'volume_create_manager' (2123e4a9-1c23-40f0-b69b-124a69fe6ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:51:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8afd3ba6-4196-4f73-bbaf-2648f0d066e1 tempest-VolumeQuotasAdminTestJSON-104659352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (009fe66a-3acd-4ba8-97f0-9900cd25a1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8afd3ba6-4196-4f73-bbaf-2648f0d066e1 tempest-VolumeQuotasAdminTestJSON-104659352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (009fe66a-3acd-4ba8-97f0-9900cd25a1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1914690934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e312e299-c9d4-498d-8515-a7af4255f058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7cb3e82a8bc4057ab6587db097160ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:51:01Z,use_quota=True,user_id='f1707b7fd44c444792f5a0d39ae34f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8afd3ba6-4196-4f73-bbaf-2648f0d066e1 tempest-VolumeQuotasAdminTestJSON-104659352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df72577c-b4ca-4bb0-a09c-87782bcf2aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8afd3ba6-4196-4f73-bbaf-2648f0d066e1 tempest-VolumeQuotasAdminTestJSON-104659352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df72577c-b4ca-4bb0-a09c-87782bcf2aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8afd3ba6-4196-4f73-bbaf-2648f0d066e1 tempest-VolumeQuotasAdminTestJSON-104659352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea242a83-82eb-48f9-82d9-4951a89a6c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8afd3ba6-4196-4f73-bbaf-2648f0d066e1 tempest-VolumeQuotasAdminTestJSON-104659352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea242a83-82eb-48f9-82d9-4951a89a6c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e312e299-c9d4-498d-8515-a7af4255f058', 'volume_name': 'volume-e312e299-c9d4-498d-8515-a7af4255f058', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8afd3ba6-4196-4f73-bbaf-2648f0d066e1 tempest-VolumeQuotasAdminTestJSON-104659352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb5cbb2-efc2-4a5e-8c97-69b1b2900402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8afd3ba6-4196-4f73-bbaf-2648f0d066e1 tempest-VolumeQuotasAdminTestJSON-104659352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb5cbb2-efc2-4a5e-8c97-69b1b2900402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8afd3ba6-4196-4f73-bbaf-2648f0d066e1 tempest-VolumeQuotasAdminTestJSON-104659352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f0d83e0-b1f8-41f2-80ab-2242f2c7b7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:00 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-8afd3ba6-4196-4f73-bbaf-2648f0d066e1 tempest-VolumeQuotasAdminTestJSON-104659352 None] Volume e312e299-c9d4-498d-8515-a7af4255f058: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e312e299-c9d4-498d-8515-a7af4255f058', 'volume_size': 1} Sep 10 16:51:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8afd3ba6-4196-4f73-bbaf-2648f0d066e1 tempest-VolumeQuotasAdminTestJSON-104659352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:51:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8afd3ba6-4196-4f73-bbaf-2648f0d066e1 tempest-VolumeQuotasAdminTestJSON-104659352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:51:00 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8afd3ba6-4196-4f73-bbaf-2648f0d066e1 tempest-VolumeQuotasAdminTestJSON-104659352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1914690934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e312e299-c9d4-498d-8515-a7af4255f058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7cb3e82a8bc4057ab6587db097160ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:51:01Z,use_quota=True,user_id='f1707b7fd44c444792f5a0d39ae34f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:51:00 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-8afd3ba6-4196-4f73-bbaf-2648f0d066e1 tempest-VolumeQuotasAdminTestJSON-104659352 None] Creating volume e312e299-c9d4-498d-8515-a7af4255f058 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:51:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8afd3ba6-4196-4f73-bbaf-2648f0d066e1 tempest-VolumeQuotasAdminTestJSON-104659352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:51:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8afd3ba6-4196-4f73-bbaf-2648f0d066e1 tempest-VolumeQuotasAdminTestJSON-104659352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:51:00 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8afd3ba6-4196-4f73-bbaf-2648f0d066e1 tempest-VolumeQuotasAdminTestJSON-104659352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:51:00 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8afd3ba6-4196-4f73-bbaf-2648f0d066e1 tempest-VolumeQuotasAdminTestJSON-104659352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:51:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8afd3ba6-4196-4f73-bbaf-2648f0d066e1 tempest-VolumeQuotasAdminTestJSON-104659352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:51:00 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8afd3ba6-4196-4f73-bbaf-2648f0d066e1 tempest-VolumeQuotasAdminTestJSON-104659352 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:51:00 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-8afd3ba6-4196-4f73-bbaf-2648f0d066e1 tempest-VolumeQuotasAdminTestJSON-104659352 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:51:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8afd3ba6-4196-4f73-bbaf-2648f0d066e1 tempest-VolumeQuotasAdminTestJSON-104659352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e312e299-c9d4-498d-8515-a7af4255f058 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:00 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e312e299-c9d4-498d-8515-a7af4255f058 1073741824 Sep 10 16:51:00 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:01 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8afd3ba6-4196-4f73-bbaf-2648f0d066e1 tempest-VolumeQuotasAdminTestJSON-104659352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e312e299-c9d4-498d-8515-a7af4255f058 1073741824" returned: 0 in 0.587s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8afd3ba6-4196-4f73-bbaf-2648f0d066e1 tempest-VolumeQuotasAdminTestJSON-104659352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e312e299-c9d4-498d-8515-a7af4255f058 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:01 devstack sudo[102495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e312e299-c9d4-498d-8515-a7af4255f058 Sep 10 16:51:01 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:01 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8afd3ba6-4196-4f73-bbaf-2648f0d066e1 tempest-VolumeQuotasAdminTestJSON-104659352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e312e299-c9d4-498d-8515-a7af4255f058" returned: 0 in 0.299s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:01 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8afd3ba6-4196-4f73-bbaf-2648f0d066e1 tempest-VolumeQuotasAdminTestJSON-104659352 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:51:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8afd3ba6-4196-4f73-bbaf-2648f0d066e1 tempest-VolumeQuotasAdminTestJSON-104659352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:51:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8afd3ba6-4196-4f73-bbaf-2648f0d066e1 tempest-VolumeQuotasAdminTestJSON-104659352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f0d83e0-b1f8-41f2-80ab-2242f2c7b7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e312e299-c9d4-498d-8515-a7af4255f058', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8afd3ba6-4196-4f73-bbaf-2648f0d066e1 tempest-VolumeQuotasAdminTestJSON-104659352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8c088c8-4a99-4799-97ae-acee43eabdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:01 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-8afd3ba6-4196-4f73-bbaf-2648f0d066e1 tempest-VolumeQuotasAdminTestJSON-104659352 None] Volume volume-e312e299-c9d4-498d-8515-a7af4255f058 (e312e299-c9d4-498d-8515-a7af4255f058): created successfully Sep 10 16:51:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8afd3ba6-4196-4f73-bbaf-2648f0d066e1 tempest-VolumeQuotasAdminTestJSON-104659352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8c088c8-4a99-4799-97ae-acee43eabdc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8afd3ba6-4196-4f73-bbaf-2648f0d066e1 tempest-VolumeQuotasAdminTestJSON-104659352 None] Flow 'volume_create_manager' (2123e4a9-1c23-40f0-b69b-124a69fe6ec7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:51:01 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-8afd3ba6-4196-4f73-bbaf-2648f0d066e1 tempest-VolumeQuotasAdminTestJSON-104659352 None] Created volume successfully. Sep 10 16:51:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-df73658d-3723-4021-a7eb-bb869f162599 tempest-VolumeQuotasAdminTestJSON-104659352 None] Acquiring lock "cinder-e312e299-c9d4-498d-8515-a7af4255f058-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:51:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-df73658d-3723-4021-a7eb-bb869f162599 tempest-VolumeQuotasAdminTestJSON-104659352 None] Lock "cinder-e312e299-c9d4-498d-8515-a7af4255f058-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:51:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-df73658d-3723-4021-a7eb-bb869f162599 tempest-VolumeQuotasAdminTestJSON-104659352 None] Acquiring lock "cinder-quobyte-e312e299-c9d4-498d-8515-a7af4255f058" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:51:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-df73658d-3723-4021-a7eb-bb869f162599 tempest-VolumeQuotasAdminTestJSON-104659352 None] Lock "cinder-quobyte-e312e299-c9d4-498d-8515-a7af4255f058" acquired by "delete_volume" :: waited 0.022s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:51:03 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[281e14cd-5fb3-44e7-a466-07548d45fd14]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:51:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-df73658d-3723-4021-a7eb-bb869f162599 tempest-VolumeQuotasAdminTestJSON-104659352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e312e299-c9d4-498d-8515-a7af4255f058 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:03 devstack sudo[102511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e312e299-c9d4-498d-8515-a7af4255f058 Sep 10 16:51:03 devstack sudo[102511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:03 devstack sudo[102511]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-df73658d-3723-4021-a7eb-bb869f162599 tempest-VolumeQuotasAdminTestJSON-104659352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e312e299-c9d4-498d-8515-a7af4255f058" returned: 0 in 0.620s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-df73658d-3723-4021-a7eb-bb869f162599 tempest-VolumeQuotasAdminTestJSON-104659352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e312e299-c9d4-498d-8515-a7af4255f058 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:03 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e312e299-c9d4-498d-8515-a7af4255f058 Sep 10 16:51:03 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:03 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-df73658d-3723-4021-a7eb-bb869f162599 tempest-VolumeQuotasAdminTestJSON-104659352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e312e299-c9d4-498d-8515-a7af4255f058" returned: 0 in 0.295s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-df73658d-3723-4021-a7eb-bb869f162599 tempest-VolumeQuotasAdminTestJSON-104659352 None] Lock "cinder-quobyte-e312e299-c9d4-498d-8515-a7af4255f058" released by "delete_volume" :: held 0.996s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:51:04 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-df73658d-3723-4021-a7eb-bb869f162599 tempest-VolumeQuotasAdminTestJSON-104659352 None] Created reservations ['9993a68b-e6e2-4882-b1ad-81b5699480fa', '74857a63-48e6-44a7-98d1-d600dc873d64', 'e1a87c0d-44a1-428f-b520-dee90d0431c6', '94016bc6-f8a0-4db8-8317-5c9de6107c55'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:51:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-df73658d-3723-4021-a7eb-bb869f162599 tempest-VolumeQuotasAdminTestJSON-104659352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:51:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-df73658d-3723-4021-a7eb-bb869f162599 tempest-VolumeQuotasAdminTestJSON-104659352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:51:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-df73658d-3723-4021-a7eb-bb869f162599 tempest-VolumeQuotasAdminTestJSON-104659352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:51:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-df73658d-3723-4021-a7eb-bb869f162599 tempest-VolumeQuotasAdminTestJSON-104659352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:51:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-df73658d-3723-4021-a7eb-bb869f162599 tempest-VolumeQuotasAdminTestJSON-104659352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:51:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-df73658d-3723-4021-a7eb-bb869f162599 tempest-VolumeQuotasAdminTestJSON-104659352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:04 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:51:04 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:04 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-df73658d-3723-4021-a7eb-bb869f162599 tempest-VolumeQuotasAdminTestJSON-104659352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.323s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:04 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-df73658d-3723-4021-a7eb-bb869f162599 tempest-VolumeQuotasAdminTestJSON-104659352 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:51:04 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-df73658d-3723-4021-a7eb-bb869f162599 tempest-VolumeQuotasAdminTestJSON-104659352 None] Deleted volume successfully. Sep 10 16:51:04 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-df73658d-3723-4021-a7eb-bb869f162599 tempest-VolumeQuotasAdminTestJSON-104659352 None] Lock "cinder-e312e299-c9d4-498d-8515-a7af4255f058-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:51:05 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-4158d687-9f59-4089-8c7b-10bfe789a46f tempest-VolumeQuotasAdminTestJSON-104659352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:51:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-4158d687-9f59-4089-8c7b-10bfe789a46f tempest-VolumeQuotasAdminTestJSON-104659352 None] Flow 'volume_create_manager' (ceecfbd4-cc97-423e-838f-5933f7fc1a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:51:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-4158d687-9f59-4089-8c7b-10bfe789a46f tempest-VolumeQuotasAdminTestJSON-104659352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b7b3a3-8dc7-49a6-800a-95d987a69165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-4158d687-9f59-4089-8c7b-10bfe789a46f tempest-VolumeQuotasAdminTestJSON-104659352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b7b3a3-8dc7-49a6-800a-95d987a69165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-575199090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7862760-fa10-4ec7-b1f1-9ad454681e4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7cb3e82a8bc4057ab6587db097160ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:51:06Z,use_quota=True,user_id='f1707b7fd44c444792f5a0d39ae34f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-4158d687-9f59-4089-8c7b-10bfe789a46f tempest-VolumeQuotasAdminTestJSON-104659352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7493a5a-5767-4b08-8170-31f144be31b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-4158d687-9f59-4089-8c7b-10bfe789a46f tempest-VolumeQuotasAdminTestJSON-104659352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7493a5a-5767-4b08-8170-31f144be31b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-4158d687-9f59-4089-8c7b-10bfe789a46f tempest-VolumeQuotasAdminTestJSON-104659352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6633bcd-e419-4c65-b7ac-46dd1913e390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-4158d687-9f59-4089-8c7b-10bfe789a46f tempest-VolumeQuotasAdminTestJSON-104659352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6633bcd-e419-4c65-b7ac-46dd1913e390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7862760-fa10-4ec7-b1f1-9ad454681e4a', 'volume_name': 'volume-b7862760-fa10-4ec7-b1f1-9ad454681e4a', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-4158d687-9f59-4089-8c7b-10bfe789a46f tempest-VolumeQuotasAdminTestJSON-104659352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9cab07b-4744-4262-8a53-95896d86ece3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:05 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-4158d687-9f59-4089-8c7b-10bfe789a46f tempest-VolumeQuotasAdminTestJSON-104659352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9cab07b-4744-4262-8a53-95896d86ece3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:06 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-4158d687-9f59-4089-8c7b-10bfe789a46f tempest-VolumeQuotasAdminTestJSON-104659352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc94fc94-7397-439b-a839-f144076e18ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:06 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-4158d687-9f59-4089-8c7b-10bfe789a46f tempest-VolumeQuotasAdminTestJSON-104659352 None] Volume b7862760-fa10-4ec7-b1f1-9ad454681e4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7862760-fa10-4ec7-b1f1-9ad454681e4a', 'volume_size': 1} Sep 10 16:51:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4158d687-9f59-4089-8c7b-10bfe789a46f tempest-VolumeQuotasAdminTestJSON-104659352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:51:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4158d687-9f59-4089-8c7b-10bfe789a46f tempest-VolumeQuotasAdminTestJSON-104659352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:51:06 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-4158d687-9f59-4089-8c7b-10bfe789a46f tempest-VolumeQuotasAdminTestJSON-104659352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-575199090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7862760-fa10-4ec7-b1f1-9ad454681e4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7cb3e82a8bc4057ab6587db097160ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:51:06Z,use_quota=True,user_id='f1707b7fd44c444792f5a0d39ae34f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:51:06 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-4158d687-9f59-4089-8c7b-10bfe789a46f tempest-VolumeQuotasAdminTestJSON-104659352 None] Creating volume b7862760-fa10-4ec7-b1f1-9ad454681e4a {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:51:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4158d687-9f59-4089-8c7b-10bfe789a46f tempest-VolumeQuotasAdminTestJSON-104659352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:51:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4158d687-9f59-4089-8c7b-10bfe789a46f tempest-VolumeQuotasAdminTestJSON-104659352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:51:06 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-4158d687-9f59-4089-8c7b-10bfe789a46f tempest-VolumeQuotasAdminTestJSON-104659352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:51:06 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-4158d687-9f59-4089-8c7b-10bfe789a46f tempest-VolumeQuotasAdminTestJSON-104659352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:51:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4158d687-9f59-4089-8c7b-10bfe789a46f tempest-VolumeQuotasAdminTestJSON-104659352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:51:06 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-4158d687-9f59-4089-8c7b-10bfe789a46f tempest-VolumeQuotasAdminTestJSON-104659352 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:51:06 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-4158d687-9f59-4089-8c7b-10bfe789a46f tempest-VolumeQuotasAdminTestJSON-104659352 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:51:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4158d687-9f59-4089-8c7b-10bfe789a46f tempest-VolumeQuotasAdminTestJSON-104659352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b7862760-fa10-4ec7-b1f1-9ad454681e4a 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:06 devstack sudo[102557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b7862760-fa10-4ec7-b1f1-9ad454681e4a 1073741824 Sep 10 16:51:06 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:06 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-6bad45b0-d6b0-40cc-8875-228e40e8d8f0 req-62bfa319-2c01-47ed-ab92-4f1cc9969ad0 tempest-TestShelveInstance-182807223 None] Terminate volume connection completed successfully. Sep 10 16:51:06 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-6bad45b0-d6b0-40cc-8875-228e40e8d8f0 req-62bfa319-2c01-47ed-ab92-4f1cc9969ad0 tempest-TestShelveInstance-182807223 None] Deleting attachment 5f624649-6ee2-4908-bcfa-a8187da88c8e. {{(pid=88189) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 16:51:07 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4158d687-9f59-4089-8c7b-10bfe789a46f tempest-VolumeQuotasAdminTestJSON-104659352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b7862760-fa10-4ec7-b1f1-9ad454681e4a 1073741824" returned: 0 in 0.991s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:07 devstack cinder-volume[88189]: DEBUG cinder.coordination [req-6bad45b0-d6b0-40cc-8875-228e40e8d8f0 req-f613d34f-9016-426b-b27f-8bb88beb66eb tempest-TestShelveInstance-182807223 None] Acquiring lock "cinder-98fadc22-cde4-49bd-9fc0-28a2bf681692-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:51:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4158d687-9f59-4089-8c7b-10bfe789a46f tempest-VolumeQuotasAdminTestJSON-104659352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b7862760-fa10-4ec7-b1f1-9ad454681e4a {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:07 devstack cinder-volume[88189]: DEBUG cinder.coordination [req-6bad45b0-d6b0-40cc-8875-228e40e8d8f0 req-f613d34f-9016-426b-b27f-8bb88beb66eb tempest-TestShelveInstance-182807223 None] Lock "cinder-98fadc22-cde4-49bd-9fc0-28a2bf681692-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:51:07 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b7862760-fa10-4ec7-b1f1-9ad454681e4a Sep 10 16:51:07 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:07 devstack cinder-volume[88189]: DEBUG cinder.coordination [req-6bad45b0-d6b0-40cc-8875-228e40e8d8f0 req-f613d34f-9016-426b-b27f-8bb88beb66eb tempest-TestShelveInstance-182807223 None] Acquiring lock "cinder-quobyte-98fadc22-cde4-49bd-9fc0-28a2bf681692" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:51:07 devstack cinder-volume[88189]: DEBUG cinder.coordination [req-6bad45b0-d6b0-40cc-8875-228e40e8d8f0 req-f613d34f-9016-426b-b27f-8bb88beb66eb tempest-TestShelveInstance-182807223 None] Lock "cinder-quobyte-98fadc22-cde4-49bd-9fc0-28a2bf681692" acquired by "delete_volume" :: waited 0.034s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:51:07 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[779901a1-f8b3-4825-a55c-44db5f973f8b]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:51:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-6bad45b0-d6b0-40cc-8875-228e40e8d8f0 req-f613d34f-9016-426b-b27f-8bb88beb66eb tempest-TestShelveInstance-182807223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-98fadc22-cde4-49bd-9fc0-28a2bf681692 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:07 devstack sudo[102629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-98fadc22-cde4-49bd-9fc0-28a2bf681692 Sep 10 16:51:07 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:07 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4158d687-9f59-4089-8c7b-10bfe789a46f tempest-VolumeQuotasAdminTestJSON-104659352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b7862760-fa10-4ec7-b1f1-9ad454681e4a" returned: 0 in 0.581s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:07 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-4158d687-9f59-4089-8c7b-10bfe789a46f tempest-VolumeQuotasAdminTestJSON-104659352 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:51:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4158d687-9f59-4089-8c7b-10bfe789a46f tempest-VolumeQuotasAdminTestJSON-104659352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:51:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-4158d687-9f59-4089-8c7b-10bfe789a46f tempest-VolumeQuotasAdminTestJSON-104659352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc94fc94-7397-439b-a839-f144076e18ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7862760-fa10-4ec7-b1f1-9ad454681e4a', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-4158d687-9f59-4089-8c7b-10bfe789a46f tempest-VolumeQuotasAdminTestJSON-104659352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e2d1127-fdcc-4187-90f1-8d0381efb871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:07 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-4158d687-9f59-4089-8c7b-10bfe789a46f tempest-VolumeQuotasAdminTestJSON-104659352 None] Volume volume-b7862760-fa10-4ec7-b1f1-9ad454681e4a (b7862760-fa10-4ec7-b1f1-9ad454681e4a): created successfully Sep 10 16:51:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-4158d687-9f59-4089-8c7b-10bfe789a46f tempest-VolumeQuotasAdminTestJSON-104659352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e2d1127-fdcc-4187-90f1-8d0381efb871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-4158d687-9f59-4089-8c7b-10bfe789a46f tempest-VolumeQuotasAdminTestJSON-104659352 None] Flow 'volume_create_manager' (ceecfbd4-cc97-423e-838f-5933f7fc1a99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:51:07 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-4158d687-9f59-4089-8c7b-10bfe789a46f tempest-VolumeQuotasAdminTestJSON-104659352 None] Created volume successfully. Sep 10 16:51:08 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-6bad45b0-d6b0-40cc-8875-228e40e8d8f0 req-f613d34f-9016-426b-b27f-8bb88beb66eb tempest-TestShelveInstance-182807223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-98fadc22-cde4-49bd-9fc0-28a2bf681692" returned: 0 in 0.667s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-6bad45b0-d6b0-40cc-8875-228e40e8d8f0 req-f613d34f-9016-426b-b27f-8bb88beb66eb tempest-TestShelveInstance-182807223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-98fadc22-cde4-49bd-9fc0-28a2bf681692 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:08 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-98fadc22-cde4-49bd-9fc0-28a2bf681692 Sep 10 16:51:08 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:08 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-6bad45b0-d6b0-40cc-8875-228e40e8d8f0 req-f613d34f-9016-426b-b27f-8bb88beb66eb tempest-TestShelveInstance-182807223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-98fadc22-cde4-49bd-9fc0-28a2bf681692" returned: 0 in 0.348s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:08 devstack cinder-volume[88189]: DEBUG cinder.coordination [req-6bad45b0-d6b0-40cc-8875-228e40e8d8f0 req-f613d34f-9016-426b-b27f-8bb88beb66eb tempest-TestShelveInstance-182807223 None] Lock "cinder-quobyte-98fadc22-cde4-49bd-9fc0-28a2bf681692" released by "delete_volume" :: held 1.126s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:51:08 devstack cinder-volume[88189]: DEBUG cinder.quota [req-6bad45b0-d6b0-40cc-8875-228e40e8d8f0 req-f613d34f-9016-426b-b27f-8bb88beb66eb tempest-TestShelveInstance-182807223 None] Created reservations ['1c24028b-572d-43cf-9863-2d30a2784c52', '70879a07-9b95-44b0-b28e-7224af8fc078', 'a30c89a4-cc9b-488f-b099-344a45b8d56b', 'ef96bc49-c105-49b7-816d-13f414be45ff'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:51:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-6bad45b0-d6b0-40cc-8875-228e40e8d8f0 req-f613d34f-9016-426b-b27f-8bb88beb66eb tempest-TestShelveInstance-182807223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:51:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-6bad45b0-d6b0-40cc-8875-228e40e8d8f0 req-f613d34f-9016-426b-b27f-8bb88beb66eb tempest-TestShelveInstance-182807223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:51:08 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [req-6bad45b0-d6b0-40cc-8875-228e40e8d8f0 req-f613d34f-9016-426b-b27f-8bb88beb66eb tempest-TestShelveInstance-182807223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:51:08 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [req-6bad45b0-d6b0-40cc-8875-228e40e8d8f0 req-f613d34f-9016-426b-b27f-8bb88beb66eb tempest-TestShelveInstance-182807223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:51:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-6bad45b0-d6b0-40cc-8875-228e40e8d8f0 req-f613d34f-9016-426b-b27f-8bb88beb66eb tempest-TestShelveInstance-182807223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:51:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-6bad45b0-d6b0-40cc-8875-228e40e8d8f0 req-f613d34f-9016-426b-b27f-8bb88beb66eb tempest-TestShelveInstance-182807223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:08 devstack sudo[102645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:51:08 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:08 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [req-6bad45b0-d6b0-40cc-8875-228e40e8d8f0 req-f613d34f-9016-426b-b27f-8bb88beb66eb tempest-TestShelveInstance-182807223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.357s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:08 devstack cinder-volume[88189]: DEBUG cinder.manager [req-6bad45b0-d6b0-40cc-8875-228e40e8d8f0 req-f613d34f-9016-426b-b27f-8bb88beb66eb tempest-TestShelveInstance-182807223 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:51:08 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-6bad45b0-d6b0-40cc-8875-228e40e8d8f0 req-f613d34f-9016-426b-b27f-8bb88beb66eb tempest-TestShelveInstance-182807223 None] Deleted volume successfully. Sep 10 16:51:09 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-27ebdf8a-462b-4107-ab52-3fe3c73ed03b tempest-VolumeQuotasAdminTestJSON-1121035602 None] Transfer volume completed successfully. Sep 10 16:51:09 devstack cinder-volume[88189]: DEBUG cinder.coordination [req-6bad45b0-d6b0-40cc-8875-228e40e8d8f0 req-f613d34f-9016-426b-b27f-8bb88beb66eb tempest-TestShelveInstance-182807223 None] Lock "cinder-98fadc22-cde4-49bd-9fc0-28a2bf681692-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:51:09 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2738a45b-ff12-4b39-8140-06a42566d982 tempest-VolumeQuotasAdminTestJSON-148108160 None] Acquiring lock "cinder-b7862760-fa10-4ec7-b1f1-9ad454681e4a-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:51:09 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2738a45b-ff12-4b39-8140-06a42566d982 tempest-VolumeQuotasAdminTestJSON-148108160 None] Lock "cinder-b7862760-fa10-4ec7-b1f1-9ad454681e4a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:51:09 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2738a45b-ff12-4b39-8140-06a42566d982 tempest-VolumeQuotasAdminTestJSON-148108160 None] Acquiring lock "cinder-quobyte-b7862760-fa10-4ec7-b1f1-9ad454681e4a" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:51:09 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2738a45b-ff12-4b39-8140-06a42566d982 tempest-VolumeQuotasAdminTestJSON-148108160 None] Lock "cinder-quobyte-b7862760-fa10-4ec7-b1f1-9ad454681e4a" acquired by "delete_volume" :: waited 0.022s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:51:09 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[faba80c2-cc01-4415-b60f-46e7da609eb4]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:51:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2738a45b-ff12-4b39-8140-06a42566d982 tempest-VolumeQuotasAdminTestJSON-148108160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b7862760-fa10-4ec7-b1f1-9ad454681e4a {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:09 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b7862760-fa10-4ec7-b1f1-9ad454681e4a Sep 10 16:51:09 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:10 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2738a45b-ff12-4b39-8140-06a42566d982 tempest-VolumeQuotasAdminTestJSON-148108160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b7862760-fa10-4ec7-b1f1-9ad454681e4a" returned: 0 in 0.510s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2738a45b-ff12-4b39-8140-06a42566d982 tempest-VolumeQuotasAdminTestJSON-148108160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b7862760-fa10-4ec7-b1f1-9ad454681e4a {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:10 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b7862760-fa10-4ec7-b1f1-9ad454681e4a Sep 10 16:51:10 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:10 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2738a45b-ff12-4b39-8140-06a42566d982 tempest-VolumeQuotasAdminTestJSON-148108160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b7862760-fa10-4ec7-b1f1-9ad454681e4a" returned: 0 in 0.452s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:10 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2738a45b-ff12-4b39-8140-06a42566d982 tempest-VolumeQuotasAdminTestJSON-148108160 None] Lock "cinder-quobyte-b7862760-fa10-4ec7-b1f1-9ad454681e4a" released by "delete_volume" :: held 1.023s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:51:10 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-2738a45b-ff12-4b39-8140-06a42566d982 tempest-VolumeQuotasAdminTestJSON-148108160 None] Created reservations ['364c1d31-47ea-4539-b611-3e589d46bcd5', '986c5461-0413-405c-8fa2-5dbbc7983f9e', '879a53a9-1aab-4a4b-8c70-d5f60120149c', '79c2f998-0fca-4dc0-bc62-258f7ba085cc'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:51:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2738a45b-ff12-4b39-8140-06a42566d982 tempest-VolumeQuotasAdminTestJSON-148108160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:51:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2738a45b-ff12-4b39-8140-06a42566d982 tempest-VolumeQuotasAdminTestJSON-148108160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:51:10 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-2738a45b-ff12-4b39-8140-06a42566d982 tempest-VolumeQuotasAdminTestJSON-148108160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:51:10 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-2738a45b-ff12-4b39-8140-06a42566d982 tempest-VolumeQuotasAdminTestJSON-148108160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:51:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2738a45b-ff12-4b39-8140-06a42566d982 tempest-VolumeQuotasAdminTestJSON-148108160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:51:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2738a45b-ff12-4b39-8140-06a42566d982 tempest-VolumeQuotasAdminTestJSON-148108160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:11 devstack sudo[102657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:51:11 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:11 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2738a45b-ff12-4b39-8140-06a42566d982 tempest-VolumeQuotasAdminTestJSON-148108160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.438s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:11 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-2738a45b-ff12-4b39-8140-06a42566d982 tempest-VolumeQuotasAdminTestJSON-148108160 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:51:11 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-2738a45b-ff12-4b39-8140-06a42566d982 tempest-VolumeQuotasAdminTestJSON-148108160 None] Deleted volume successfully. Sep 10 16:51:11 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2738a45b-ff12-4b39-8140-06a42566d982 tempest-VolumeQuotasAdminTestJSON-148108160 None] Lock "cinder-b7862760-fa10-4ec7-b1f1-9ad454681e4a-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:51:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-4ec8f6b2-9ebd-4ecc-8363-c626db069313 req-9be51070-b167-4dc9-86e6-338d88847526 tempest-TestInstancesWithCinderVolumes-1558773528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:51:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-4ec8f6b2-9ebd-4ecc-8363-c626db069313 req-9be51070-b167-4dc9-86e6-338d88847526 tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:51:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-4ec8f6b2-9ebd-4ecc-8363-c626db069313 req-9be51070-b167-4dc9-86e6-338d88847526 tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:51:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-4ec8f6b2-9ebd-4ecc-8363-c626db069313 req-9be51070-b167-4dc9-86e6-338d88847526 tempest-TestInstancesWithCinderVolumes-1558773528 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8', 'name': 'volume-c9ab3a2c-aa19-4cff-88fc-c8b2df27b269', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cb1acd51-bc5b-45cc-a926-96ef13b804c5', 'enforce_multipath': True} {{(pid=88189) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 16:51:18 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-4ec8f6b2-9ebd-4ecc-8363-c626db069313 req-9be51070-b167-4dc9-86e6-338d88847526 tempest-TestInstancesWithCinderVolumes-1558773528 None] attachment_update completed successfully. Sep 10 16:51:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-c675762e-dcf4-4901-91e9-556fe65898bf req-2e2a56cb-351e-48a9-b94e-52e5a34d7d4a tempest-TestInstancesWithCinderVolumes-1558773528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:51:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-c675762e-dcf4-4901-91e9-556fe65898bf req-2e2a56cb-351e-48a9-b94e-52e5a34d7d4a tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:51:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-c675762e-dcf4-4901-91e9-556fe65898bf req-2e2a56cb-351e-48a9-b94e-52e5a34d7d4a tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:51:22 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-c675762e-dcf4-4901-91e9-556fe65898bf req-2e2a56cb-351e-48a9-b94e-52e5a34d7d4a tempest-TestInstancesWithCinderVolumes-1558773528 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8', 'name': 'volume-e73164a2-edae-47f1-b131-5a70597bd790', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9a3e261a-670b-459d-b15b-e69c2f9a662a', 'enforce_multipath': True} {{(pid=88189) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 16:51:22 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-c675762e-dcf4-4901-91e9-556fe65898bf req-2e2a56cb-351e-48a9-b94e-52e5a34d7d4a tempest-TestInstancesWithCinderVolumes-1558773528 None] attachment_update completed successfully. Sep 10 16:51:23 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff76c627-59f5-48ea-927d-a25cf19ed137 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:51:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ff76c627-59f5-48ea-927d-a25cf19ed137 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Flow 'volume_create_manager' (c439365d-c0d2-4e1a-b60a-c2516a4ca143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:51:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ff76c627-59f5-48ea-927d-a25cf19ed137 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (106aa08d-3687-4c08-bbae-c53e6cf8a2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ff76c627-59f5-48ea-927d-a25cf19ed137 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (106aa08d-3687-4c08-bbae-c53e6cf8a2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-116720551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b237492f-f897-46e0-b89a-2796979096d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a44707899614b95a2a2fdd5212b6611',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:51:24Z,use_quota=True,user_id='62391657c3ab4fbeb04c3f6c32ca8449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ff76c627-59f5-48ea-927d-a25cf19ed137 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787be204-06a5-43ee-8826-83ef434bcc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ff76c627-59f5-48ea-927d-a25cf19ed137 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787be204-06a5-43ee-8826-83ef434bcc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ff76c627-59f5-48ea-927d-a25cf19ed137 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (107fc121-2bf1-40c5-8f2c-ebc8981f27c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ff76c627-59f5-48ea-927d-a25cf19ed137 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (107fc121-2bf1-40c5-8f2c-ebc8981f27c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b237492f-f897-46e0-b89a-2796979096d1', 'volume_name': 'volume-b237492f-f897-46e0-b89a-2796979096d1', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ff76c627-59f5-48ea-927d-a25cf19ed137 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db258651-931f-4dbf-b3fd-d843fbfb2039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ff76c627-59f5-48ea-927d-a25cf19ed137 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db258651-931f-4dbf-b3fd-d843fbfb2039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ff76c627-59f5-48ea-927d-a25cf19ed137 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (923229f1-3fa9-4d84-ba62-3d4ea9cd1512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:23 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-ff76c627-59f5-48ea-927d-a25cf19ed137 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Volume b237492f-f897-46e0-b89a-2796979096d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b237492f-f897-46e0-b89a-2796979096d1', 'volume_size': 1} Sep 10 16:51:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ff76c627-59f5-48ea-927d-a25cf19ed137 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:51:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ff76c627-59f5-48ea-927d-a25cf19ed137 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:51:23 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ff76c627-59f5-48ea-927d-a25cf19ed137 tempest-VolumeQuotasNegativeTestJSON-488137671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-116720551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b237492f-f897-46e0-b89a-2796979096d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a44707899614b95a2a2fdd5212b6611',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:51:24Z,use_quota=True,user_id='62391657c3ab4fbeb04c3f6c32ca8449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:51:23 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-ff76c627-59f5-48ea-927d-a25cf19ed137 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Creating volume b237492f-f897-46e0-b89a-2796979096d1 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:51:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ff76c627-59f5-48ea-927d-a25cf19ed137 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:51:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ff76c627-59f5-48ea-927d-a25cf19ed137 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:51:23 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ff76c627-59f5-48ea-927d-a25cf19ed137 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:51:23 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ff76c627-59f5-48ea-927d-a25cf19ed137 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:51:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ff76c627-59f5-48ea-927d-a25cf19ed137 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:51:23 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ff76c627-59f5-48ea-927d-a25cf19ed137 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:51:23 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-ff76c627-59f5-48ea-927d-a25cf19ed137 tempest-VolumeQuotasNegativeTestJSON-488137671 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:51:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ff76c627-59f5-48ea-927d-a25cf19ed137 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b237492f-f897-46e0-b89a-2796979096d1 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:23 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b237492f-f897-46e0-b89a-2796979096d1 1073741824 Sep 10 16:51:23 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:24 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ff76c627-59f5-48ea-927d-a25cf19ed137 tempest-VolumeQuotasNegativeTestJSON-488137671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b237492f-f897-46e0-b89a-2796979096d1 1073741824" returned: 0 in 0.532s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ff76c627-59f5-48ea-927d-a25cf19ed137 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b237492f-f897-46e0-b89a-2796979096d1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:24 devstack sudo[102768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b237492f-f897-46e0-b89a-2796979096d1 Sep 10 16:51:24 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:24 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ff76c627-59f5-48ea-927d-a25cf19ed137 tempest-VolumeQuotasNegativeTestJSON-488137671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b237492f-f897-46e0-b89a-2796979096d1" returned: 0 in 0.285s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:24 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ff76c627-59f5-48ea-927d-a25cf19ed137 tempest-VolumeQuotasNegativeTestJSON-488137671 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:51:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ff76c627-59f5-48ea-927d-a25cf19ed137 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:51:24 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ff76c627-59f5-48ea-927d-a25cf19ed137 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (923229f1-3fa9-4d84-ba62-3d4ea9cd1512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b237492f-f897-46e0-b89a-2796979096d1', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:24 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ff76c627-59f5-48ea-927d-a25cf19ed137 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1473c315-0152-45b8-a064-29534c63223d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:24 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-ff76c627-59f5-48ea-927d-a25cf19ed137 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Volume volume-b237492f-f897-46e0-b89a-2796979096d1 (b237492f-f897-46e0-b89a-2796979096d1): created successfully Sep 10 16:51:24 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ff76c627-59f5-48ea-927d-a25cf19ed137 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1473c315-0152-45b8-a064-29534c63223d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:24 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ff76c627-59f5-48ea-927d-a25cf19ed137 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Flow 'volume_create_manager' (c439365d-c0d2-4e1a-b60a-c2516a4ca143) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:51:24 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-ff76c627-59f5-48ea-927d-a25cf19ed137 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Created volume successfully. Sep 10 16:51:26 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-e4fc9c81-a11d-47d0-bda2-618bc2a93227 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Acquiring lock "cinder-b237492f-f897-46e0-b89a-2796979096d1-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:51:26 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-e4fc9c81-a11d-47d0-bda2-618bc2a93227 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Lock "cinder-b237492f-f897-46e0-b89a-2796979096d1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:51:27 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-e4fc9c81-a11d-47d0-bda2-618bc2a93227 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Acquiring lock "cinder-quobyte-b237492f-f897-46e0-b89a-2796979096d1" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:51:27 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-e4fc9c81-a11d-47d0-bda2-618bc2a93227 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Lock "cinder-quobyte-b237492f-f897-46e0-b89a-2796979096d1" acquired by "delete_volume" :: waited 0.019s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:51:27 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb36575-1066-4a30-aae1-d1d65c69dbc2]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:51:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e4fc9c81-a11d-47d0-bda2-618bc2a93227 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b237492f-f897-46e0-b89a-2796979096d1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:27 devstack sudo[102794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b237492f-f897-46e0-b89a-2796979096d1 Sep 10 16:51:27 devstack sudo[102794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:27 devstack sudo[102794]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e4fc9c81-a11d-47d0-bda2-618bc2a93227 tempest-VolumeQuotasNegativeTestJSON-488137671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b237492f-f897-46e0-b89a-2796979096d1" returned: 0 in 0.416s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e4fc9c81-a11d-47d0-bda2-618bc2a93227 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b237492f-f897-46e0-b89a-2796979096d1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:27 devstack sudo[102807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b237492f-f897-46e0-b89a-2796979096d1 Sep 10 16:51:27 devstack sudo[102807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:27 devstack sudo[102807]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e4fc9c81-a11d-47d0-bda2-618bc2a93227 tempest-VolumeQuotasNegativeTestJSON-488137671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b237492f-f897-46e0-b89a-2796979096d1" returned: 0 in 0.267s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:27 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-e4fc9c81-a11d-47d0-bda2-618bc2a93227 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Lock "cinder-quobyte-b237492f-f897-46e0-b89a-2796979096d1" released by "delete_volume" :: held 0.750s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:51:27 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-e4fc9c81-a11d-47d0-bda2-618bc2a93227 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Created reservations ['c0af482b-9c6a-4b8d-8b88-ff032aa9a03b', '572ca74c-af59-4dbd-a7c1-fb4407b4fd2b', '398fd7f9-5b88-4771-ad92-f5eb9102f2cf', '594ec624-8736-4f07-923d-361c1203c8cd'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:51:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e4fc9c81-a11d-47d0-bda2-618bc2a93227 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:51:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e4fc9c81-a11d-47d0-bda2-618bc2a93227 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:51:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-e4fc9c81-a11d-47d0-bda2-618bc2a93227 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:51:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-e4fc9c81-a11d-47d0-bda2-618bc2a93227 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:51:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e4fc9c81-a11d-47d0-bda2-618bc2a93227 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:51:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e4fc9c81-a11d-47d0-bda2-618bc2a93227 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:27 devstack sudo[102816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:51:27 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:28 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e4fc9c81-a11d-47d0-bda2-618bc2a93227 tempest-VolumeQuotasNegativeTestJSON-488137671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.485s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:28 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-e4fc9c81-a11d-47d0-bda2-618bc2a93227 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:51:28 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-e4fc9c81-a11d-47d0-bda2-618bc2a93227 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Deleted volume successfully. Sep 10 16:51:28 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-e4fc9c81-a11d-47d0-bda2-618bc2a93227 tempest-VolumeQuotasNegativeTestJSON-488137671 None] Lock "cinder-b237492f-f897-46e0-b89a-2796979096d1-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:51:28 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-d9c5647c-bf6f-48a4-b3b1-dd3a34a0e501 req-4c3f129a-42ce-4761-8d75-62ec4580944b tempest-TestInstancesWithCinderVolumes-1558773528 None] Terminate volume connection completed successfully. Sep 10 16:51:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-d9c5647c-bf6f-48a4-b3b1-dd3a34a0e501 req-4c3f129a-42ce-4761-8d75-62ec4580944b tempest-TestInstancesWithCinderVolumes-1558773528 None] Deleting attachment cb1acd51-bc5b-45cc-a926-96ef13b804c5. {{(pid=88189) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 16:51:29 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bb92aa0f-bf93-41d2-bf7e-3e1937567845 tempest-TestInstancesWithCinderVolumes-1558773528 None] Acquiring lock "cinder-c9ab3a2c-aa19-4cff-88fc-c8b2df27b269-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:51:29 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bb92aa0f-bf93-41d2-bf7e-3e1937567845 tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "cinder-c9ab3a2c-aa19-4cff-88fc-c8b2df27b269-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:51:29 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bb92aa0f-bf93-41d2-bf7e-3e1937567845 tempest-TestInstancesWithCinderVolumes-1558773528 None] Acquiring lock "cinder-quobyte-c9ab3a2c-aa19-4cff-88fc-c8b2df27b269" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:51:29 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bb92aa0f-bf93-41d2-bf7e-3e1937567845 tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "cinder-quobyte-c9ab3a2c-aa19-4cff-88fc-c8b2df27b269" acquired by "delete_volume" :: waited 0.034s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:51:29 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[27394279-27d7-4e71-8757-6dcda9d60238]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:51:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bb92aa0f-bf93-41d2-bf7e-3e1937567845 tempest-TestInstancesWithCinderVolumes-1558773528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c9ab3a2c-aa19-4cff-88fc-c8b2df27b269 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:29 devstack sudo[102825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c9ab3a2c-aa19-4cff-88fc-c8b2df27b269 Sep 10 16:51:29 devstack sudo[102825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:30 devstack sudo[102825]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bb92aa0f-bf93-41d2-bf7e-3e1937567845 tempest-TestInstancesWithCinderVolumes-1558773528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c9ab3a2c-aa19-4cff-88fc-c8b2df27b269" returned: 0 in 0.643s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bb92aa0f-bf93-41d2-bf7e-3e1937567845 tempest-TestInstancesWithCinderVolumes-1558773528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c9ab3a2c-aa19-4cff-88fc-c8b2df27b269 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:30 devstack sudo[102831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c9ab3a2c-aa19-4cff-88fc-c8b2df27b269 Sep 10 16:51:30 devstack sudo[102831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:30 devstack sudo[102831]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bb92aa0f-bf93-41d2-bf7e-3e1937567845 tempest-TestInstancesWithCinderVolumes-1558773528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c9ab3a2c-aa19-4cff-88fc-c8b2df27b269" returned: 0 in 0.330s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:30 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bb92aa0f-bf93-41d2-bf7e-3e1937567845 tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "cinder-quobyte-c9ab3a2c-aa19-4cff-88fc-c8b2df27b269" released by "delete_volume" :: held 1.028s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:51:30 devstack cinder-volume[88189]: WARNING cinder.quota [None req-bb92aa0f-bf93-41d2-bf7e-3e1937567845 tempest-TestInstancesWithCinderVolumes-1558773528 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1689000907-1526999113 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1689000907-1526999113, it is now deprecated. Please use the default quota class for default quota. Sep 10 16:51:30 devstack cinder-volume[88189]: WARNING cinder.quota [None req-bb92aa0f-bf93-41d2-bf7e-3e1937567845 tempest-TestInstancesWithCinderVolumes-1558773528 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1689000907-1526999113 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1689000907-1526999113, it is now deprecated. Please use the default quota class for default quota. Sep 10 16:51:30 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-bb92aa0f-bf93-41d2-bf7e-3e1937567845 tempest-TestInstancesWithCinderVolumes-1558773528 None] Created reservations ['5637ba03-c964-4df2-886e-b066f54cb985', 'c117ae9d-db73-4d2e-9a44-29b95947f56b', '7fb54ef2-adb1-461a-82c6-8c1d0d72a312', 'd6dee153-d4d9-4c59-8dca-f2b62a7a2605'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:51:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-bb92aa0f-bf93-41d2-bf7e-3e1937567845 tempest-TestInstancesWithCinderVolumes-1558773528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:51:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-bb92aa0f-bf93-41d2-bf7e-3e1937567845 tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:51:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-bb92aa0f-bf93-41d2-bf7e-3e1937567845 tempest-TestInstancesWithCinderVolumes-1558773528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:51:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-bb92aa0f-bf93-41d2-bf7e-3e1937567845 tempest-TestInstancesWithCinderVolumes-1558773528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:51:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-bb92aa0f-bf93-41d2-bf7e-3e1937567845 tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:51:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bb92aa0f-bf93-41d2-bf7e-3e1937567845 tempest-TestInstancesWithCinderVolumes-1558773528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:30 devstack sudo[102834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:51:30 devstack sudo[102834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:31 devstack sudo[102834]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bb92aa0f-bf93-41d2-bf7e-3e1937567845 tempest-TestInstancesWithCinderVolumes-1558773528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.419s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:31 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-bb92aa0f-bf93-41d2-bf7e-3e1937567845 tempest-TestInstancesWithCinderVolumes-1558773528 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:51:31 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-bb92aa0f-bf93-41d2-bf7e-3e1937567845 tempest-TestInstancesWithCinderVolumes-1558773528 None] Deleted volume successfully. Sep 10 16:51:31 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bb92aa0f-bf93-41d2-bf7e-3e1937567845 tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "cinder-c9ab3a2c-aa19-4cff-88fc-c8b2df27b269-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:51:32 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:51:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Flow 'volume_create_manager' (1104685d-6f33-4732-b727-13d4121157c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:51:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe2eb9f-8354-4952-836f-f21b04252fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe2eb9f-8354-4952-836f-f21b04252fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd864705-516e-4052-b160-6432e1ab52e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b433f46c49c54ffb868db260d68aaaa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:51:33Z,use_quota=True,user_id='28a30da9ce5740bebef7e9cd5d349e6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0497ec9-ded6-43f8-9e39-783decc43902),volume_type_id=a0497ec9-ded6-43f8-9e39-783decc43902)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e450362c-e450-418c-b272-de8d1c742183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e450362c-e450-418c-b272-de8d1c742183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74572f86-8942-4bf7-a17f-8c43b3acb806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:32 devstack cinder-volume[88189]: DEBUG cinder.image.glance [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Creating Keystone auth plugin from conf {{(pid=88189) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 16:51:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74572f86-8942-4bf7-a17f-8c43b3acb806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fd864705-516e-4052-b160-6432e1ab52e5', 'volume_name': 'volume-fd864705-516e-4052-b160-6432e1ab52e5', 'volume_size': 1, 'image_id': '79ebb7ec-b910-4a6d-a681-10082c4747d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79ebb7ec-b910-4a6d-a681-10082c4747d0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd1d2c221f0b99d0b28244a5081fd9764', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b433f46c49c54ffb868db260d68aaaa7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '96c1fa22d3ac095ff7d7cc0eada187772a2a04aa2b5c1751ec211c4da0725451ddbe3c536f9cbafc70f98b3c822ac089403ba1b71f0c583f9f01e94c548ae3a1', 'id': '79ebb7ec-b910-4a6d-a681-10082c4747d0', 'created_at': datetime.datetime(2026, 9, 10, 14, 51, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 14, 51, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79ebb7ec-b910-4a6d-a681-10082c4747d0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249b68c3-23e9-4c51-80ed-a01df1c4d9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249b68c3-23e9-4c51-80ed-a01df1c4d9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f864d3c-e225-4034-857f-3241224ed762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:33 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Volume fd864705-516e-4052-b160-6432e1ab52e5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fd864705-516e-4052-b160-6432e1ab52e5', 'volume_size': 1, 'image_id': '79ebb7ec-b910-4a6d-a681-10082c4747d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79ebb7ec-b910-4a6d-a681-10082c4747d0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd1d2c221f0b99d0b28244a5081fd9764', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b433f46c49c54ffb868db260d68aaaa7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '96c1fa22d3ac095ff7d7cc0eada187772a2a04aa2b5c1751ec211c4da0725451ddbe3c536f9cbafc70f98b3c822ac089403ba1b71f0c583f9f01e94c548ae3a1', 'id': '79ebb7ec-b910-4a6d-a681-10082c4747d0', 'created_at': datetime.datetime(2026, 9, 10, 14, 51, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 14, 51, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79ebb7ec-b910-4a6d-a681-10082c4747d0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 10 16:51:33 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Trying to clone fd864705-516e-4052-b160-6432e1ab52e5 from image 79ebb7ec-b910-4a6d-a681-10082c4747d0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/79ebb7ec-b910-4a6d-a681-10082c4747d0', 'metadata': {}}]). {{(pid=88189) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 16:51:33 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_79ebb7ec-b910-4a6d-a681-10082c4747d0__2cepyk5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88189) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 16:51:33 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Image download 0.00 MB at 0.00 MB/s Sep 10 16:51:33 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[760e213c-1cf0-42af-bf93-91574d7dab38]: (4, 'raw') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:51:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79ebb7ec-b910-4a6d-a681-10082c4747d0__2cepyk5devstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:33 devstack sudo[102860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79ebb7ec-b910-4a6d-a681-10082c4747d0__2cepyk5devstack@QuobyteHD Sep 10 16:51:33 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:33 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79ebb7ec-b910-4a6d-a681-10082c4747d0__2cepyk5devstack@QuobyteHD" returned: 0 in 0.447s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79ebb7ec-b910-4a6d-a681-10082c4747d0__2cepyk5devstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:33 devstack sudo[102864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79ebb7ec-b910-4a6d-a681-10082c4747d0__2cepyk5devstack@QuobyteHD Sep 10 16:51:33 devstack sudo[102864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:34 devstack sudo[102864]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79ebb7ec-b910-4a6d-a681-10082c4747d0__2cepyk5devstack@QuobyteHD" returned: 1 in 0.407s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79ebb7ec-b910-4a6d-a681-10082c4747d0__2cepyk5devstack@QuobyteHD' failed. Not Retrying. {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 16:51:34 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Temporary image 79ebb7ec-b910-4a6d-a681-10082c4747d0 is fetched for user 28a30da9ce5740bebef7e9cd5d349e6b. {{(pid=88189) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 16:51:34 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9242ff-48b7-4342-81ec-4b88900e0f08]: (4, 'raw') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:51:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79ebb7ec-b910-4a6d-a681-10082c4747d0__2cepyk5devstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:34 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-ad873290-ebc6-486d-85ea-3ff413df825e req-2e61bc81-072b-47c5-8eb7-563c2a5585db tempest-TestInstancesWithCinderVolumes-1558773528 None] Terminate volume connection completed successfully. Sep 10 16:51:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-ad873290-ebc6-486d-85ea-3ff413df825e req-2e61bc81-072b-47c5-8eb7-563c2a5585db tempest-TestInstancesWithCinderVolumes-1558773528 None] Deleting attachment 9a3e261a-670b-459d-b15b-e69c2f9a662a. {{(pid=88189) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 16:51:34 devstack sudo[102875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79ebb7ec-b910-4a6d-a681-10082c4747d0__2cepyk5devstack@QuobyteHD Sep 10 16:51:34 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:34 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79ebb7ec-b910-4a6d-a681-10082c4747d0__2cepyk5devstack@QuobyteHD" returned: 0 in 0.398s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79ebb7ec-b910-4a6d-a681-10082c4747d0__2cepyk5devstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:34 devstack sudo[102880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79ebb7ec-b910-4a6d-a681-10082c4747d0__2cepyk5devstack@QuobyteHD Sep 10 16:51:34 devstack sudo[102880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-13cca52f-44f5-4b4b-b4b2-b5bac042dcac tempest-TestInstancesWithCinderVolumes-1558773528 None] Acquiring lock "cinder-e73164a2-edae-47f1-b131-5a70597bd790-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:51:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-13cca52f-44f5-4b4b-b4b2-b5bac042dcac tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "cinder-e73164a2-edae-47f1-b131-5a70597bd790-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:51:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-07de3832-990d-4aa3-85df-10a073db358c req-054d7395-b518-4766-9377-48ebaae6e422 tempest-TestServerVolumeAttachmentScenario-984045012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:51:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-07de3832-990d-4aa3-85df-10a073db358c req-054d7395-b518-4766-9377-48ebaae6e422 tempest-TestServerVolumeAttachmentScenario-984045012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:51:35 devstack sudo[102880]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79ebb7ec-b910-4a6d-a681-10082c4747d0__2cepyk5devstack@QuobyteHD" returned: 1 in 0.452s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79ebb7ec-b910-4a6d-a681-10082c4747d0__2cepyk5devstack@QuobyteHD' failed. Not Retrying. {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 16:51:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:51:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-13cca52f-44f5-4b4b-b4b2-b5bac042dcac tempest-TestInstancesWithCinderVolumes-1558773528 None] Acquiring lock "cinder-quobyte-e73164a2-edae-47f1-b131-5a70597bd790" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:51:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-07de3832-990d-4aa3-85df-10a073db358c req-054d7395-b518-4766-9377-48ebaae6e422 tempest-TestServerVolumeAttachmentScenario-984045012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:51:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:51:35 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd864705-516e-4052-b160-6432e1ab52e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b433f46c49c54ffb868db260d68aaaa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:51:33Z,use_quota=True,user_id='28a30da9ce5740bebef7e9cd5d349e6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0497ec9-ded6-43f8-9e39-783decc43902),volume_type_id=a0497ec9-ded6-43f8-9e39-783decc43902)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:51:35 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Creating volume fd864705-516e-4052-b160-6432e1ab52e5 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:51:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:51:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:51:35 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:51:35 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:51:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:51:35 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:51:35 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:51:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fd864705-516e-4052-b160-6432e1ab52e5 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-13cca52f-44f5-4b4b-b4b2-b5bac042dcac tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "cinder-quobyte-e73164a2-edae-47f1-b131-5a70597bd790" acquired by "delete_volume" :: waited 0.063s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:51:35 devstack sudo[102893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fd864705-516e-4052-b160-6432e1ab52e5 1073741824 Sep 10 16:51:35 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:35 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee6da78-75e1-48d0-bb94-76feb4619a90]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:51:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-13cca52f-44f5-4b4b-b4b2-b5bac042dcac tempest-TestInstancesWithCinderVolumes-1558773528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e73164a2-edae-47f1-b131-5a70597bd790 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-07de3832-990d-4aa3-85df-10a073db358c req-054d7395-b518-4766-9377-48ebaae6e422 tempest-TestServerVolumeAttachmentScenario-984045012 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8', 'name': 'volume-9d2bed22-8cc6-449e-8238-76f07499ecc9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a038770-6500-4187-a562-1573e0ecfebf', 'enforce_multipath': True} {{(pid=88189) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 16:51:35 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-07de3832-990d-4aa3-85df-10a073db358c req-054d7395-b518-4766-9377-48ebaae6e422 tempest-TestServerVolumeAttachmentScenario-984045012 None] attachment_update completed successfully. Sep 10 16:51:35 devstack sudo[102895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e73164a2-edae-47f1-b131-5a70597bd790 Sep 10 16:51:35 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:35 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-13cca52f-44f5-4b4b-b4b2-b5bac042dcac tempest-TestInstancesWithCinderVolumes-1558773528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e73164a2-edae-47f1-b131-5a70597bd790" returned: 0 in 0.561s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-13cca52f-44f5-4b4b-b4b2-b5bac042dcac tempest-TestInstancesWithCinderVolumes-1558773528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e73164a2-edae-47f1-b131-5a70597bd790 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:35 devstack sudo[102907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e73164a2-edae-47f1-b131-5a70597bd790 Sep 10 16:51:35 devstack sudo[102907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:35 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fd864705-516e-4052-b160-6432e1ab52e5 1073741824" returned: 0 in 0.728s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fd864705-516e-4052-b160-6432e1ab52e5 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:35 devstack sudo[102909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fd864705-516e-4052-b160-6432e1ab52e5 Sep 10 16:51:35 devstack sudo[102909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:36 devstack sudo[102907]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-13cca52f-44f5-4b4b-b4b2-b5bac042dcac tempest-TestInstancesWithCinderVolumes-1558773528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e73164a2-edae-47f1-b131-5a70597bd790" returned: 0 in 0.447s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-13cca52f-44f5-4b4b-b4b2-b5bac042dcac tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "cinder-quobyte-e73164a2-edae-47f1-b131-5a70597bd790" released by "delete_volume" :: held 1.091s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:51:36 devstack sudo[102909]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fd864705-516e-4052-b160-6432e1ab52e5" returned: 0 in 0.397s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:36 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:51:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:51:36 devstack cinder-volume[88189]: WARNING cinder.quota [None req-13cca52f-44f5-4b4b-b4b2-b5bac042dcac tempest-TestInstancesWithCinderVolumes-1558773528 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-784225843-1226924887 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-784225843-1226924887, it is now deprecated. Please use the default quota class for default quota. Sep 10 16:51:36 devstack cinder-volume[88189]: WARNING cinder.quota [None req-13cca52f-44f5-4b4b-b4b2-b5bac042dcac tempest-TestInstancesWithCinderVolumes-1558773528 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-784225843-1226924887 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-784225843-1226924887, it is now deprecated. Please use the default quota class for default quota. Sep 10 16:51:36 devstack cinder-volume[88189]: DEBUG cinder.volume.volume_utils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Attempting download of 79ebb7ec-b910-4a6d-a681-10082c4747d0 ((None, [{'url': 'file:///opt/stack/data/glance/images/79ebb7ec-b910-4a6d-a681-10082c4747d0', 'metadata': {}}])) to volume fd864705-516e-4052-b160-6432e1ab52e5. {{(pid=88189) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 16:51:36 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-13cca52f-44f5-4b4b-b4b2-b5bac042dcac tempest-TestInstancesWithCinderVolumes-1558773528 None] Created reservations ['585520cf-2c4c-46b9-854b-be2d1da31415', '4b9e8188-3231-4e99-9046-36a5634e9b8e', '774ee25c-0925-44b3-96f0-6d7c38900414', '7aa87cd9-66a0-41e2-9f78-b3750c9d0cbf'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:51:36 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ea3140-9ef2-4b60-8a20-06399e098fba]: (4, 'raw') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:51:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79ebb7ec-b910-4a6d-a681-10082c4747d0_h9flabwe {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-13cca52f-44f5-4b4b-b4b2-b5bac042dcac tempest-TestInstancesWithCinderVolumes-1558773528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:51:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-13cca52f-44f5-4b4b-b4b2-b5bac042dcac tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:51:36 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-13cca52f-44f5-4b4b-b4b2-b5bac042dcac tempest-TestInstancesWithCinderVolumes-1558773528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:51:36 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-13cca52f-44f5-4b4b-b4b2-b5bac042dcac tempest-TestInstancesWithCinderVolumes-1558773528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:51:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-13cca52f-44f5-4b4b-b4b2-b5bac042dcac tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:51:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-13cca52f-44f5-4b4b-b4b2-b5bac042dcac tempest-TestInstancesWithCinderVolumes-1558773528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:36 devstack sudo[102914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:51:36 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:36 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79ebb7ec-b910-4a6d-a681-10082c4747d0_h9flabwe Sep 10 16:51:36 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:36 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-13cca52f-44f5-4b4b-b4b2-b5bac042dcac tempest-TestInstancesWithCinderVolumes-1558773528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.348s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:36 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-13cca52f-44f5-4b4b-b4b2-b5bac042dcac tempest-TestInstancesWithCinderVolumes-1558773528 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:51:36 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-13cca52f-44f5-4b4b-b4b2-b5bac042dcac tempest-TestInstancesWithCinderVolumes-1558773528 None] Deleted volume successfully. Sep 10 16:51:36 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-273188d7-936b-49db-bbf5-aacb2bc793f6 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:51:36 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-273188d7-936b-49db-bbf5-aacb2bc793f6 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Flow 'volume_create_manager' (2bfafd25-b344-4b22-843b-c89098a2949d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:51:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-273188d7-936b-49db-bbf5-aacb2bc793f6 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47b645b0-8a43-4fa3-8408-851b03ff3e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79ebb7ec-b910-4a6d-a681-10082c4747d0_h9flabwe" returned: 0 in 0.541s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79ebb7ec-b910-4a6d-a681-10082c4747d0_h9flabwe {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-13cca52f-44f5-4b4b-b4b2-b5bac042dcac tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "cinder-e73164a2-edae-47f1-b131-5a70597bd790-delete_volume" released by "delete_volume" :: held 1.953s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:51:37 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-273188d7-936b-49db-bbf5-aacb2bc793f6 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47b645b0-8a43-4fa3-8408-851b03ff3e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-676692301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770f6c67-f123-41de-8be2-afc043a796cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eb3509531ec441d813f8e9573e311a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:51:37Z,use_quota=True,user_id='f611c7a3797a4cd183a7e4555741432e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9037a25c-2567-4a16-ab5e-b68a27e9489e),volume_type_id=9037a25c-2567-4a16-ab5e-b68a27e9489e)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:37 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-273188d7-936b-49db-bbf5-aacb2bc793f6 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8b8da4-74b3-4888-a7b8-015952beb334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:37 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-273188d7-936b-49db-bbf5-aacb2bc793f6 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8b8da4-74b3-4888-a7b8-015952beb334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:37 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-273188d7-936b-49db-bbf5-aacb2bc793f6 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11198ff6-8500-40ac-9a1a-a0ea8ff47e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:37 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-273188d7-936b-49db-bbf5-aacb2bc793f6 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11198ff6-8500-40ac-9a1a-a0ea8ff47e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '770f6c67-f123-41de-8be2-afc043a796cc', 'volume_name': 'volume-770f6c67-f123-41de-8be2-afc043a796cc', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:37 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-273188d7-936b-49db-bbf5-aacb2bc793f6 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fc32325-7302-4c10-b41e-2e656d6dd16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:37 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-273188d7-936b-49db-bbf5-aacb2bc793f6 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fc32325-7302-4c10-b41e-2e656d6dd16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:37 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-273188d7-936b-49db-bbf5-aacb2bc793f6 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f993611-875d-4e7c-aed5-b7bc5152c626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:37 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-273188d7-936b-49db-bbf5-aacb2bc793f6 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Volume 770f6c67-f123-41de-8be2-afc043a796cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-770f6c67-f123-41de-8be2-afc043a796cc', 'volume_size': 1} Sep 10 16:51:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-273188d7-936b-49db-bbf5-aacb2bc793f6 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:51:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-273188d7-936b-49db-bbf5-aacb2bc793f6 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:51:37 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-273188d7-936b-49db-bbf5-aacb2bc793f6 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-676692301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770f6c67-f123-41de-8be2-afc043a796cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eb3509531ec441d813f8e9573e311a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:51:37Z,use_quota=True,user_id='f611c7a3797a4cd183a7e4555741432e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9037a25c-2567-4a16-ab5e-b68a27e9489e),volume_type_id=9037a25c-2567-4a16-ab5e-b68a27e9489e)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:51:37 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-273188d7-936b-49db-bbf5-aacb2bc793f6 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Creating volume 770f6c67-f123-41de-8be2-afc043a796cc {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:51:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-273188d7-936b-49db-bbf5-aacb2bc793f6 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:51:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-273188d7-936b-49db-bbf5-aacb2bc793f6 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:51:37 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-273188d7-936b-49db-bbf5-aacb2bc793f6 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:51:37 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-273188d7-936b-49db-bbf5-aacb2bc793f6 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:51:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-273188d7-936b-49db-bbf5-aacb2bc793f6 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:51:37 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-273188d7-936b-49db-bbf5-aacb2bc793f6 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:51:37 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-273188d7-936b-49db-bbf5-aacb2bc793f6 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:51:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-273188d7-936b-49db-bbf5-aacb2bc793f6 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-770f6c67-f123-41de-8be2-afc043a796cc 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:37 devstack sudo[102921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79ebb7ec-b910-4a6d-a681-10082c4747d0_h9flabwe Sep 10 16:51:37 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:37 devstack sudo[102922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-770f6c67-f123-41de-8be2-afc043a796cc 1073741824 Sep 10 16:51:37 devstack sudo[102922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:37 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79ebb7ec-b910-4a6d-a681-10082c4747d0_h9flabwe" returned: 1 in 0.431s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79ebb7ec-b910-4a6d-a681-10082c4747d0_h9flabwe' failed. Not Retrying. {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 16:51:37 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfc602c-db40-407b-b68d-3ff9d3a56b9c]: (4, 'raw') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:51:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79ebb7ec-b910-4a6d-a681-10082c4747d0__2cepyk5devstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:37 devstack sudo[102930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79ebb7ec-b910-4a6d-a681-10082c4747d0__2cepyk5devstack@QuobyteHD Sep 10 16:51:37 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:37 devstack sudo[102922]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-273188d7-936b-49db-bbf5-aacb2bc793f6 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-770f6c67-f123-41de-8be2-afc043a796cc 1073741824" returned: 0 in 0.673s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-273188d7-936b-49db-bbf5-aacb2bc793f6 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-770f6c67-f123-41de-8be2-afc043a796cc {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:37 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:37 devstack sudo[102934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-770f6c67-f123-41de-8be2-afc043a796cc Sep 10 16:51:37 devstack sudo[102934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79ebb7ec-b910-4a6d-a681-10082c4747d0__2cepyk5devstack@QuobyteHD" returned: 0 in 0.472s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79ebb7ec-b910-4a6d-a681-10082c4747d0__2cepyk5devstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:37 devstack sudo[102936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79ebb7ec-b910-4a6d-a681-10082c4747d0__2cepyk5devstack@QuobyteHD Sep 10 16:51:37 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:38 devstack sudo[102934]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-273188d7-936b-49db-bbf5-aacb2bc793f6 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-770f6c67-f123-41de-8be2-afc043a796cc" returned: 0 in 0.355s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:38 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-273188d7-936b-49db-bbf5-aacb2bc793f6 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:51:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-273188d7-936b-49db-bbf5-aacb2bc793f6 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:51:38 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-273188d7-936b-49db-bbf5-aacb2bc793f6 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f993611-875d-4e7c-aed5-b7bc5152c626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-770f6c67-f123-41de-8be2-afc043a796cc', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:38 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-273188d7-936b-49db-bbf5-aacb2bc793f6 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628ae536-6b5a-44bc-96b5-87e6a8e13c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:38 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-273188d7-936b-49db-bbf5-aacb2bc793f6 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Volume volume-770f6c67-f123-41de-8be2-afc043a796cc (770f6c67-f123-41de-8be2-afc043a796cc): created successfully Sep 10 16:51:38 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-273188d7-936b-49db-bbf5-aacb2bc793f6 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628ae536-6b5a-44bc-96b5-87e6a8e13c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:38 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-273188d7-936b-49db-bbf5-aacb2bc793f6 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Flow 'volume_create_manager' (2bfafd25-b344-4b22-843b-c89098a2949d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:51:38 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-273188d7-936b-49db-bbf5-aacb2bc793f6 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Created volume successfully. Sep 10 16:51:38 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79ebb7ec-b910-4a6d-a681-10082c4747d0__2cepyk5devstack@QuobyteHD" returned: 1 in 0.423s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79ebb7ec-b910-4a6d-a681-10082c4747d0__2cepyk5devstack@QuobyteHD' failed. Not Retrying. {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 16:51:38 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] 79ebb7ec-b910-4a6d-a681-10082c4747d0 was raw, converting to qcow2 {{(pid=88189) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 16:51:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_79ebb7ec-b910-4a6d-a681-10082c4747d0__2cepyk5devstack@QuobyteHD /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fd864705-516e-4052-b160-6432e1ab52e5 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:38 devstack sudo[102942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_79ebb7ec-b910-4a6d-a681-10082c4747d0__2cepyk5devstack@QuobyteHD /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fd864705-516e-4052-b160-6432e1ab52e5 Sep 10 16:51:38 devstack sudo[102942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:39 devstack sudo[102942]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_79ebb7ec-b910-4a6d-a681-10082c4747d0__2cepyk5devstack@QuobyteHD /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fd864705-516e-4052-b160-6432e1ab52e5" returned: 0 in 0.751s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:39 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_79ebb7ec-b910-4a6d-a681-10082c4747d0__2cepyk5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fd864705-516e-4052-b160-6432e1ab52e5 {{(pid=88189) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 16:51:39 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Converted 0.00 MB image at 0.00 MB/s Sep 10 16:51:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fd864705-516e-4052-b160-6432e1ab52e5 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:39 devstack sudo[102952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fd864705-516e-4052-b160-6432e1ab52e5 1G Sep 10 16:51:39 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:39 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fd864705-516e-4052-b160-6432e1ab52e5 1G" returned: 0 in 0.738s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:39 devstack cinder-volume[88189]: DEBUG cinder.volume.volume_utils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Downloaded image 79ebb7ec-b910-4a6d-a681-10082c4747d0 ((None, [{'url': 'file:///opt/stack/data/glance/images/79ebb7ec-b910-4a6d-a681-10082c4747d0', 'metadata': {}}])) to volume fd864705-516e-4052-b160-6432e1ab52e5 successfully. {{(pid=88189) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 16:51:39 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Temporary image 79ebb7ec-b910-4a6d-a681-10082c4747d0 for user 28a30da9ce5740bebef7e9cd5d349e6b is deleted. {{(pid=88189) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 16:51:39 devstack cinder-volume[88189]: DEBUG cinder.volume.volume_utils [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Marking volume fd864705-516e-4052-b160-6432e1ab52e5 as bootable. {{(pid=88189) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 16:51:39 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Copying metadata from image 79ebb7ec-b910-4a6d-a681-10082c4747d0 to fd864705-516e-4052-b160-6432e1ab52e5. {{(pid=88189) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 16:51:39 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Creating volume glance metadata for volume fd864705-516e-4052-b160-6432e1ab52e5 backed by image 79ebb7ec-b910-4a6d-a681-10082c4747d0 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '79ebb7ec-b910-4a6d-a681-10082c4747d0', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd1d2c221f0b99d0b28244a5081fd9764', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88189) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 16:51:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5261af0b-1aa8-46d1-9cfd-3e8e7b2cce65 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:51:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5261af0b-1aa8-46d1-9cfd-3e8e7b2cce65 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:51:39 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-5261af0b-1aa8-46d1-9cfd-3e8e7b2cce65 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:51:39 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-5261af0b-1aa8-46d1-9cfd-3e8e7b2cce65 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:51:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5261af0b-1aa8-46d1-9cfd-3e8e7b2cce65 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:51:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5261af0b-1aa8-46d1-9cfd-3e8e7b2cce65 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:39 devstack sudo[102976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:51:39 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f864d3c-e225-4034-857f-3241224ed762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd864705-516e-4052-b160-6432e1ab52e5', 'volume_size': 1, 'image_id': '79ebb7ec-b910-4a6d-a681-10082c4747d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79ebb7ec-b910-4a6d-a681-10082c4747d0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd1d2c221f0b99d0b28244a5081fd9764', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b433f46c49c54ffb868db260d68aaaa7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '96c1fa22d3ac095ff7d7cc0eada187772a2a04aa2b5c1751ec211c4da0725451ddbe3c536f9cbafc70f98b3c822ac089403ba1b71f0c583f9f01e94c548ae3a1', 'id': '79ebb7ec-b910-4a6d-a681-10082c4747d0', 'created_at': datetime.datetime(2026, 9, 10, 14, 51, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 14, 51, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79ebb7ec-b910-4a6d-a681-10082c4747d0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddaaae3a-d6e7-48fe-a47a-958f5b623390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:39 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Volume volume-fd864705-516e-4052-b160-6432e1ab52e5 (fd864705-516e-4052-b160-6432e1ab52e5): created successfully Sep 10 16:51:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddaaae3a-d6e7-48fe-a47a-958f5b623390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Flow 'volume_create_manager' (1104685d-6f33-4732-b727-13d4121157c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:51:39 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-56d68440-32aa-4944-9d5a-bb213aa8ac59 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Created volume successfully. Sep 10 16:51:40 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5261af0b-1aa8-46d1-9cfd-3e8e7b2cce65 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.372s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:40 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-5261af0b-1aa8-46d1-9cfd-3e8e7b2cce65 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:51:40 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-5261af0b-1aa8-46d1-9cfd-3e8e7b2cce65 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Retype volume completed successfully. Sep 10 16:51:40 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9289a8ac-a855-4c41-bd67-02c8ff78e3d7 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Acquiring lock "cinder-fd864705-516e-4052-b160-6432e1ab52e5-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:51:40 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9289a8ac-a855-4c41-bd67-02c8ff78e3d7 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Lock "cinder-fd864705-516e-4052-b160-6432e1ab52e5-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:51:40 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9289a8ac-a855-4c41-bd67-02c8ff78e3d7 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Acquiring lock "cinder-quobyte-fd864705-516e-4052-b160-6432e1ab52e5" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:51:40 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9289a8ac-a855-4c41-bd67-02c8ff78e3d7 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Lock "cinder-quobyte-fd864705-516e-4052-b160-6432e1ab52e5" acquired by "delete_volume" :: waited 0.021s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:51:40 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[488caaa2-a509-4fba-a6d1-e3694ae615fc]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:51:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9289a8ac-a855-4c41-bd67-02c8ff78e3d7 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fd864705-516e-4052-b160-6432e1ab52e5 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:40 devstack sudo[102984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fd864705-516e-4052-b160-6432e1ab52e5 Sep 10 16:51:40 devstack sudo[102984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:40 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-f49fff3e-5871-436f-a79f-4becfdccc97f req-3f915e59-378c-4aeb-ab39-5e103ba05149 tempest-TestInstancesWithCinderVolumes-1558773528 None] Terminate volume connection completed successfully. Sep 10 16:51:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-f49fff3e-5871-436f-a79f-4becfdccc97f req-3f915e59-378c-4aeb-ab39-5e103ba05149 tempest-TestInstancesWithCinderVolumes-1558773528 None] Deleting attachment 34377c43-93ea-41ab-bbee-914143f3bec7. {{(pid=88189) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 16:51:41 devstack sudo[102984]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9289a8ac-a855-4c41-bd67-02c8ff78e3d7 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fd864705-516e-4052-b160-6432e1ab52e5" returned: 0 in 0.515s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9289a8ac-a855-4c41-bd67-02c8ff78e3d7 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fd864705-516e-4052-b160-6432e1ab52e5 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:41 devstack sudo[102992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fd864705-516e-4052-b160-6432e1ab52e5 Sep 10 16:51:41 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:41 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2fff6a0b-77d2-4be1-8694-6fba2765f771 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Acquiring lock "cinder-770f6c67-f123-41de-8be2-afc043a796cc-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:51:41 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2fff6a0b-77d2-4be1-8694-6fba2765f771 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Lock "cinder-770f6c67-f123-41de-8be2-afc043a796cc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:51:41 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2fff6a0b-77d2-4be1-8694-6fba2765f771 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Acquiring lock "cinder-quobyte-770f6c67-f123-41de-8be2-afc043a796cc" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:51:41 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2fff6a0b-77d2-4be1-8694-6fba2765f771 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Lock "cinder-quobyte-770f6c67-f123-41de-8be2-afc043a796cc" acquired by "delete_volume" :: waited 0.016s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:51:41 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fdd969-c153-4df7-9ebb-aebc97f13d7a]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:51:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2fff6a0b-77d2-4be1-8694-6fba2765f771 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-770f6c67-f123-41de-8be2-afc043a796cc {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-2798485a-897b-42e7-aefb-781e61fb63c8 req-15fe4515-c15f-4cad-8c22-3618522f6fa0 tempest-TestServerVolumeAttachmentScenario-984045012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:51:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-2798485a-897b-42e7-aefb-781e61fb63c8 req-15fe4515-c15f-4cad-8c22-3618522f6fa0 tempest-TestServerVolumeAttachmentScenario-984045012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:51:41 devstack sudo[103000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-770f6c67-f123-41de-8be2-afc043a796cc Sep 10 16:51:41 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:41 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9289a8ac-a855-4c41-bd67-02c8ff78e3d7 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-fd864705-516e-4052-b160-6432e1ab52e5" returned: 0 in 0.362s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-2798485a-897b-42e7-aefb-781e61fb63c8 req-15fe4515-c15f-4cad-8c22-3618522f6fa0 tempest-TestServerVolumeAttachmentScenario-984045012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:51:41 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9289a8ac-a855-4c41-bd67-02c8ff78e3d7 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Lock "cinder-quobyte-fd864705-516e-4052-b160-6432e1ab52e5" released by "delete_volume" :: held 0.944s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:51:41 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-2798485a-897b-42e7-aefb-781e61fb63c8 req-15fe4515-c15f-4cad-8c22-3618522f6fa0 tempest-TestServerVolumeAttachmentScenario-984045012 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8', 'name': 'volume-b1c2b441-fbd1-4be4-b682-a4a36debc3b2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8b23fbd0-c0d7-4dc7-8774-26f735c155ec', 'enforce_multipath': True} {{(pid=88189) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 16:51:41 devstack cinder-volume[88189]: WARNING cinder.quota [None req-9289a8ac-a855-4c41-bd67-02c8ff78e3d7 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 10 16:51:41 devstack cinder-volume[88189]: WARNING cinder.quota [None req-9289a8ac-a855-4c41-bd67-02c8ff78e3d7 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 10 16:51:41 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-9289a8ac-a855-4c41-bd67-02c8ff78e3d7 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Created reservations ['c0ed0939-9705-4739-bda0-df1b2713e8fe', '97de866a-0081-43b5-b968-4d6c7ac32e9a', '8d38eaf0-49cb-46d4-a7da-f1b30da62e5c', '4d7f8937-2f60-42c3-b3a6-9d399efb31c8'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:51:41 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-2798485a-897b-42e7-aefb-781e61fb63c8 req-15fe4515-c15f-4cad-8c22-3618522f6fa0 tempest-TestServerVolumeAttachmentScenario-984045012 None] attachment_update completed successfully. Sep 10 16:51:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9289a8ac-a855-4c41-bd67-02c8ff78e3d7 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:51:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9289a8ac-a855-4c41-bd67-02c8ff78e3d7 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:51:41 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9289a8ac-a855-4c41-bd67-02c8ff78e3d7 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:51:41 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9289a8ac-a855-4c41-bd67-02c8ff78e3d7 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:51:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9289a8ac-a855-4c41-bd67-02c8ff78e3d7 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:51:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9289a8ac-a855-4c41-bd67-02c8ff78e3d7 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:41 devstack sudo[103005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:51:41 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:41 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2fff6a0b-77d2-4be1-8694-6fba2765f771 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-770f6c67-f123-41de-8be2-afc043a796cc" returned: 0 in 0.549s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2fff6a0b-77d2-4be1-8694-6fba2765f771 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-770f6c67-f123-41de-8be2-afc043a796cc {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:41 devstack sudo[103011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-770f6c67-f123-41de-8be2-afc043a796cc Sep 10 16:51:41 devstack sudo[103011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:42 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9289a8ac-a855-4c41-bd67-02c8ff78e3d7 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.352s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:42 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-9289a8ac-a855-4c41-bd67-02c8ff78e3d7 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:51:42 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-9289a8ac-a855-4c41-bd67-02c8ff78e3d7 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Deleted volume successfully. Sep 10 16:51:42 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9289a8ac-a855-4c41-bd67-02c8ff78e3d7 tempest-VolumeAndVolumeTypeFromImageTest-1982442628 None] Lock "cinder-fd864705-516e-4052-b160-6432e1ab52e5-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:51:42 devstack sudo[103011]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2fff6a0b-77d2-4be1-8694-6fba2765f771 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-770f6c67-f123-41de-8be2-afc043a796cc" returned: 0 in 0.328s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:42 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2fff6a0b-77d2-4be1-8694-6fba2765f771 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Lock "cinder-quobyte-770f6c67-f123-41de-8be2-afc043a796cc" released by "delete_volume" :: held 0.921s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:51:42 devstack cinder-volume[88189]: WARNING cinder.quota [None req-2fff6a0b-77d2-4be1-8694-6fba2765f771 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 10 16:51:42 devstack cinder-volume[88189]: WARNING cinder.quota [None req-2fff6a0b-77d2-4be1-8694-6fba2765f771 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 10 16:51:42 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-2fff6a0b-77d2-4be1-8694-6fba2765f771 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Created reservations ['d17db51a-f94d-4174-8e0b-e5623f6825d2', '9d794e41-26ac-4cb5-9cf1-56c9e71788de', 'c3723717-ea42-4e7d-9a77-c104580c1e37', 'e10e3151-6be4-4448-92a4-1588da865a0d'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:51:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2fff6a0b-77d2-4be1-8694-6fba2765f771 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:51:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2fff6a0b-77d2-4be1-8694-6fba2765f771 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:51:42 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-2fff6a0b-77d2-4be1-8694-6fba2765f771 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:51:42 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-2fff6a0b-77d2-4be1-8694-6fba2765f771 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:51:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2fff6a0b-77d2-4be1-8694-6fba2765f771 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:51:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2fff6a0b-77d2-4be1-8694-6fba2765f771 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:42 devstack sudo[103015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:51:42 devstack sudo[103015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:42 devstack sudo[103015]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2fff6a0b-77d2-4be1-8694-6fba2765f771 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.253s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:42 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-2fff6a0b-77d2-4be1-8694-6fba2765f771 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:51:42 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-2fff6a0b-77d2-4be1-8694-6fba2765f771 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Deleted volume successfully. Sep 10 16:51:42 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2fff6a0b-77d2-4be1-8694-6fba2765f771 tempest-VolumeRetypeWithoutMigrationTest-1660367035 None] Lock "cinder-770f6c67-f123-41de-8be2-afc043a796cc-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:51:42 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4679e18f-54aa-4ee2-afb0-1a76017548f9 tempest-TestInstancesWithCinderVolumes-1558773528 None] Acquiring lock "cinder-1e2be01b-2320-4f68-a1f2-6e59b735d10c-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:51:42 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4679e18f-54aa-4ee2-afb0-1a76017548f9 tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "cinder-1e2be01b-2320-4f68-a1f2-6e59b735d10c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:51:42 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4679e18f-54aa-4ee2-afb0-1a76017548f9 tempest-TestInstancesWithCinderVolumes-1558773528 None] Acquiring lock "cinder-quobyte-1e2be01b-2320-4f68-a1f2-6e59b735d10c" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:51:42 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4679e18f-54aa-4ee2-afb0-1a76017548f9 tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "cinder-quobyte-1e2be01b-2320-4f68-a1f2-6e59b735d10c" acquired by "delete_volume" :: waited 0.022s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:51:42 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd4de06-28f7-4ecf-8106-261e76d87f4d]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:51:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4679e18f-54aa-4ee2-afb0-1a76017548f9 tempest-TestInstancesWithCinderVolumes-1558773528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1e2be01b-2320-4f68-a1f2-6e59b735d10c {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:43 devstack sudo[103018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1e2be01b-2320-4f68-a1f2-6e59b735d10c Sep 10 16:51:43 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:43 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4679e18f-54aa-4ee2-afb0-1a76017548f9 tempest-TestInstancesWithCinderVolumes-1558773528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1e2be01b-2320-4f68-a1f2-6e59b735d10c" returned: 0 in 0.491s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4679e18f-54aa-4ee2-afb0-1a76017548f9 tempest-TestInstancesWithCinderVolumes-1558773528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1e2be01b-2320-4f68-a1f2-6e59b735d10c {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:43 devstack sudo[103023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1e2be01b-2320-4f68-a1f2-6e59b735d10c Sep 10 16:51:43 devstack sudo[103023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:43 devstack sudo[103023]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4679e18f-54aa-4ee2-afb0-1a76017548f9 tempest-TestInstancesWithCinderVolumes-1558773528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1e2be01b-2320-4f68-a1f2-6e59b735d10c" returned: 0 in 0.365s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:43 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4679e18f-54aa-4ee2-afb0-1a76017548f9 tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "cinder-quobyte-1e2be01b-2320-4f68-a1f2-6e59b735d10c" released by "delete_volume" :: held 0.911s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:51:43 devstack cinder-volume[88189]: WARNING cinder.quota [None req-4679e18f-54aa-4ee2-afb0-1a76017548f9 tempest-TestInstancesWithCinderVolumes-1558773528 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1325685210-1481524629 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1325685210-1481524629, it is now deprecated. Please use the default quota class for default quota. Sep 10 16:51:43 devstack cinder-volume[88189]: WARNING cinder.quota [None req-4679e18f-54aa-4ee2-afb0-1a76017548f9 tempest-TestInstancesWithCinderVolumes-1558773528 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1325685210-1481524629 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1325685210-1481524629, it is now deprecated. Please use the default quota class for default quota. Sep 10 16:51:43 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-4679e18f-54aa-4ee2-afb0-1a76017548f9 tempest-TestInstancesWithCinderVolumes-1558773528 None] Created reservations ['dfe61ccf-959e-46dd-a1ac-0f1586768fc9', 'abce5b9d-12de-4b04-a3f8-54c51b404f70', '08153219-1109-4e89-9cb7-b2246b8bafb4', '17b50d0d-69e9-49f9-a7e3-c3027bbf69ef'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:51:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4679e18f-54aa-4ee2-afb0-1a76017548f9 tempest-TestInstancesWithCinderVolumes-1558773528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:51:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4679e18f-54aa-4ee2-afb0-1a76017548f9 tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:51:43 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-4679e18f-54aa-4ee2-afb0-1a76017548f9 tempest-TestInstancesWithCinderVolumes-1558773528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:51:43 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-4679e18f-54aa-4ee2-afb0-1a76017548f9 tempest-TestInstancesWithCinderVolumes-1558773528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:51:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4679e18f-54aa-4ee2-afb0-1a76017548f9 tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:51:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4679e18f-54aa-4ee2-afb0-1a76017548f9 tempest-TestInstancesWithCinderVolumes-1558773528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:44 devstack sudo[103026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:51:44 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:44 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-c25c0ac8-efa2-46dc-a5f4-66e5033fb92a req-fb461cc6-a2d3-40f7-a57a-ce767b54fcea tempest-TestServerVolumeAttachmentScenario-984045012 None] Terminate volume connection completed successfully. Sep 10 16:51:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-c25c0ac8-efa2-46dc-a5f4-66e5033fb92a req-fb461cc6-a2d3-40f7-a57a-ce767b54fcea tempest-TestServerVolumeAttachmentScenario-984045012 None] Deleting attachment 8b23fbd0-c0d7-4dc7-8774-26f735c155ec. {{(pid=88189) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 16:51:44 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4679e18f-54aa-4ee2-afb0-1a76017548f9 tempest-TestInstancesWithCinderVolumes-1558773528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.378s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:44 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-4679e18f-54aa-4ee2-afb0-1a76017548f9 tempest-TestInstancesWithCinderVolumes-1558773528 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:51:44 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-4679e18f-54aa-4ee2-afb0-1a76017548f9 tempest-TestInstancesWithCinderVolumes-1558773528 None] Deleted volume successfully. Sep 10 16:51:44 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4679e18f-54aa-4ee2-afb0-1a76017548f9 tempest-TestInstancesWithCinderVolumes-1558773528 None] Lock "cinder-1e2be01b-2320-4f68-a1f2-6e59b735d10c-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:51:45 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-bda0a510-dbe8-47c1-b857-1b62a35991c3 req-5da1aad9-c9f2-41af-91a6-7a59ae9b37ff tempest-TestServerVolumeAttachmentScenario-984045012 None] Terminate volume connection completed successfully. Sep 10 16:51:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-bda0a510-dbe8-47c1-b857-1b62a35991c3 req-5da1aad9-c9f2-41af-91a6-7a59ae9b37ff tempest-TestServerVolumeAttachmentScenario-984045012 None] Deleting attachment 6a038770-6500-4187-a562-1573e0ecfebf. {{(pid=88189) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 16:51:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:51:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:51:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:51:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:51:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:51:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:51:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:49 devstack sudo[103060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:51:49 devstack sudo[103060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:49 devstack sudo[103060]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.427s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:49 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:51:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager._thread_info {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:51:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread count: 28 {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 16:51:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread info: [<_MainThread(MainThread, started 125792070905984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 16:51:50 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:UPDATE=102,cinder:SELECT=112,cinder:INSERT=25,cinder:DELETE=9 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:51:50 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=99,cinder:UPDATE=110,cinder:DELETE=7,cinder:INSERT=28 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:51:50 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:51:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Flow 'volume_create_manager' (f4da59b7-ab6c-4357-8fcb-537fde728d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:51:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa4b677-b181-410b-b3db-b5dcc0cbaffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa4b677-b181-410b-b3db-b5dcc0cbaffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1197479436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8acd3c00-4fe8-43bc-bdb1-f1f74b05771b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16eb79d022dd4324861d6826f712f0db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:51:51Z,use_quota=True,user_id='aba0355585b848afbc37f47a00a12ed8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (085f2312-3c12-48c1-b1dc-301466ae675b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (085f2312-3c12-48c1-b1dc-301466ae675b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1560cd8-6ba4-4579-aa3c-d8b8c5e5b9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:50 devstack cinder-volume[88189]: DEBUG cinder.image.glance [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Creating Keystone auth plugin from conf {{(pid=88189) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 16:51:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1560cd8-6ba4-4579-aa3c-d8b8c5e5b9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8acd3c00-4fe8-43bc-bdb1-f1f74b05771b', 'volume_name': 'volume-8acd3c00-4fe8-43bc-bdb1-f1f74b05771b', 'volume_size': 1, 'image_id': '5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dbb77788940a4d64b2cf7dbf5431f2a1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'created_at': datetime.datetime(2026, 9, 10, 14, 32, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 14, 32, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c613bee9-6701-4b66-a23b-bb5b78a6412b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c613bee9-6701-4b66-a23b-bb5b78a6412b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cef9b4af-0228-46cf-b0a5-b0065643895f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:51 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Volume 8acd3c00-4fe8-43bc-bdb1-f1f74b05771b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8acd3c00-4fe8-43bc-bdb1-f1f74b05771b', 'volume_size': 1, 'image_id': '5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dbb77788940a4d64b2cf7dbf5431f2a1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'created_at': datetime.datetime(2026, 9, 10, 14, 32, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 14, 32, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 16:51:51 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Trying to clone 8acd3c00-4fe8-43bc-bdb1-f1f74b05771b from image 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'metadata': {}}]). {{(pid=88189) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 16:51:51 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_6z944tjrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88189) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 16:51:51 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Image download 20.69 MB at 20.69 MB/s Sep 10 16:51:51 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74304e8-956f-4189-a3ac-d56f1842ce8f]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:51:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_6z944tjrdevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:51 devstack sudo[103066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_6z944tjrdevstack@QuobyteHD Sep 10 16:51:51 devstack sudo[103066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:52 devstack sudo[103066]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_6z944tjrdevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:52 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Temporary image 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 is fetched for user aba0355585b848afbc37f47a00a12ed8. {{(pid=88189) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 16:51:52 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff779b04-51a7-4111-8a44-6f3aea6e00cc]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:51:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_6z944tjrdevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:52 devstack sudo[103071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_6z944tjrdevstack@QuobyteHD Sep 10 16:51:52 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:52 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_6z944tjrdevstack@QuobyteHD" returned: 0 in 0.380s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:51:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:51:52 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1197479436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8acd3c00-4fe8-43bc-bdb1-f1f74b05771b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16eb79d022dd4324861d6826f712f0db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:51:51Z,use_quota=True,user_id='aba0355585b848afbc37f47a00a12ed8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:51:52 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Creating volume 8acd3c00-4fe8-43bc-bdb1-f1f74b05771b {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:51:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:51:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:51:52 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:51:52 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:51:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:51:52 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:51:52 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:51:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8acd3c00-4fe8-43bc-bdb1-f1f74b05771b 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:52 devstack sudo[103076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8acd3c00-4fe8-43bc-bdb1-f1f74b05771b 1073741824 Sep 10 16:51:52 devstack sudo[103076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:53 devstack sudo[103076]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8acd3c00-4fe8-43bc-bdb1-f1f74b05771b 1073741824" returned: 0 in 0.512s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8acd3c00-4fe8-43bc-bdb1-f1f74b05771b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:53 devstack sudo[103083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8acd3c00-4fe8-43bc-bdb1-f1f74b05771b Sep 10 16:51:53 devstack sudo[103083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:53 devstack sudo[103083]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8acd3c00-4fe8-43bc-bdb1-f1f74b05771b" returned: 0 in 0.296s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:53 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:51:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:51:53 devstack cinder-volume[88189]: DEBUG cinder.volume.volume_utils [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Attempting download of 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'metadata': {}}])) to volume 8acd3c00-4fe8-43bc-bdb1-f1f74b05771b. {{(pid=88189) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 16:51:53 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[836b0ca2-fa09-4462-8bc4-ad5d2c27365d]: (4, 'raw') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:51:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_8o3zo3_x {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:53 devstack sudo[103086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_8o3zo3_x Sep 10 16:51:53 devstack sudo[103086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:53 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-72783934-6bc3-40fa-912b-367a0ce4f1e0 tempest-TestServerVolumeAttachmentScenario-984045012 None] Acquiring lock "cinder-b1c2b441-fbd1-4be4-b682-a4a36debc3b2-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:51:53 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-72783934-6bc3-40fa-912b-367a0ce4f1e0 tempest-TestServerVolumeAttachmentScenario-984045012 None] Lock "cinder-b1c2b441-fbd1-4be4-b682-a4a36debc3b2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:51:53 devstack sudo[103086]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:53 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-72783934-6bc3-40fa-912b-367a0ce4f1e0 tempest-TestServerVolumeAttachmentScenario-984045012 None] Acquiring lock "cinder-quobyte-b1c2b441-fbd1-4be4-b682-a4a36debc3b2" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:51:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_8o3zo3_x" returned: 0 in 0.380s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_8o3zo3_x {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:53 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-72783934-6bc3-40fa-912b-367a0ce4f1e0 tempest-TestServerVolumeAttachmentScenario-984045012 None] Lock "cinder-quobyte-b1c2b441-fbd1-4be4-b682-a4a36debc3b2" acquired by "delete_volume" :: waited 0.030s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:51:53 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a6b371-3d3a-431a-8ea5-89a3bd9fe6e5]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:51:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-72783934-6bc3-40fa-912b-367a0ce4f1e0 tempest-TestServerVolumeAttachmentScenario-984045012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b1c2b441-fbd1-4be4-b682-a4a36debc3b2 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:54 devstack sudo[103090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_8o3zo3_x Sep 10 16:51:54 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:54 devstack sudo[103091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b1c2b441-fbd1-4be4-b682-a4a36debc3b2 Sep 10 16:51:54 devstack sudo[103091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:54 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_8o3zo3_x" returned: 1 in 0.395s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_8o3zo3_x' failed. Not Retrying. {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 16:51:54 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a4a88a-7336-475d-9ceb-fa59dea0b1a8]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:51:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_6z944tjrdevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:54 devstack sudo[103096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_6z944tjrdevstack@QuobyteHD Sep 10 16:51:54 devstack sudo[103096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:54 devstack sudo[103091]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-72783934-6bc3-40fa-912b-367a0ce4f1e0 tempest-TestServerVolumeAttachmentScenario-984045012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b1c2b441-fbd1-4be4-b682-a4a36debc3b2" returned: 0 in 0.533s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-72783934-6bc3-40fa-912b-367a0ce4f1e0 tempest-TestServerVolumeAttachmentScenario-984045012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b1c2b441-fbd1-4be4-b682-a4a36debc3b2 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:54 devstack sudo[103101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b1c2b441-fbd1-4be4-b682-a4a36debc3b2 Sep 10 16:51:54 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:54 devstack sudo[103096]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_6z944tjrdevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:54 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 was qcow2, converting to qcow2 {{(pid=88189) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 16:51:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_6z944tjrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8acd3c00-4fe8-43bc-bdb1-f1f74b05771b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:54 devstack sudo[103106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_6z944tjrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8acd3c00-4fe8-43bc-bdb1-f1f74b05771b Sep 10 16:51:54 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:54 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-72783934-6bc3-40fa-912b-367a0ce4f1e0 tempest-TestServerVolumeAttachmentScenario-984045012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b1c2b441-fbd1-4be4-b682-a4a36debc3b2" returned: 0 in 0.293s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:54 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-72783934-6bc3-40fa-912b-367a0ce4f1e0 tempest-TestServerVolumeAttachmentScenario-984045012 None] Lock "cinder-quobyte-b1c2b441-fbd1-4be4-b682-a4a36debc3b2" released by "delete_volume" :: held 0.890s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:51:54 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-72783934-6bc3-40fa-912b-367a0ce4f1e0 tempest-TestServerVolumeAttachmentScenario-984045012 None] Created reservations ['42bea4cf-97e3-4fd2-adaa-cd0eb9ed5bf4', 'ea05b7cb-ea45-4695-8712-0942b18c36d6', '1681c458-97cc-45d7-a13e-34564cce9691', '9a2830a9-3c79-45ea-a65a-70a2ae290147'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:51:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-72783934-6bc3-40fa-912b-367a0ce4f1e0 tempest-TestServerVolumeAttachmentScenario-984045012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:51:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-72783934-6bc3-40fa-912b-367a0ce4f1e0 tempest-TestServerVolumeAttachmentScenario-984045012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:51:55 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-72783934-6bc3-40fa-912b-367a0ce4f1e0 tempest-TestServerVolumeAttachmentScenario-984045012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:51:55 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-72783934-6bc3-40fa-912b-367a0ce4f1e0 tempest-TestServerVolumeAttachmentScenario-984045012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:51:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-72783934-6bc3-40fa-912b-367a0ce4f1e0 tempest-TestServerVolumeAttachmentScenario-984045012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:51:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-72783934-6bc3-40fa-912b-367a0ce4f1e0 tempest-TestServerVolumeAttachmentScenario-984045012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:55 devstack sudo[103110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:51:55 devstack sudo[103110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:55 devstack sudo[103110]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-72783934-6bc3-40fa-912b-367a0ce4f1e0 tempest-TestServerVolumeAttachmentScenario-984045012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.307s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:55 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-72783934-6bc3-40fa-912b-367a0ce4f1e0 tempest-TestServerVolumeAttachmentScenario-984045012 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:51:55 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-72783934-6bc3-40fa-912b-367a0ce4f1e0 tempest-TestServerVolumeAttachmentScenario-984045012 None] Deleted volume successfully. Sep 10 16:51:55 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-72783934-6bc3-40fa-912b-367a0ce4f1e0 tempest-TestServerVolumeAttachmentScenario-984045012 None] Lock "cinder-b1c2b441-fbd1-4be4-b682-a4a36debc3b2-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:51:56 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c88e5866-0a77-4c9a-9842-2ad4dcf92fbf tempest-TestServerVolumeAttachmentScenario-984045012 None] Acquiring lock "cinder-9d2bed22-8cc6-449e-8238-76f07499ecc9-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:51:56 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c88e5866-0a77-4c9a-9842-2ad4dcf92fbf tempest-TestServerVolumeAttachmentScenario-984045012 None] Lock "cinder-9d2bed22-8cc6-449e-8238-76f07499ecc9-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:51:56 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c88e5866-0a77-4c9a-9842-2ad4dcf92fbf tempest-TestServerVolumeAttachmentScenario-984045012 None] Acquiring lock "cinder-quobyte-9d2bed22-8cc6-449e-8238-76f07499ecc9" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:51:56 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c88e5866-0a77-4c9a-9842-2ad4dcf92fbf tempest-TestServerVolumeAttachmentScenario-984045012 None] Lock "cinder-quobyte-9d2bed22-8cc6-449e-8238-76f07499ecc9" acquired by "delete_volume" :: waited 0.020s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:51:56 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[728f3701-6bfe-4c6f-8643-c558a873cbf5]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:51:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c88e5866-0a77-4c9a-9842-2ad4dcf92fbf tempest-TestServerVolumeAttachmentScenario-984045012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9d2bed22-8cc6-449e-8238-76f07499ecc9 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:56 devstack sudo[103122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9d2bed22-8cc6-449e-8238-76f07499ecc9 Sep 10 16:51:56 devstack sudo[103122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:57 devstack sudo[103122]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c88e5866-0a77-4c9a-9842-2ad4dcf92fbf tempest-TestServerVolumeAttachmentScenario-984045012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9d2bed22-8cc6-449e-8238-76f07499ecc9" returned: 0 in 0.617s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c88e5866-0a77-4c9a-9842-2ad4dcf92fbf tempest-TestServerVolumeAttachmentScenario-984045012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9d2bed22-8cc6-449e-8238-76f07499ecc9 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:57 devstack sudo[103128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9d2bed22-8cc6-449e-8238-76f07499ecc9 Sep 10 16:51:57 devstack sudo[103128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:57 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_6z944tjrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8acd3c00-4fe8-43bc-bdb1-f1f74b05771b" returned: 0 in 2.493s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:57 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_6z944tjrdevstack@QuobyteHD, size 112.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8acd3c00-4fe8-43bc-bdb1-f1f74b05771b {{(pid=88189) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 16:51:57 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Converted 112.00 MB image at 44.89 MB/s Sep 10 16:51:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8acd3c00-4fe8-43bc-bdb1-f1f74b05771b 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:57 devstack sudo[103130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8acd3c00-4fe8-43bc-bdb1-f1f74b05771b 1G Sep 10 16:51:57 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:57 devstack sudo[103128]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c88e5866-0a77-4c9a-9842-2ad4dcf92fbf tempest-TestServerVolumeAttachmentScenario-984045012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9d2bed22-8cc6-449e-8238-76f07499ecc9" returned: 0 in 0.412s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:57 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c88e5866-0a77-4c9a-9842-2ad4dcf92fbf tempest-TestServerVolumeAttachmentScenario-984045012 None] Lock "cinder-quobyte-9d2bed22-8cc6-449e-8238-76f07499ecc9" released by "delete_volume" :: held 1.105s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:51:57 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-c88e5866-0a77-4c9a-9842-2ad4dcf92fbf tempest-TestServerVolumeAttachmentScenario-984045012 None] Created reservations ['27e87a32-f115-4a54-a842-bbe1261973d2', '878b7b3f-3f4f-4938-9ece-505177561327', 'f54aced6-313a-4fdf-ad39-c032d1ab23e6', '2e607dee-e117-45d3-89e3-b489e30116b1'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:51:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c88e5866-0a77-4c9a-9842-2ad4dcf92fbf tempest-TestServerVolumeAttachmentScenario-984045012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:51:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c88e5866-0a77-4c9a-9842-2ad4dcf92fbf tempest-TestServerVolumeAttachmentScenario-984045012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:51:57 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c88e5866-0a77-4c9a-9842-2ad4dcf92fbf tempest-TestServerVolumeAttachmentScenario-984045012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:51:57 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c88e5866-0a77-4c9a-9842-2ad4dcf92fbf tempest-TestServerVolumeAttachmentScenario-984045012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:51:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c88e5866-0a77-4c9a-9842-2ad4dcf92fbf tempest-TestServerVolumeAttachmentScenario-984045012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:51:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c88e5866-0a77-4c9a-9842-2ad4dcf92fbf tempest-TestServerVolumeAttachmentScenario-984045012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:57 devstack sudo[103137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:51:57 devstack sudo[103137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:57 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8acd3c00-4fe8-43bc-bdb1-f1f74b05771b 1G" returned: 0 in 0.622s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:57 devstack cinder-volume[88189]: DEBUG cinder.volume.volume_utils [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Downloaded image 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'metadata': {}}])) to volume 8acd3c00-4fe8-43bc-bdb1-f1f74b05771b successfully. {{(pid=88189) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 16:51:57 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Temporary image 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 for user aba0355585b848afbc37f47a00a12ed8 is deleted. {{(pid=88189) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 16:51:57 devstack cinder-volume[88189]: DEBUG cinder.volume.volume_utils [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Marking volume 8acd3c00-4fe8-43bc-bdb1-f1f74b05771b as bootable. {{(pid=88189) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 16:51:57 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Copying metadata from image 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 to 8acd3c00-4fe8-43bc-bdb1-f1f74b05771b. {{(pid=88189) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 16:51:57 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Creating volume glance metadata for volume 8acd3c00-4fe8-43bc-bdb1-f1f74b05771b backed by image 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88189) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 16:51:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cef9b4af-0228-46cf-b0a5-b0065643895f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8acd3c00-4fe8-43bc-bdb1-f1f74b05771b', 'volume_size': 1, 'image_id': '5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dbb77788940a4d64b2cf7dbf5431f2a1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'created_at': datetime.datetime(2026, 9, 10, 14, 32, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 14, 32, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b46f3e3-eb4e-4949-92b8-7ad623bee550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:51:58 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Volume volume-8acd3c00-4fe8-43bc-bdb1-f1f74b05771b (8acd3c00-4fe8-43bc-bdb1-f1f74b05771b): created successfully Sep 10 16:51:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b46f3e3-eb4e-4949-92b8-7ad623bee550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:51:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Flow 'volume_create_manager' (f4da59b7-ab6c-4357-8fcb-537fde728d97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:51:58 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-e5c69b3e-2a30-4047-ad1d-6de0c14e9a9b tempest-VolumesImageMetadata-1580706741 None] Created volume successfully. Sep 10 16:51:58 devstack sudo[103137]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c88e5866-0a77-4c9a-9842-2ad4dcf92fbf tempest-TestServerVolumeAttachmentScenario-984045012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.372s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:58 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-c88e5866-0a77-4c9a-9842-2ad4dcf92fbf tempest-TestServerVolumeAttachmentScenario-984045012 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:51:58 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-c88e5866-0a77-4c9a-9842-2ad4dcf92fbf tempest-TestServerVolumeAttachmentScenario-984045012 None] Deleted volume successfully. Sep 10 16:51:58 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c88e5866-0a77-4c9a-9842-2ad4dcf92fbf tempest-TestServerVolumeAttachmentScenario-984045012 None] Lock "cinder-9d2bed22-8cc6-449e-8238-76f07499ecc9-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:51:59 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8af15aae-2205-4f00-8f53-dc6902f0ddbf tempest-VolumesImageMetadata-1580706741 None] Acquiring lock "cinder-8acd3c00-4fe8-43bc-bdb1-f1f74b05771b-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:51:59 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8af15aae-2205-4f00-8f53-dc6902f0ddbf tempest-VolumesImageMetadata-1580706741 None] Lock "cinder-8acd3c00-4fe8-43bc-bdb1-f1f74b05771b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:51:59 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8af15aae-2205-4f00-8f53-dc6902f0ddbf tempest-VolumesImageMetadata-1580706741 None] Acquiring lock "cinder-quobyte-8acd3c00-4fe8-43bc-bdb1-f1f74b05771b" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:51:59 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8af15aae-2205-4f00-8f53-dc6902f0ddbf tempest-VolumesImageMetadata-1580706741 None] Lock "cinder-quobyte-8acd3c00-4fe8-43bc-bdb1-f1f74b05771b" acquired by "delete_volume" :: waited 0.019s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:51:59 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bb5557-121c-457f-8139-10614080034d]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:51:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8af15aae-2205-4f00-8f53-dc6902f0ddbf tempest-VolumesImageMetadata-1580706741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8acd3c00-4fe8-43bc-bdb1-f1f74b05771b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:59 devstack sudo[103142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8acd3c00-4fe8-43bc-bdb1-f1f74b05771b Sep 10 16:51:59 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:51:59 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root Sep 10 16:51:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8af15aae-2205-4f00-8f53-dc6902f0ddbf tempest-VolumesImageMetadata-1580706741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8acd3c00-4fe8-43bc-bdb1-f1f74b05771b" returned: 0 in 0.461s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:51:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8af15aae-2205-4f00-8f53-dc6902f0ddbf tempest-VolumesImageMetadata-1580706741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8acd3c00-4fe8-43bc-bdb1-f1f74b05771b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:51:59 devstack sudo[103147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8acd3c00-4fe8-43bc-bdb1-f1f74b05771b Sep 10 16:51:59 devstack sudo[103147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:00 devstack sudo[103147]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8af15aae-2205-4f00-8f53-dc6902f0ddbf tempest-VolumesImageMetadata-1580706741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8acd3c00-4fe8-43bc-bdb1-f1f74b05771b" returned: 0 in 0.302s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:00 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8af15aae-2205-4f00-8f53-dc6902f0ddbf tempest-VolumesImageMetadata-1580706741 None] Lock "cinder-quobyte-8acd3c00-4fe8-43bc-bdb1-f1f74b05771b" released by "delete_volume" :: held 0.812s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:52:00 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-8af15aae-2205-4f00-8f53-dc6902f0ddbf tempest-VolumesImageMetadata-1580706741 None] Created reservations ['88908e72-23c6-4925-b3d5-621ea69d0233', 'b890b3e1-85fc-4d47-b6fb-48bbf791ca19', 'd504aa5b-787b-4825-bd50-5db365f6c4cb', 'dca5a542-116e-4993-a98c-e162cdbaccdc'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:52:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8af15aae-2205-4f00-8f53-dc6902f0ddbf tempest-VolumesImageMetadata-1580706741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8af15aae-2205-4f00-8f53-dc6902f0ddbf tempest-VolumesImageMetadata-1580706741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:00 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8af15aae-2205-4f00-8f53-dc6902f0ddbf tempest-VolumesImageMetadata-1580706741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:52:00 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8af15aae-2205-4f00-8f53-dc6902f0ddbf tempest-VolumesImageMetadata-1580706741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:52:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8af15aae-2205-4f00-8f53-dc6902f0ddbf tempest-VolumesImageMetadata-1580706741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8af15aae-2205-4f00-8f53-dc6902f0ddbf tempest-VolumesImageMetadata-1580706741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:00 devstack sudo[103150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:52:00 devstack sudo[103150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:00 devstack sudo[103150]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8af15aae-2205-4f00-8f53-dc6902f0ddbf tempest-VolumesImageMetadata-1580706741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.332s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:00 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-8af15aae-2205-4f00-8f53-dc6902f0ddbf tempest-VolumesImageMetadata-1580706741 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:52:00 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-8af15aae-2205-4f00-8f53-dc6902f0ddbf tempest-VolumesImageMetadata-1580706741 None] Deleted volume successfully. Sep 10 16:52:00 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8af15aae-2205-4f00-8f53-dc6902f0ddbf tempest-VolumesImageMetadata-1580706741 None] Lock "cinder-8acd3c00-4fe8-43bc-bdb1-f1f74b05771b-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:52:06 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9d4a5a7-3509-4bb9-ab2d-cac86bac785b tempest-ProjectReaderTests-2085471397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:52:06 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a9d4a5a7-3509-4bb9-ab2d-cac86bac785b tempest-ProjectReaderTests-2085471397 None] Flow 'volume_create_manager' (37239106-63ad-4108-ac02-9ab80449158e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:52:06 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a9d4a5a7-3509-4bb9-ab2d-cac86bac785b tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05fc4985-e3bb-4d06-a976-8e8ad2f76225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:06 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a9d4a5a7-3509-4bb9-ab2d-cac86bac785b tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05fc4985-e3bb-4d06-a976-8e8ad2f76225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-964135355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdf302aa-b39c-427d-8afd-44223d339442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='585a38fa0bda4d9c8c012c1b84cb2259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:52:07Z,use_quota=True,user_id='c1919ff8ae2c408e985681d873412f0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:06 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a9d4a5a7-3509-4bb9-ab2d-cac86bac785b tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae40de98-04a8-4a4b-a484-47b125cf1ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:06 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a9d4a5a7-3509-4bb9-ab2d-cac86bac785b tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae40de98-04a8-4a4b-a484-47b125cf1ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:06 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a9d4a5a7-3509-4bb9-ab2d-cac86bac785b tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5137dbf-1849-443a-9fbf-10042254a394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:06 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a9d4a5a7-3509-4bb9-ab2d-cac86bac785b tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5137dbf-1849-443a-9fbf-10042254a394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdf302aa-b39c-427d-8afd-44223d339442', 'volume_name': 'volume-bdf302aa-b39c-427d-8afd-44223d339442', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:06 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a9d4a5a7-3509-4bb9-ab2d-cac86bac785b tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4d18a17-b32d-474b-9082-966cb9cb9e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:06 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a9d4a5a7-3509-4bb9-ab2d-cac86bac785b tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4d18a17-b32d-474b-9082-966cb9cb9e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:06 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a9d4a5a7-3509-4bb9-ab2d-cac86bac785b tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be413928-df9b-4bd6-8320-76cc3ec0e779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:06 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-a9d4a5a7-3509-4bb9-ab2d-cac86bac785b tempest-ProjectReaderTests-2085471397 None] Volume bdf302aa-b39c-427d-8afd-44223d339442: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdf302aa-b39c-427d-8afd-44223d339442', 'volume_size': 1} Sep 10 16:52:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a9d4a5a7-3509-4bb9-ab2d-cac86bac785b tempest-ProjectReaderTests-2085471397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a9d4a5a7-3509-4bb9-ab2d-cac86bac785b tempest-ProjectReaderTests-2085471397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:06 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-a9d4a5a7-3509-4bb9-ab2d-cac86bac785b tempest-ProjectReaderTests-2085471397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-964135355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdf302aa-b39c-427d-8afd-44223d339442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='585a38fa0bda4d9c8c012c1b84cb2259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:52:07Z,use_quota=True,user_id='c1919ff8ae2c408e985681d873412f0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:52:06 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-a9d4a5a7-3509-4bb9-ab2d-cac86bac785b tempest-ProjectReaderTests-2085471397 None] Creating volume bdf302aa-b39c-427d-8afd-44223d339442 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:52:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a9d4a5a7-3509-4bb9-ab2d-cac86bac785b tempest-ProjectReaderTests-2085471397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a9d4a5a7-3509-4bb9-ab2d-cac86bac785b tempest-ProjectReaderTests-2085471397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:06 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-a9d4a5a7-3509-4bb9-ab2d-cac86bac785b tempest-ProjectReaderTests-2085471397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:52:06 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-a9d4a5a7-3509-4bb9-ab2d-cac86bac785b tempest-ProjectReaderTests-2085471397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:52:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a9d4a5a7-3509-4bb9-ab2d-cac86bac785b tempest-ProjectReaderTests-2085471397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:06 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-a9d4a5a7-3509-4bb9-ab2d-cac86bac785b tempest-ProjectReaderTests-2085471397 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:52:06 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-a9d4a5a7-3509-4bb9-ab2d-cac86bac785b tempest-ProjectReaderTests-2085471397 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:52:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a9d4a5a7-3509-4bb9-ab2d-cac86bac785b tempest-ProjectReaderTests-2085471397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bdf302aa-b39c-427d-8afd-44223d339442 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:06 devstack sudo[103157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bdf302aa-b39c-427d-8afd-44223d339442 1073741824 Sep 10 16:52:06 devstack sudo[103157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:07 devstack sudo[103157]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a9d4a5a7-3509-4bb9-ab2d-cac86bac785b tempest-ProjectReaderTests-2085471397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bdf302aa-b39c-427d-8afd-44223d339442 1073741824" returned: 0 in 0.711s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a9d4a5a7-3509-4bb9-ab2d-cac86bac785b tempest-ProjectReaderTests-2085471397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bdf302aa-b39c-427d-8afd-44223d339442 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:07 devstack sudo[103164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bdf302aa-b39c-427d-8afd-44223d339442 Sep 10 16:52:07 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:07 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a9d4a5a7-3509-4bb9-ab2d-cac86bac785b tempest-ProjectReaderTests-2085471397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bdf302aa-b39c-427d-8afd-44223d339442" returned: 0 in 0.319s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:07 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-a9d4a5a7-3509-4bb9-ab2d-cac86bac785b tempest-ProjectReaderTests-2085471397 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:52:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a9d4a5a7-3509-4bb9-ab2d-cac86bac785b tempest-ProjectReaderTests-2085471397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a9d4a5a7-3509-4bb9-ab2d-cac86bac785b tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be413928-df9b-4bd6-8320-76cc3ec0e779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdf302aa-b39c-427d-8afd-44223d339442', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a9d4a5a7-3509-4bb9-ab2d-cac86bac785b tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6bada0c-9745-473f-89e3-9f128042ce44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:07 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-a9d4a5a7-3509-4bb9-ab2d-cac86bac785b tempest-ProjectReaderTests-2085471397 None] Volume volume-bdf302aa-b39c-427d-8afd-44223d339442 (bdf302aa-b39c-427d-8afd-44223d339442): created successfully Sep 10 16:52:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a9d4a5a7-3509-4bb9-ab2d-cac86bac785b tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6bada0c-9745-473f-89e3-9f128042ce44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a9d4a5a7-3509-4bb9-ab2d-cac86bac785b tempest-ProjectReaderTests-2085471397 None] Flow 'volume_create_manager' (37239106-63ad-4108-ac02-9ab80449158e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:52:07 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-a9d4a5a7-3509-4bb9-ab2d-cac86bac785b tempest-ProjectReaderTests-2085471397 None] Created volume successfully. Sep 10 16:52:09 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-455663d4-f841-49bf-ac42-0ce9550ee636 tempest-ProjectReaderTests-2085471397 None] Acquiring lock "cinder-bdf302aa-b39c-427d-8afd-44223d339442-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:52:09 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-455663d4-f841-49bf-ac42-0ce9550ee636 tempest-ProjectReaderTests-2085471397 None] Lock "cinder-bdf302aa-b39c-427d-8afd-44223d339442-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:52:09 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-455663d4-f841-49bf-ac42-0ce9550ee636 tempest-ProjectReaderTests-2085471397 None] Acquiring lock "cinder-quobyte-bdf302aa-b39c-427d-8afd-44223d339442" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:52:09 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-455663d4-f841-49bf-ac42-0ce9550ee636 tempest-ProjectReaderTests-2085471397 None] Lock "cinder-quobyte-bdf302aa-b39c-427d-8afd-44223d339442" acquired by "delete_volume" :: waited 0.024s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:52:09 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c25edfa-edc9-4962-96d0-f1ca31be4dd5]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:52:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-455663d4-f841-49bf-ac42-0ce9550ee636 tempest-ProjectReaderTests-2085471397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bdf302aa-b39c-427d-8afd-44223d339442 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:09 devstack sudo[103167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bdf302aa-b39c-427d-8afd-44223d339442 Sep 10 16:52:09 devstack sudo[103167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:09 devstack sudo[103167]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-455663d4-f841-49bf-ac42-0ce9550ee636 tempest-ProjectReaderTests-2085471397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bdf302aa-b39c-427d-8afd-44223d339442" returned: 0 in 0.555s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-455663d4-f841-49bf-ac42-0ce9550ee636 tempest-ProjectReaderTests-2085471397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bdf302aa-b39c-427d-8afd-44223d339442 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:09 devstack sudo[103172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bdf302aa-b39c-427d-8afd-44223d339442 Sep 10 16:52:09 devstack sudo[103172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:10 devstack sudo[103172]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-455663d4-f841-49bf-ac42-0ce9550ee636 tempest-ProjectReaderTests-2085471397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bdf302aa-b39c-427d-8afd-44223d339442" returned: 0 in 0.360s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:10 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-455663d4-f841-49bf-ac42-0ce9550ee636 tempest-ProjectReaderTests-2085471397 None] Lock "cinder-quobyte-bdf302aa-b39c-427d-8afd-44223d339442" released by "delete_volume" :: held 0.983s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:52:10 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ad7019c-65b4-4419-8f62-c7cb7f1d7239 tempest-VolumesTransfersTest-23708117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:52:10 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9ad7019c-65b4-4419-8f62-c7cb7f1d7239 tempest-VolumesTransfersTest-23708117 None] Flow 'volume_create_manager' (7d5add7b-5dc1-468b-bf02-f3f45a69e713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:52:10 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9ad7019c-65b4-4419-8f62-c7cb7f1d7239 tempest-VolumesTransfersTest-23708117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ff9ea87-10eb-4bcd-a7e6-5c720f248777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:10 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9ad7019c-65b4-4419-8f62-c7cb7f1d7239 tempest-VolumesTransfersTest-23708117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ff9ea87-10eb-4bcd-a7e6-5c720f248777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1633660156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0e72a5d-c6b9-42fb-bdf8-d3391c49f3e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e979cd295064b0991ec514b20448e20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:52:10Z,use_quota=True,user_id='c8b297b790654d719a12809ee38d2426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:10 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9ad7019c-65b4-4419-8f62-c7cb7f1d7239 tempest-VolumesTransfersTest-23708117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc7b4af-ec72-4a86-8ff9-1ce1554b46aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:10 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9ad7019c-65b4-4419-8f62-c7cb7f1d7239 tempest-VolumesTransfersTest-23708117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc7b4af-ec72-4a86-8ff9-1ce1554b46aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:10 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9ad7019c-65b4-4419-8f62-c7cb7f1d7239 tempest-VolumesTransfersTest-23708117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f079069-bbad-4641-8f4f-f4bae63377b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:10 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9ad7019c-65b4-4419-8f62-c7cb7f1d7239 tempest-VolumesTransfersTest-23708117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f079069-bbad-4641-8f4f-f4bae63377b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0e72a5d-c6b9-42fb-bdf8-d3391c49f3e0', 'volume_name': 'volume-b0e72a5d-c6b9-42fb-bdf8-d3391c49f3e0', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:10 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9ad7019c-65b4-4419-8f62-c7cb7f1d7239 tempest-VolumesTransfersTest-23708117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b614b6b-bed6-47b3-a5d7-e98c88140fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:10 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9ad7019c-65b4-4419-8f62-c7cb7f1d7239 tempest-VolumesTransfersTest-23708117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b614b6b-bed6-47b3-a5d7-e98c88140fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:10 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9ad7019c-65b4-4419-8f62-c7cb7f1d7239 tempest-VolumesTransfersTest-23708117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af466acd-1b62-48e6-a8a4-9b355fc793e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:10 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-9ad7019c-65b4-4419-8f62-c7cb7f1d7239 tempest-VolumesTransfersTest-23708117 None] Volume b0e72a5d-c6b9-42fb-bdf8-d3391c49f3e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0e72a5d-c6b9-42fb-bdf8-d3391c49f3e0', 'volume_size': 1} Sep 10 16:52:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9ad7019c-65b4-4419-8f62-c7cb7f1d7239 tempest-VolumesTransfersTest-23708117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9ad7019c-65b4-4419-8f62-c7cb7f1d7239 tempest-VolumesTransfersTest-23708117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:10 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9ad7019c-65b4-4419-8f62-c7cb7f1d7239 tempest-VolumesTransfersTest-23708117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1633660156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0e72a5d-c6b9-42fb-bdf8-d3391c49f3e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e979cd295064b0991ec514b20448e20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:52:10Z,use_quota=True,user_id='c8b297b790654d719a12809ee38d2426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:52:10 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-9ad7019c-65b4-4419-8f62-c7cb7f1d7239 tempest-VolumesTransfersTest-23708117 None] Creating volume b0e72a5d-c6b9-42fb-bdf8-d3391c49f3e0 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:52:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9ad7019c-65b4-4419-8f62-c7cb7f1d7239 tempest-VolumesTransfersTest-23708117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9ad7019c-65b4-4419-8f62-c7cb7f1d7239 tempest-VolumesTransfersTest-23708117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:10 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9ad7019c-65b4-4419-8f62-c7cb7f1d7239 tempest-VolumesTransfersTest-23708117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:52:10 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9ad7019c-65b4-4419-8f62-c7cb7f1d7239 tempest-VolumesTransfersTest-23708117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:52:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9ad7019c-65b4-4419-8f62-c7cb7f1d7239 tempest-VolumesTransfersTest-23708117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:10 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9ad7019c-65b4-4419-8f62-c7cb7f1d7239 tempest-VolumesTransfersTest-23708117 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:52:10 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-9ad7019c-65b4-4419-8f62-c7cb7f1d7239 tempest-VolumesTransfersTest-23708117 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:52:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9ad7019c-65b4-4419-8f62-c7cb7f1d7239 tempest-VolumesTransfersTest-23708117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b0e72a5d-c6b9-42fb-bdf8-d3391c49f3e0 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:10 devstack sudo[103176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b0e72a5d-c6b9-42fb-bdf8-d3391c49f3e0 1073741824 Sep 10 16:52:10 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:10 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-455663d4-f841-49bf-ac42-0ce9550ee636 tempest-ProjectReaderTests-2085471397 None] Created reservations ['1d47550a-84a4-405f-b338-2c1ce7deb024', '7873572c-c11c-4686-8794-2c9e7bc8b5ee', '1f310b95-c13c-463a-ae3c-53612d199076', '511fcfa8-76a3-48af-9884-5ab4edb5d529'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:52:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-455663d4-f841-49bf-ac42-0ce9550ee636 tempest-ProjectReaderTests-2085471397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-455663d4-f841-49bf-ac42-0ce9550ee636 tempest-ProjectReaderTests-2085471397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:10 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-455663d4-f841-49bf-ac42-0ce9550ee636 tempest-ProjectReaderTests-2085471397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:52:10 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-455663d4-f841-49bf-ac42-0ce9550ee636 tempest-ProjectReaderTests-2085471397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:52:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-455663d4-f841-49bf-ac42-0ce9550ee636 tempest-ProjectReaderTests-2085471397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-455663d4-f841-49bf-ac42-0ce9550ee636 tempest-ProjectReaderTests-2085471397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:10 devstack sudo[103179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:52:10 devstack sudo[103179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:11 devstack sudo[103179]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-455663d4-f841-49bf-ac42-0ce9550ee636 tempest-ProjectReaderTests-2085471397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.326s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:11 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-455663d4-f841-49bf-ac42-0ce9550ee636 tempest-ProjectReaderTests-2085471397 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:52:11 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-455663d4-f841-49bf-ac42-0ce9550ee636 tempest-ProjectReaderTests-2085471397 None] Deleted volume successfully. Sep 10 16:52:11 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-455663d4-f841-49bf-ac42-0ce9550ee636 tempest-ProjectReaderTests-2085471397 None] Lock "cinder-bdf302aa-b39c-427d-8afd-44223d339442-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:52:11 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9ad7019c-65b4-4419-8f62-c7cb7f1d7239 tempest-VolumesTransfersTest-23708117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b0e72a5d-c6b9-42fb-bdf8-d3391c49f3e0 1073741824" returned: 0 in 0.669s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9ad7019c-65b4-4419-8f62-c7cb7f1d7239 tempest-VolumesTransfersTest-23708117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b0e72a5d-c6b9-42fb-bdf8-d3391c49f3e0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:11 devstack sudo[103186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b0e72a5d-c6b9-42fb-bdf8-d3391c49f3e0 Sep 10 16:52:11 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:11 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9ad7019c-65b4-4419-8f62-c7cb7f1d7239 tempest-VolumesTransfersTest-23708117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b0e72a5d-c6b9-42fb-bdf8-d3391c49f3e0" returned: 0 in 0.303s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:11 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9ad7019c-65b4-4419-8f62-c7cb7f1d7239 tempest-VolumesTransfersTest-23708117 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:52:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9ad7019c-65b4-4419-8f62-c7cb7f1d7239 tempest-VolumesTransfersTest-23708117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:11 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9ad7019c-65b4-4419-8f62-c7cb7f1d7239 tempest-VolumesTransfersTest-23708117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af466acd-1b62-48e6-a8a4-9b355fc793e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0e72a5d-c6b9-42fb-bdf8-d3391c49f3e0', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:11 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9ad7019c-65b4-4419-8f62-c7cb7f1d7239 tempest-VolumesTransfersTest-23708117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2ac91f7-71bd-4a77-a544-0ec4c9e842f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:11 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-9ad7019c-65b4-4419-8f62-c7cb7f1d7239 tempest-VolumesTransfersTest-23708117 None] Volume volume-b0e72a5d-c6b9-42fb-bdf8-d3391c49f3e0 (b0e72a5d-c6b9-42fb-bdf8-d3391c49f3e0): created successfully Sep 10 16:52:11 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9ad7019c-65b4-4419-8f62-c7cb7f1d7239 tempest-VolumesTransfersTest-23708117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2ac91f7-71bd-4a77-a544-0ec4c9e842f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:11 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9ad7019c-65b4-4419-8f62-c7cb7f1d7239 tempest-VolumesTransfersTest-23708117 None] Flow 'volume_create_manager' (7d5add7b-5dc1-468b-bf02-f3f45a69e713) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:52:11 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-9ad7019c-65b4-4419-8f62-c7cb7f1d7239 tempest-VolumesTransfersTest-23708117 None] Created volume successfully. Sep 10 16:52:12 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-c36b679e-6e32-4a5e-9266-39dff7e9dc94 tempest-ProjectReaderTests-2085471397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:52:12 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c36b679e-6e32-4a5e-9266-39dff7e9dc94 tempest-ProjectReaderTests-2085471397 None] Flow 'volume_create_manager' (a308a6ec-3e4b-4f9b-a3a8-d8b54ed1be7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:52:12 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c36b679e-6e32-4a5e-9266-39dff7e9dc94 tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffaf9707-1842-4b41-bf7e-d7b0a878b669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:12 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c36b679e-6e32-4a5e-9266-39dff7e9dc94 tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffaf9707-1842-4b41-bf7e-d7b0a878b669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-595918649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cc13ccc-a52a-4c90-a34c-d67b3465f167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='585a38fa0bda4d9c8c012c1b84cb2259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:52:12Z,use_quota=True,user_id='c1919ff8ae2c408e985681d873412f0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:12 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c36b679e-6e32-4a5e-9266-39dff7e9dc94 tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59cbcb1a-d56b-4e18-9b68-64446a689772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:12 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c36b679e-6e32-4a5e-9266-39dff7e9dc94 tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59cbcb1a-d56b-4e18-9b68-64446a689772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:12 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c36b679e-6e32-4a5e-9266-39dff7e9dc94 tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca0e1c0a-6451-4e9e-9002-9e1cddaf1093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:12 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c36b679e-6e32-4a5e-9266-39dff7e9dc94 tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca0e1c0a-6451-4e9e-9002-9e1cddaf1093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cc13ccc-a52a-4c90-a34c-d67b3465f167', 'volume_name': 'volume-5cc13ccc-a52a-4c90-a34c-d67b3465f167', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:12 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c36b679e-6e32-4a5e-9266-39dff7e9dc94 tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c544d7a7-4d09-43bc-b158-72cee33a2e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:12 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c36b679e-6e32-4a5e-9266-39dff7e9dc94 tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c544d7a7-4d09-43bc-b158-72cee33a2e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:12 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c36b679e-6e32-4a5e-9266-39dff7e9dc94 tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d02303-0825-4b23-826e-f0b3d45649af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:12 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-c36b679e-6e32-4a5e-9266-39dff7e9dc94 tempest-ProjectReaderTests-2085471397 None] Volume 5cc13ccc-a52a-4c90-a34c-d67b3465f167: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cc13ccc-a52a-4c90-a34c-d67b3465f167', 'volume_size': 1} Sep 10 16:52:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c36b679e-6e32-4a5e-9266-39dff7e9dc94 tempest-ProjectReaderTests-2085471397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c36b679e-6e32-4a5e-9266-39dff7e9dc94 tempest-ProjectReaderTests-2085471397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:12 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c36b679e-6e32-4a5e-9266-39dff7e9dc94 tempest-ProjectReaderTests-2085471397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-595918649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cc13ccc-a52a-4c90-a34c-d67b3465f167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='585a38fa0bda4d9c8c012c1b84cb2259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:52:12Z,use_quota=True,user_id='c1919ff8ae2c408e985681d873412f0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:52:12 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-c36b679e-6e32-4a5e-9266-39dff7e9dc94 tempest-ProjectReaderTests-2085471397 None] Creating volume 5cc13ccc-a52a-4c90-a34c-d67b3465f167 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:52:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c36b679e-6e32-4a5e-9266-39dff7e9dc94 tempest-ProjectReaderTests-2085471397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c36b679e-6e32-4a5e-9266-39dff7e9dc94 tempest-ProjectReaderTests-2085471397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:12 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c36b679e-6e32-4a5e-9266-39dff7e9dc94 tempest-ProjectReaderTests-2085471397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:52:12 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c36b679e-6e32-4a5e-9266-39dff7e9dc94 tempest-ProjectReaderTests-2085471397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:52:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c36b679e-6e32-4a5e-9266-39dff7e9dc94 tempest-ProjectReaderTests-2085471397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:12 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c36b679e-6e32-4a5e-9266-39dff7e9dc94 tempest-ProjectReaderTests-2085471397 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:52:12 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-c36b679e-6e32-4a5e-9266-39dff7e9dc94 tempest-ProjectReaderTests-2085471397 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:52:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c36b679e-6e32-4a5e-9266-39dff7e9dc94 tempest-ProjectReaderTests-2085471397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5cc13ccc-a52a-4c90-a34c-d67b3465f167 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:12 devstack sudo[103189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5cc13ccc-a52a-4c90-a34c-d67b3465f167 1073741824 Sep 10 16:52:12 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:12 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c36b679e-6e32-4a5e-9266-39dff7e9dc94 tempest-ProjectReaderTests-2085471397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5cc13ccc-a52a-4c90-a34c-d67b3465f167 1073741824" returned: 0 in 0.596s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c36b679e-6e32-4a5e-9266-39dff7e9dc94 tempest-ProjectReaderTests-2085471397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5cc13ccc-a52a-4c90-a34c-d67b3465f167 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:12 devstack sudo[103195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5cc13ccc-a52a-4c90-a34c-d67b3465f167 Sep 10 16:52:12 devstack sudo[103195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:13 devstack sudo[103195]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c36b679e-6e32-4a5e-9266-39dff7e9dc94 tempest-ProjectReaderTests-2085471397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5cc13ccc-a52a-4c90-a34c-d67b3465f167" returned: 0 in 0.329s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:13 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c36b679e-6e32-4a5e-9266-39dff7e9dc94 tempest-ProjectReaderTests-2085471397 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:52:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c36b679e-6e32-4a5e-9266-39dff7e9dc94 tempest-ProjectReaderTests-2085471397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:13 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c36b679e-6e32-4a5e-9266-39dff7e9dc94 tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d02303-0825-4b23-826e-f0b3d45649af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cc13ccc-a52a-4c90-a34c-d67b3465f167', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:13 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c36b679e-6e32-4a5e-9266-39dff7e9dc94 tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5844afa-1fca-4df0-be5a-deb52f86a345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:13 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-c36b679e-6e32-4a5e-9266-39dff7e9dc94 tempest-ProjectReaderTests-2085471397 None] Volume volume-5cc13ccc-a52a-4c90-a34c-d67b3465f167 (5cc13ccc-a52a-4c90-a34c-d67b3465f167): created successfully Sep 10 16:52:13 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c36b679e-6e32-4a5e-9266-39dff7e9dc94 tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5844afa-1fca-4df0-be5a-deb52f86a345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:13 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c36b679e-6e32-4a5e-9266-39dff7e9dc94 tempest-ProjectReaderTests-2085471397 None] Flow 'volume_create_manager' (a308a6ec-3e4b-4f9b-a3a8-d8b54ed1be7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:52:13 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-c36b679e-6e32-4a5e-9266-39dff7e9dc94 tempest-ProjectReaderTests-2085471397 None] Created volume successfully. Sep 10 16:52:13 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-65b833e2-163f-4b6e-861c-883d0f197d44 tempest-VolumesTransfersTest-1112744900 None] Transfer volume completed successfully. Sep 10 16:52:14 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-add78a0b-7739-49fc-a72c-b0ea0a3a9952 tempest-ProjectReaderTests-2085471397 None] Acquiring lock "cinder-5cc13ccc-a52a-4c90-a34c-d67b3465f167-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:52:14 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-add78a0b-7739-49fc-a72c-b0ea0a3a9952 tempest-ProjectReaderTests-2085471397 None] Lock "cinder-5cc13ccc-a52a-4c90-a34c-d67b3465f167-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:52:14 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-add78a0b-7739-49fc-a72c-b0ea0a3a9952 tempest-ProjectReaderTests-2085471397 None] Acquiring lock "cinder-quobyte-5cc13ccc-a52a-4c90-a34c-d67b3465f167" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:52:14 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-add78a0b-7739-49fc-a72c-b0ea0a3a9952 tempest-ProjectReaderTests-2085471397 None] Lock "cinder-quobyte-5cc13ccc-a52a-4c90-a34c-d67b3465f167" acquired by "delete_volume" :: waited 0.017s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:52:14 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e1bb44-cd9d-4e12-92d8-76f6efaec484]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:52:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-add78a0b-7739-49fc-a72c-b0ea0a3a9952 tempest-ProjectReaderTests-2085471397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5cc13ccc-a52a-4c90-a34c-d67b3465f167 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:14 devstack sudo[103198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5cc13ccc-a52a-4c90-a34c-d67b3465f167 Sep 10 16:52:14 devstack sudo[103198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:14 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b27a5c3d-cc44-4b0b-ad7d-98f4e98263a2 tempest-VolumesTransfersTest-1418299085 None] Acquiring lock "cinder-b0e72a5d-c6b9-42fb-bdf8-d3391c49f3e0-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:52:14 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b27a5c3d-cc44-4b0b-ad7d-98f4e98263a2 tempest-VolumesTransfersTest-1418299085 None] Lock "cinder-b0e72a5d-c6b9-42fb-bdf8-d3391c49f3e0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:52:14 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b27a5c3d-cc44-4b0b-ad7d-98f4e98263a2 tempest-VolumesTransfersTest-1418299085 None] Acquiring lock "cinder-quobyte-b0e72a5d-c6b9-42fb-bdf8-d3391c49f3e0" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:52:15 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b27a5c3d-cc44-4b0b-ad7d-98f4e98263a2 tempest-VolumesTransfersTest-1418299085 None] Lock "cinder-quobyte-b0e72a5d-c6b9-42fb-bdf8-d3391c49f3e0" acquired by "delete_volume" :: waited 0.046s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:52:15 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c532f4-4524-4f99-b3f8-751d94189fbb]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:52:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b27a5c3d-cc44-4b0b-ad7d-98f4e98263a2 tempest-VolumesTransfersTest-1418299085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b0e72a5d-c6b9-42fb-bdf8-d3391c49f3e0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:15 devstack sudo[103198]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-add78a0b-7739-49fc-a72c-b0ea0a3a9952 tempest-ProjectReaderTests-2085471397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5cc13ccc-a52a-4c90-a34c-d67b3465f167" returned: 0 in 0.625s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-add78a0b-7739-49fc-a72c-b0ea0a3a9952 tempest-ProjectReaderTests-2085471397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5cc13ccc-a52a-4c90-a34c-d67b3465f167 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:15 devstack sudo[103202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b0e72a5d-c6b9-42fb-bdf8-d3391c49f3e0 Sep 10 16:52:15 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:15 devstack sudo[103204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5cc13ccc-a52a-4c90-a34c-d67b3465f167 Sep 10 16:52:15 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:15 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-add78a0b-7739-49fc-a72c-b0ea0a3a9952 tempest-ProjectReaderTests-2085471397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5cc13ccc-a52a-4c90-a34c-d67b3465f167" returned: 0 in 0.507s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:15 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-add78a0b-7739-49fc-a72c-b0ea0a3a9952 tempest-ProjectReaderTests-2085471397 None] Lock "cinder-quobyte-5cc13ccc-a52a-4c90-a34c-d67b3465f167" released by "delete_volume" :: held 1.208s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:52:15 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b27a5c3d-cc44-4b0b-ad7d-98f4e98263a2 tempest-VolumesTransfersTest-1418299085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b0e72a5d-c6b9-42fb-bdf8-d3391c49f3e0" returned: 0 in 0.679s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b27a5c3d-cc44-4b0b-ad7d-98f4e98263a2 tempest-VolumesTransfersTest-1418299085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b0e72a5d-c6b9-42fb-bdf8-d3391c49f3e0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:15 devstack sudo[103245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b0e72a5d-c6b9-42fb-bdf8-d3391c49f3e0 Sep 10 16:52:15 devstack sudo[103245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:15 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-add78a0b-7739-49fc-a72c-b0ea0a3a9952 tempest-ProjectReaderTests-2085471397 None] Created reservations ['3d02278b-019a-4c9e-a460-bfdf5c5980c7', 'a6ce6066-9b8b-4ae6-8733-9495631a0395', 'a0071f56-8e59-490a-99ef-a9ecd19605ff', '42a8b4bb-c070-430d-a216-818114075d9d'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:52:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-add78a0b-7739-49fc-a72c-b0ea0a3a9952 tempest-ProjectReaderTests-2085471397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-add78a0b-7739-49fc-a72c-b0ea0a3a9952 tempest-ProjectReaderTests-2085471397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-add78a0b-7739-49fc-a72c-b0ea0a3a9952 tempest-ProjectReaderTests-2085471397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:52:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-add78a0b-7739-49fc-a72c-b0ea0a3a9952 tempest-ProjectReaderTests-2085471397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:52:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-add78a0b-7739-49fc-a72c-b0ea0a3a9952 tempest-ProjectReaderTests-2085471397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-add78a0b-7739-49fc-a72c-b0ea0a3a9952 tempest-ProjectReaderTests-2085471397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:16 devstack sudo[103249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:52:16 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:16 devstack sudo[103245]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b27a5c3d-cc44-4b0b-ad7d-98f4e98263a2 tempest-VolumesTransfersTest-1418299085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b0e72a5d-c6b9-42fb-bdf8-d3391c49f3e0" returned: 0 in 0.436s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:16 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b27a5c3d-cc44-4b0b-ad7d-98f4e98263a2 tempest-VolumesTransfersTest-1418299085 None] Lock "cinder-quobyte-b0e72a5d-c6b9-42fb-bdf8-d3391c49f3e0" released by "delete_volume" :: held 1.225s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:52:16 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-b27a5c3d-cc44-4b0b-ad7d-98f4e98263a2 tempest-VolumesTransfersTest-1418299085 None] Created reservations ['4264b3c8-91ad-44bd-b14b-e2121f7630e8', 'dad3a03d-9b2b-4467-9470-c4ddeed387b3', 'f39448a9-d9dc-4822-9890-cd0d3ffa817d', '38e60c26-c8d6-4e7e-bc35-80a9d3c804c8'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:52:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b27a5c3d-cc44-4b0b-ad7d-98f4e98263a2 tempest-VolumesTransfersTest-1418299085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b27a5c3d-cc44-4b0b-ad7d-98f4e98263a2 tempest-VolumesTransfersTest-1418299085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b27a5c3d-cc44-4b0b-ad7d-98f4e98263a2 tempest-VolumesTransfersTest-1418299085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:52:16 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b27a5c3d-cc44-4b0b-ad7d-98f4e98263a2 tempest-VolumesTransfersTest-1418299085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:52:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b27a5c3d-cc44-4b0b-ad7d-98f4e98263a2 tempest-VolumesTransfersTest-1418299085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b27a5c3d-cc44-4b0b-ad7d-98f4e98263a2 tempest-VolumesTransfersTest-1418299085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-add78a0b-7739-49fc-a72c-b0ea0a3a9952 tempest-ProjectReaderTests-2085471397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.431s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:16 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-add78a0b-7739-49fc-a72c-b0ea0a3a9952 tempest-ProjectReaderTests-2085471397 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:52:16 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-add78a0b-7739-49fc-a72c-b0ea0a3a9952 tempest-ProjectReaderTests-2085471397 None] Deleted volume successfully. Sep 10 16:52:16 devstack sudo[103253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:52:16 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:16 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-add78a0b-7739-49fc-a72c-b0ea0a3a9952 tempest-ProjectReaderTests-2085471397 None] Lock "cinder-5cc13ccc-a52a-4c90-a34c-d67b3465f167-delete_volume" released by "delete_volume" :: held 2.010s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:52:16 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b27a5c3d-cc44-4b0b-ad7d-98f4e98263a2 tempest-VolumesTransfersTest-1418299085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.278s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:16 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-b27a5c3d-cc44-4b0b-ad7d-98f4e98263a2 tempest-VolumesTransfersTest-1418299085 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:52:16 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-b27a5c3d-cc44-4b0b-ad7d-98f4e98263a2 tempest-VolumesTransfersTest-1418299085 None] Deleted volume successfully. Sep 10 16:52:16 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b27a5c3d-cc44-4b0b-ad7d-98f4e98263a2 tempest-VolumesTransfersTest-1418299085 None] Lock "cinder-b0e72a5d-c6b9-42fb-bdf8-d3391c49f3e0-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:52:17 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c34b720-dafc-440d-a4b4-373903ac8b36 tempest-ProjectReaderTests-2085471397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:52:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7c34b720-dafc-440d-a4b4-373903ac8b36 tempest-ProjectReaderTests-2085471397 None] Flow 'volume_create_manager' (837a5b86-d747-4ab2-a3c7-40cac7fec5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:52:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7c34b720-dafc-440d-a4b4-373903ac8b36 tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e2fc1cd-3917-4b41-b9bd-f4470386dbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7c34b720-dafc-440d-a4b4-373903ac8b36 tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e2fc1cd-3917-4b41-b9bd-f4470386dbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1117964875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b631746-495d-4ecc-b36d-1f35b609a969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='585a38fa0bda4d9c8c012c1b84cb2259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:52:18Z,use_quota=True,user_id='c1919ff8ae2c408e985681d873412f0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7c34b720-dafc-440d-a4b4-373903ac8b36 tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (078d6088-0149-4ae0-b1cc-a955870cd1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7c34b720-dafc-440d-a4b4-373903ac8b36 tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (078d6088-0149-4ae0-b1cc-a955870cd1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7c34b720-dafc-440d-a4b4-373903ac8b36 tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e60ba3-b0c9-4aab-bb5b-0c9f057bda24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7c34b720-dafc-440d-a4b4-373903ac8b36 tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e60ba3-b0c9-4aab-bb5b-0c9f057bda24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b631746-495d-4ecc-b36d-1f35b609a969', 'volume_name': 'volume-9b631746-495d-4ecc-b36d-1f35b609a969', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7c34b720-dafc-440d-a4b4-373903ac8b36 tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f7d216f-d5dd-4f37-bfb8-19ff2657a690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7c34b720-dafc-440d-a4b4-373903ac8b36 tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f7d216f-d5dd-4f37-bfb8-19ff2657a690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7c34b720-dafc-440d-a4b4-373903ac8b36 tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b40d3db-9318-45f4-b382-69b5decc8702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:17 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-7c34b720-dafc-440d-a4b4-373903ac8b36 tempest-ProjectReaderTests-2085471397 None] Volume 9b631746-495d-4ecc-b36d-1f35b609a969: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b631746-495d-4ecc-b36d-1f35b609a969', 'volume_size': 1} Sep 10 16:52:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7c34b720-dafc-440d-a4b4-373903ac8b36 tempest-ProjectReaderTests-2085471397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7c34b720-dafc-440d-a4b4-373903ac8b36 tempest-ProjectReaderTests-2085471397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7c34b720-dafc-440d-a4b4-373903ac8b36 tempest-ProjectReaderTests-2085471397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1117964875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b631746-495d-4ecc-b36d-1f35b609a969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='585a38fa0bda4d9c8c012c1b84cb2259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:52:18Z,use_quota=True,user_id='c1919ff8ae2c408e985681d873412f0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:52:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-7c34b720-dafc-440d-a4b4-373903ac8b36 tempest-ProjectReaderTests-2085471397 None] Creating volume 9b631746-495d-4ecc-b36d-1f35b609a969 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:52:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7c34b720-dafc-440d-a4b4-373903ac8b36 tempest-ProjectReaderTests-2085471397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7c34b720-dafc-440d-a4b4-373903ac8b36 tempest-ProjectReaderTests-2085471397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7c34b720-dafc-440d-a4b4-373903ac8b36 tempest-ProjectReaderTests-2085471397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:52:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7c34b720-dafc-440d-a4b4-373903ac8b36 tempest-ProjectReaderTests-2085471397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:52:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7c34b720-dafc-440d-a4b4-373903ac8b36 tempest-ProjectReaderTests-2085471397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7c34b720-dafc-440d-a4b4-373903ac8b36 tempest-ProjectReaderTests-2085471397 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:52:17 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-7c34b720-dafc-440d-a4b4-373903ac8b36 tempest-ProjectReaderTests-2085471397 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:52:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7c34b720-dafc-440d-a4b4-373903ac8b36 tempest-ProjectReaderTests-2085471397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9b631746-495d-4ecc-b36d-1f35b609a969 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:17 devstack sudo[103257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9b631746-495d-4ecc-b36d-1f35b609a969 1073741824 Sep 10 16:52:17 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:18 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-25ec5632-f281-4635-9e9c-fc943ec8bf7e tempest-VolumesTransfersTest-23708117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:52:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-25ec5632-f281-4635-9e9c-fc943ec8bf7e tempest-VolumesTransfersTest-23708117 None] Flow 'volume_create_manager' (53abc7c6-d822-4e63-8de5-87bd50772396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:52:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-25ec5632-f281-4635-9e9c-fc943ec8bf7e tempest-VolumesTransfersTest-23708117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f833e549-e4c4-4418-91dd-71b4ebc7bb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-25ec5632-f281-4635-9e9c-fc943ec8bf7e tempest-VolumesTransfersTest-23708117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f833e549-e4c4-4418-91dd-71b4ebc7bb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-999158593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4325fe4b-c683-496b-826e-295549c0d636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e979cd295064b0991ec514b20448e20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:52:18Z,use_quota=True,user_id='c8b297b790654d719a12809ee38d2426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-25ec5632-f281-4635-9e9c-fc943ec8bf7e tempest-VolumesTransfersTest-23708117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f268cd7-2c80-4bda-aaf1-96530f6228e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-25ec5632-f281-4635-9e9c-fc943ec8bf7e tempest-VolumesTransfersTest-23708117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f268cd7-2c80-4bda-aaf1-96530f6228e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-25ec5632-f281-4635-9e9c-fc943ec8bf7e tempest-VolumesTransfersTest-23708117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa548cdb-ce9e-408b-9561-8c8f9aec94b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-25ec5632-f281-4635-9e9c-fc943ec8bf7e tempest-VolumesTransfersTest-23708117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa548cdb-ce9e-408b-9561-8c8f9aec94b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4325fe4b-c683-496b-826e-295549c0d636', 'volume_name': 'volume-4325fe4b-c683-496b-826e-295549c0d636', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-25ec5632-f281-4635-9e9c-fc943ec8bf7e tempest-VolumesTransfersTest-23708117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ed05ce-f9d9-4ee6-b13a-09bce605c8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-25ec5632-f281-4635-9e9c-fc943ec8bf7e tempest-VolumesTransfersTest-23708117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ed05ce-f9d9-4ee6-b13a-09bce605c8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-25ec5632-f281-4635-9e9c-fc943ec8bf7e tempest-VolumesTransfersTest-23708117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a104ad-236f-4d86-a9d6-eba12fb64190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:18 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-25ec5632-f281-4635-9e9c-fc943ec8bf7e tempest-VolumesTransfersTest-23708117 None] Volume 4325fe4b-c683-496b-826e-295549c0d636: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4325fe4b-c683-496b-826e-295549c0d636', 'volume_size': 1} Sep 10 16:52:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-25ec5632-f281-4635-9e9c-fc943ec8bf7e tempest-VolumesTransfersTest-23708117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:18 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7c34b720-dafc-440d-a4b4-373903ac8b36 tempest-ProjectReaderTests-2085471397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9b631746-495d-4ecc-b36d-1f35b609a969 1073741824" returned: 0 in 0.709s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7c34b720-dafc-440d-a4b4-373903ac8b36 tempest-ProjectReaderTests-2085471397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9b631746-495d-4ecc-b36d-1f35b609a969 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:18 devstack sudo[103263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9b631746-495d-4ecc-b36d-1f35b609a969 Sep 10 16:52:18 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:18 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0a31c2b-e6e5-4360-bf68-c29485709ede tempest-SnapshotDependencyTests-741204092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:52:18 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a0a31c2b-e6e5-4360-bf68-c29485709ede tempest-SnapshotDependencyTests-741204092 None] Flow 'volume_create_manager' (c4442135-1c5f-4b94-8f38-4811ce11c38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:52:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a0a31c2b-e6e5-4360-bf68-c29485709ede tempest-SnapshotDependencyTests-741204092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd804039-b606-4955-adf7-e4c6b0310efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7c34b720-dafc-440d-a4b4-373903ac8b36 tempest-ProjectReaderTests-2085471397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9b631746-495d-4ecc-b36d-1f35b609a969" returned: 0 in 0.314s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:18 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7c34b720-dafc-440d-a4b4-373903ac8b36 tempest-ProjectReaderTests-2085471397 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:52:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7c34b720-dafc-440d-a4b4-373903ac8b36 tempest-ProjectReaderTests-2085471397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-25ec5632-f281-4635-9e9c-fc943ec8bf7e tempest-VolumesTransfersTest-23708117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.602s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:18 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-25ec5632-f281-4635-9e9c-fc943ec8bf7e tempest-VolumesTransfersTest-23708117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-999158593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4325fe4b-c683-496b-826e-295549c0d636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e979cd295064b0991ec514b20448e20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:52:18Z,use_quota=True,user_id='c8b297b790654d719a12809ee38d2426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:52:18 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-25ec5632-f281-4635-9e9c-fc943ec8bf7e tempest-VolumesTransfersTest-23708117 None] Creating volume 4325fe4b-c683-496b-826e-295549c0d636 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:52:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-25ec5632-f281-4635-9e9c-fc943ec8bf7e tempest-VolumesTransfersTest-23708117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-25ec5632-f281-4635-9e9c-fc943ec8bf7e tempest-VolumesTransfersTest-23708117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:18 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-25ec5632-f281-4635-9e9c-fc943ec8bf7e tempest-VolumesTransfersTest-23708117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:52:18 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-25ec5632-f281-4635-9e9c-fc943ec8bf7e tempest-VolumesTransfersTest-23708117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:52:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-25ec5632-f281-4635-9e9c-fc943ec8bf7e tempest-VolumesTransfersTest-23708117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:18 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-25ec5632-f281-4635-9e9c-fc943ec8bf7e tempest-VolumesTransfersTest-23708117 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:52:18 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-25ec5632-f281-4635-9e9c-fc943ec8bf7e tempest-VolumesTransfersTest-23708117 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:52:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-25ec5632-f281-4635-9e9c-fc943ec8bf7e tempest-VolumesTransfersTest-23708117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4325fe4b-c683-496b-826e-295549c0d636 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7c34b720-dafc-440d-a4b4-373903ac8b36 tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b40d3db-9318-45f4-b382-69b5decc8702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b631746-495d-4ecc-b36d-1f35b609a969', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7c34b720-dafc-440d-a4b4-373903ac8b36 tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7ef0228-e841-48ac-bf33-1d65e0e56d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:18 devstack sudo[103266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4325fe4b-c683-496b-826e-295549c0d636 1073741824 Sep 10 16:52:18 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a0a31c2b-e6e5-4360-bf68-c29485709ede tempest-SnapshotDependencyTests-741204092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd804039-b606-4955-adf7-e4c6b0310efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-935174644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40ab28f6-0915-417e-b5f2-a5f6b8f1019d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87c4e7e64cf641ff9f118356bc8091f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:52:19Z,use_quota=True,user_id='cf0433446c854dddbce3e4657e4ec9d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a0a31c2b-e6e5-4360-bf68-c29485709ede tempest-SnapshotDependencyTests-741204092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec1e0e1-b702-4383-a10a-136bd5735f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a0a31c2b-e6e5-4360-bf68-c29485709ede tempest-SnapshotDependencyTests-741204092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec1e0e1-b702-4383-a10a-136bd5735f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a0a31c2b-e6e5-4360-bf68-c29485709ede tempest-SnapshotDependencyTests-741204092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ae66b56-f396-4333-a716-b21d504c23c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a0a31c2b-e6e5-4360-bf68-c29485709ede tempest-SnapshotDependencyTests-741204092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ae66b56-f396-4333-a716-b21d504c23c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40ab28f6-0915-417e-b5f2-a5f6b8f1019d', 'volume_name': 'volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a0a31c2b-e6e5-4360-bf68-c29485709ede tempest-SnapshotDependencyTests-741204092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8037f72-ca4d-4d5d-b8f4-7f8b7282d130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a0a31c2b-e6e5-4360-bf68-c29485709ede tempest-SnapshotDependencyTests-741204092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8037f72-ca4d-4d5d-b8f4-7f8b7282d130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a0a31c2b-e6e5-4360-bf68-c29485709ede tempest-SnapshotDependencyTests-741204092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e5738c7-dce3-4282-a55b-05ffaf9f9afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:19 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-a0a31c2b-e6e5-4360-bf68-c29485709ede tempest-SnapshotDependencyTests-741204092 None] Volume 40ab28f6-0915-417e-b5f2-a5f6b8f1019d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d', 'volume_size': 1} Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a0a31c2b-e6e5-4360-bf68-c29485709ede tempest-SnapshotDependencyTests-741204092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:19 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-7c34b720-dafc-440d-a4b4-373903ac8b36 tempest-ProjectReaderTests-2085471397 None] Volume volume-9b631746-495d-4ecc-b36d-1f35b609a969 (9b631746-495d-4ecc-b36d-1f35b609a969): created successfully Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7c34b720-dafc-440d-a4b4-373903ac8b36 tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7ef0228-e841-48ac-bf33-1d65e0e56d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7c34b720-dafc-440d-a4b4-373903ac8b36 tempest-ProjectReaderTests-2085471397 None] Flow 'volume_create_manager' (837a5b86-d747-4ab2-a3c7-40cac7fec5fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:52:19 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-7c34b720-dafc-440d-a4b4-373903ac8b36 tempest-ProjectReaderTests-2085471397 None] Created volume successfully. Sep 10 16:52:19 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-25ec5632-f281-4635-9e9c-fc943ec8bf7e tempest-VolumesTransfersTest-23708117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4325fe4b-c683-496b-826e-295549c0d636 1073741824" returned: 0 in 0.490s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-25ec5632-f281-4635-9e9c-fc943ec8bf7e tempest-VolumesTransfersTest-23708117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4325fe4b-c683-496b-826e-295549c0d636 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:19 devstack sudo[103272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4325fe4b-c683-496b-826e-295549c0d636 Sep 10 16:52:19 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-11fc308e-3840-412d-a898-a76327d1f30e tempest-ProjectReaderTests-2085471397 None] Acquiring lock "cinder-9b631746-495d-4ecc-b36d-1f35b609a969-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-11fc308e-3840-412d-a898-a76327d1f30e tempest-ProjectReaderTests-2085471397 None] Lock "cinder-9b631746-495d-4ecc-b36d-1f35b609a969-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:52:19 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-11fc308e-3840-412d-a898-a76327d1f30e tempest-ProjectReaderTests-2085471397 None] Acquiring lock "cinder-quobyte-9b631746-495d-4ecc-b36d-1f35b609a969" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-25ec5632-f281-4635-9e9c-fc943ec8bf7e tempest-VolumesTransfersTest-23708117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4325fe4b-c683-496b-826e-295549c0d636" returned: 0 in 0.348s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-25ec5632-f281-4635-9e9c-fc943ec8bf7e tempest-VolumesTransfersTest-23708117 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-25ec5632-f281-4635-9e9c-fc943ec8bf7e tempest-VolumesTransfersTest-23708117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a0a31c2b-e6e5-4360-bf68-c29485709ede tempest-SnapshotDependencyTests-741204092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.812s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-a0a31c2b-e6e5-4360-bf68-c29485709ede tempest-SnapshotDependencyTests-741204092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-935174644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40ab28f6-0915-417e-b5f2-a5f6b8f1019d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87c4e7e64cf641ff9f118356bc8091f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:52:19Z,use_quota=True,user_id='cf0433446c854dddbce3e4657e4ec9d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-a0a31c2b-e6e5-4360-bf68-c29485709ede tempest-SnapshotDependencyTests-741204092 None] Creating volume 40ab28f6-0915-417e-b5f2-a5f6b8f1019d {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a0a31c2b-e6e5-4360-bf68-c29485709ede tempest-SnapshotDependencyTests-741204092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a0a31c2b-e6e5-4360-bf68-c29485709ede tempest-SnapshotDependencyTests-741204092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-a0a31c2b-e6e5-4360-bf68-c29485709ede tempest-SnapshotDependencyTests-741204092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-a0a31c2b-e6e5-4360-bf68-c29485709ede tempest-SnapshotDependencyTests-741204092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a0a31c2b-e6e5-4360-bf68-c29485709ede tempest-SnapshotDependencyTests-741204092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-a0a31c2b-e6e5-4360-bf68-c29485709ede tempest-SnapshotDependencyTests-741204092 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:52:19 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-a0a31c2b-e6e5-4360-bf68-c29485709ede tempest-SnapshotDependencyTests-741204092 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a0a31c2b-e6e5-4360-bf68-c29485709ede tempest-SnapshotDependencyTests-741204092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-11fc308e-3840-412d-a898-a76327d1f30e tempest-ProjectReaderTests-2085471397 None] Lock "cinder-quobyte-9b631746-495d-4ecc-b36d-1f35b609a969" acquired by "delete_volume" :: waited 0.062s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:52:19 devstack sudo[103275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d 1073741824 Sep 10 16:52:19 devstack sudo[103275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-25ec5632-f281-4635-9e9c-fc943ec8bf7e tempest-VolumesTransfersTest-23708117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a104ad-236f-4d86-a9d6-eba12fb64190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4325fe4b-c683-496b-826e-295549c0d636', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-25ec5632-f281-4635-9e9c-fc943ec8bf7e tempest-VolumesTransfersTest-23708117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca46e5e1-daed-42ad-b1d0-219a0c7c5a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b69f397-2645-40ef-8053-131140a009a4]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-11fc308e-3840-412d-a898-a76327d1f30e tempest-ProjectReaderTests-2085471397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9b631746-495d-4ecc-b36d-1f35b609a969 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:19 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-25ec5632-f281-4635-9e9c-fc943ec8bf7e tempest-VolumesTransfersTest-23708117 None] Volume volume-4325fe4b-c683-496b-826e-295549c0d636 (4325fe4b-c683-496b-826e-295549c0d636): created successfully Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-25ec5632-f281-4635-9e9c-fc943ec8bf7e tempest-VolumesTransfersTest-23708117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca46e5e1-daed-42ad-b1d0-219a0c7c5a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-25ec5632-f281-4635-9e9c-fc943ec8bf7e tempest-VolumesTransfersTest-23708117 None] Flow 'volume_create_manager' (53abc7c6-d822-4e63-8de5-87bd50772396) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:52:20 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-25ec5632-f281-4635-9e9c-fc943ec8bf7e tempest-VolumesTransfersTest-23708117 None] Created volume successfully. Sep 10 16:52:20 devstack sudo[103277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9b631746-495d-4ecc-b36d-1f35b609a969 Sep 10 16:52:20 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:20 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-11fc308e-3840-412d-a898-a76327d1f30e tempest-ProjectReaderTests-2085471397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9b631746-495d-4ecc-b36d-1f35b609a969" returned: 0 in 0.497s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-11fc308e-3840-412d-a898-a76327d1f30e tempest-ProjectReaderTests-2085471397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9b631746-495d-4ecc-b36d-1f35b609a969 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:20 devstack sudo[103275]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a0a31c2b-e6e5-4360-bf68-c29485709ede tempest-SnapshotDependencyTests-741204092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d 1073741824" returned: 0 in 0.579s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:20 devstack sudo[103287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9b631746-495d-4ecc-b36d-1f35b609a969 Sep 10 16:52:20 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a0a31c2b-e6e5-4360-bf68-c29485709ede tempest-SnapshotDependencyTests-741204092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:20 devstack sudo[103289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d Sep 10 16:52:20 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:20 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-84a2d59d-28a2-4480-a97c-6d2417958674 tempest-VolumesTransfersTest-1418299085 None] Acquiring lock "cinder-4325fe4b-c683-496b-826e-295549c0d636-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:52:20 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-84a2d59d-28a2-4480-a97c-6d2417958674 tempest-VolumesTransfersTest-1418299085 None] Lock "cinder-4325fe4b-c683-496b-826e-295549c0d636-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:52:20 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-84a2d59d-28a2-4480-a97c-6d2417958674 tempest-VolumesTransfersTest-1418299085 None] Acquiring lock "cinder-quobyte-4325fe4b-c683-496b-826e-295549c0d636" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:52:20 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-84a2d59d-28a2-4480-a97c-6d2417958674 tempest-VolumesTransfersTest-1418299085 None] Lock "cinder-quobyte-4325fe4b-c683-496b-826e-295549c0d636" acquired by "delete_volume" :: waited 0.018s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:52:20 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b1df9b-8d3d-44a5-9ee3-4311516cdc04]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:52:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-84a2d59d-28a2-4480-a97c-6d2417958674 tempest-VolumesTransfersTest-1418299085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4325fe4b-c683-496b-826e-295549c0d636 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:20 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-11fc308e-3840-412d-a898-a76327d1f30e tempest-ProjectReaderTests-2085471397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9b631746-495d-4ecc-b36d-1f35b609a969" returned: 0 in 0.352s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:20 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a0a31c2b-e6e5-4360-bf68-c29485709ede tempest-SnapshotDependencyTests-741204092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d" returned: 0 in 0.294s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:20 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-a0a31c2b-e6e5-4360-bf68-c29485709ede tempest-SnapshotDependencyTests-741204092 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:52:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a0a31c2b-e6e5-4360-bf68-c29485709ede tempest-SnapshotDependencyTests-741204092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:20 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-11fc308e-3840-412d-a898-a76327d1f30e tempest-ProjectReaderTests-2085471397 None] Lock "cinder-quobyte-9b631746-495d-4ecc-b36d-1f35b609a969" released by "delete_volume" :: held 0.910s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:52:20 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a0a31c2b-e6e5-4360-bf68-c29485709ede tempest-SnapshotDependencyTests-741204092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e5738c7-dce3-4282-a55b-05ffaf9f9afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:20 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a0a31c2b-e6e5-4360-bf68-c29485709ede tempest-SnapshotDependencyTests-741204092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94dfe9c2-1c0a-476b-b5cd-b2922b86e4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:20 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-a0a31c2b-e6e5-4360-bf68-c29485709ede tempest-SnapshotDependencyTests-741204092 None] Volume volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d (40ab28f6-0915-417e-b5f2-a5f6b8f1019d): created successfully Sep 10 16:52:20 devstack sudo[103291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4325fe4b-c683-496b-826e-295549c0d636 Sep 10 16:52:20 devstack sudo[103291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:20 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a0a31c2b-e6e5-4360-bf68-c29485709ede tempest-SnapshotDependencyTests-741204092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94dfe9c2-1c0a-476b-b5cd-b2922b86e4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:20 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a0a31c2b-e6e5-4360-bf68-c29485709ede tempest-SnapshotDependencyTests-741204092 None] Flow 'volume_create_manager' (c4442135-1c5f-4b94-8f38-4811ce11c38f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:52:20 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-a0a31c2b-e6e5-4360-bf68-c29485709ede tempest-SnapshotDependencyTests-741204092 None] Created volume successfully. Sep 10 16:52:20 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-11fc308e-3840-412d-a898-a76327d1f30e tempest-ProjectReaderTests-2085471397 None] Created reservations ['b9caae67-c9d9-4645-915f-a07d71ab24af', 'b7dc577c-71d1-4d00-af30-f6eb3f811241', '9a34c738-50a1-4710-908d-7fc16e0c31e9', '5ff098f5-7aed-4f2c-a16e-184ffa8a758d'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:52:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-11fc308e-3840-412d-a898-a76327d1f30e tempest-ProjectReaderTests-2085471397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-11fc308e-3840-412d-a898-a76327d1f30e tempest-ProjectReaderTests-2085471397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:21 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-11fc308e-3840-412d-a898-a76327d1f30e tempest-ProjectReaderTests-2085471397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:52:21 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-11fc308e-3840-412d-a898-a76327d1f30e tempest-ProjectReaderTests-2085471397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:52:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-11fc308e-3840-412d-a898-a76327d1f30e tempest-ProjectReaderTests-2085471397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-11fc308e-3840-412d-a898-a76327d1f30e tempest-ProjectReaderTests-2085471397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:21 devstack sudo[103295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:52:21 devstack sudo[103295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:21 devstack sudo[103291]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-84a2d59d-28a2-4480-a97c-6d2417958674 tempest-VolumesTransfersTest-1418299085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4325fe4b-c683-496b-826e-295549c0d636" returned: 0 in 0.648s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-84a2d59d-28a2-4480-a97c-6d2417958674 tempest-VolumesTransfersTest-1418299085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4325fe4b-c683-496b-826e-295549c0d636 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:21 devstack sudo[103295]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-11fc308e-3840-412d-a898-a76327d1f30e tempest-ProjectReaderTests-2085471397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.343s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:21 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-11fc308e-3840-412d-a898-a76327d1f30e tempest-ProjectReaderTests-2085471397 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:52:21 devstack sudo[103301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4325fe4b-c683-496b-826e-295549c0d636 Sep 10 16:52:21 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:21 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-11fc308e-3840-412d-a898-a76327d1f30e tempest-ProjectReaderTests-2085471397 None] Deleted volume successfully. Sep 10 16:52:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-11fc308e-3840-412d-a898-a76327d1f30e tempest-ProjectReaderTests-2085471397 None] Lock "cinder-9b631746-495d-4ecc-b36d-1f35b609a969-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:52:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-bc39f257-49ea-42e1-a458-28dc318f2721 tempest-SnapshotDependencyTests-741204092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-bc39f257-49ea-42e1-a458-28dc318f2721 tempest-SnapshotDependencyTests-741204092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:21 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-bc39f257-49ea-42e1-a458-28dc318f2721 tempest-SnapshotDependencyTests-741204092 None] Creating offline snapshot 892aee84-02d0-42f5-ad19-ffe8f05f23bf of volume 40ab28f6-0915-417e-b5f2-a5f6b8f1019d {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:52:21 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e116f0-8d3f-4962-9c38-c7ef4ebc2b40]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:52:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bc39f257-49ea-42e1-a458-28dc318f2721 tempest-SnapshotDependencyTests-741204092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:21 devstack sudo[103303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d Sep 10 16:52:21 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:21 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-84a2d59d-28a2-4480-a97c-6d2417958674 tempest-VolumesTransfersTest-1418299085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4325fe4b-c683-496b-826e-295549c0d636" returned: 0 in 0.315s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-84a2d59d-28a2-4480-a97c-6d2417958674 tempest-VolumesTransfersTest-1418299085 None] Lock "cinder-quobyte-4325fe4b-c683-496b-826e-295549c0d636" released by "delete_volume" :: held 1.029s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:52:21 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-84a2d59d-28a2-4480-a97c-6d2417958674 tempest-VolumesTransfersTest-1418299085 None] Created reservations ['ed018e4a-b6c4-49f3-82f7-12523513c3f9', '88ec914b-514a-409f-a5ed-ceb520fb5ecf', '148bec05-a125-440a-8e80-8a0a6da1d9c4', 'd26b0bc8-8acc-418b-abe2-b11d4e60f719'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:52:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-84a2d59d-28a2-4480-a97c-6d2417958674 tempest-VolumesTransfersTest-1418299085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-84a2d59d-28a2-4480-a97c-6d2417958674 tempest-VolumesTransfersTest-1418299085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:21 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-84a2d59d-28a2-4480-a97c-6d2417958674 tempest-VolumesTransfersTest-1418299085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:52:21 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:21 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-84a2d59d-28a2-4480-a97c-6d2417958674 tempest-VolumesTransfersTest-1418299085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:52:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-84a2d59d-28a2-4480-a97c-6d2417958674 tempest-VolumesTransfersTest-1418299085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-84a2d59d-28a2-4480-a97c-6d2417958674 tempest-VolumesTransfersTest-1418299085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bc39f257-49ea-42e1-a458-28dc318f2721 tempest-SnapshotDependencyTests-741204092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d" returned: 0 in 0.404s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bc39f257-49ea-42e1-a458-28dc318f2721 tempest-SnapshotDependencyTests-741204092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d.892aee84-02d0-42f5-ad19-ffe8f05f23bf 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:21 devstack sudo[103309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:52:21 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:21 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d.892aee84-02d0-42f5-ad19-ffe8f05f23bf 1G Sep 10 16:52:21 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:22 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-84a2d59d-28a2-4480-a97c-6d2417958674 tempest-VolumesTransfersTest-1418299085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.395s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:22 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-84a2d59d-28a2-4480-a97c-6d2417958674 tempest-VolumesTransfersTest-1418299085 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:52:22 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-84a2d59d-28a2-4480-a97c-6d2417958674 tempest-VolumesTransfersTest-1418299085 None] Deleted volume successfully. Sep 10 16:52:22 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-84a2d59d-28a2-4480-a97c-6d2417958674 tempest-VolumesTransfersTest-1418299085 None] Lock "cinder-4325fe4b-c683-496b-826e-295549c0d636-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:52:22 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bc39f257-49ea-42e1-a458-28dc318f2721 tempest-SnapshotDependencyTests-741204092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d.892aee84-02d0-42f5-ad19-ffe8f05f23bf 1G" returned: 0 in 0.681s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bc39f257-49ea-42e1-a458-28dc318f2721 tempest-SnapshotDependencyTests-741204092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d.892aee84-02d0-42f5-ad19-ffe8f05f23bf {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:22 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d.892aee84-02d0-42f5-ad19-ffe8f05f23bf Sep 10 16:52:22 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:22 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5383aa3-b9e1-4bf6-8e92-0dfcbd81acde tempest-ProjectReaderTests-2085471397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:52:22 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f5383aa3-b9e1-4bf6-8e92-0dfcbd81acde tempest-ProjectReaderTests-2085471397 None] Flow 'volume_create_manager' (8ad60696-9e37-4110-be16-d27c19fc6be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:52:22 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f5383aa3-b9e1-4bf6-8e92-0dfcbd81acde tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da5a54f-8a9b-452c-9826-a9c44a634763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:22 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f5383aa3-b9e1-4bf6-8e92-0dfcbd81acde tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da5a54f-8a9b-452c-9826-a9c44a634763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-284708915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44996459-b0f2-47ad-859e-094c740607f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='585a38fa0bda4d9c8c012c1b84cb2259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:52:23Z,use_quota=True,user_id='c1919ff8ae2c408e985681d873412f0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:22 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f5383aa3-b9e1-4bf6-8e92-0dfcbd81acde tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad11d4d-7788-4469-990d-22546e366ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:22 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f5383aa3-b9e1-4bf6-8e92-0dfcbd81acde tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad11d4d-7788-4469-990d-22546e366ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:22 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f5383aa3-b9e1-4bf6-8e92-0dfcbd81acde tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec914927-100c-4cba-879e-b167d4475cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:22 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f5383aa3-b9e1-4bf6-8e92-0dfcbd81acde tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec914927-100c-4cba-879e-b167d4475cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44996459-b0f2-47ad-859e-094c740607f1', 'volume_name': 'volume-44996459-b0f2-47ad-859e-094c740607f1', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:22 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f5383aa3-b9e1-4bf6-8e92-0dfcbd81acde tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (530bf742-0af8-478b-8380-dda4244e3c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:22 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f5383aa3-b9e1-4bf6-8e92-0dfcbd81acde tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (530bf742-0af8-478b-8380-dda4244e3c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:22 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f5383aa3-b9e1-4bf6-8e92-0dfcbd81acde tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acc042ca-2b6e-4de6-9be2-6efa344ca073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:22 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-f5383aa3-b9e1-4bf6-8e92-0dfcbd81acde tempest-ProjectReaderTests-2085471397 None] Volume 44996459-b0f2-47ad-859e-094c740607f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44996459-b0f2-47ad-859e-094c740607f1', 'volume_size': 1} Sep 10 16:52:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f5383aa3-b9e1-4bf6-8e92-0dfcbd81acde tempest-ProjectReaderTests-2085471397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:23 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bc39f257-49ea-42e1-a458-28dc318f2721 tempest-SnapshotDependencyTests-741204092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d.892aee84-02d0-42f5-ad19-ffe8f05f23bf" returned: 0 in 0.436s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:23 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-bc39f257-49ea-42e1-a458-28dc318f2721 tempest-SnapshotDependencyTests-741204092 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d.892aee84-02d0-42f5-ad19-ffe8f05f23bf is being set with open permissions: ugo+rw Sep 10 16:52:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bc39f257-49ea-42e1-a458-28dc318f2721 tempest-SnapshotDependencyTests-741204092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d.892aee84-02d0-42f5-ad19-ffe8f05f23bf {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:23 devstack sudo[103325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d.892aee84-02d0-42f5-ad19-ffe8f05f23bf Sep 10 16:52:23 devstack sudo[103325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:23 devstack sudo[103325]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bc39f257-49ea-42e1-a458-28dc318f2721 tempest-SnapshotDependencyTests-741204092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d.892aee84-02d0-42f5-ad19-ffe8f05f23bf" returned: 0 in 0.324s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bc39f257-49ea-42e1-a458-28dc318f2721 tempest-SnapshotDependencyTests-741204092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:23 devstack sudo[103328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d.info Sep 10 16:52:23 devstack sudo[103328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:23 devstack sudo[103328]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bc39f257-49ea-42e1-a458-28dc318f2721 tempest-SnapshotDependencyTests-741204092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d.info" returned: 0 in 0.316s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:23 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-bc39f257-49ea-42e1-a458-28dc318f2721 tempest-SnapshotDependencyTests-741204092 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d.info is being set with open permissions: ugo+rw Sep 10 16:52:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bc39f257-49ea-42e1-a458-28dc318f2721 tempest-SnapshotDependencyTests-741204092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:23 devstack sudo[103331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d.info Sep 10 16:52:23 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:24 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bc39f257-49ea-42e1-a458-28dc318f2721 tempest-SnapshotDependencyTests-741204092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d.info" returned: 0 in 0.285s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-bc39f257-49ea-42e1-a458-28dc318f2721 tempest-SnapshotDependencyTests-741204092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.571s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f5383aa3-b9e1-4bf6-8e92-0dfcbd81acde tempest-ProjectReaderTests-2085471397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.167s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:24 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f5383aa3-b9e1-4bf6-8e92-0dfcbd81acde tempest-ProjectReaderTests-2085471397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-284708915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44996459-b0f2-47ad-859e-094c740607f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='585a38fa0bda4d9c8c012c1b84cb2259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:52:23Z,use_quota=True,user_id='c1919ff8ae2c408e985681d873412f0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:52:24 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-f5383aa3-b9e1-4bf6-8e92-0dfcbd81acde tempest-ProjectReaderTests-2085471397 None] Creating volume 44996459-b0f2-47ad-859e-094c740607f1 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:52:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f5383aa3-b9e1-4bf6-8e92-0dfcbd81acde tempest-ProjectReaderTests-2085471397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f5383aa3-b9e1-4bf6-8e92-0dfcbd81acde tempest-ProjectReaderTests-2085471397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:24 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f5383aa3-b9e1-4bf6-8e92-0dfcbd81acde tempest-ProjectReaderTests-2085471397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:52:24 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f5383aa3-b9e1-4bf6-8e92-0dfcbd81acde tempest-ProjectReaderTests-2085471397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:52:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f5383aa3-b9e1-4bf6-8e92-0dfcbd81acde tempest-ProjectReaderTests-2085471397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:24 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f5383aa3-b9e1-4bf6-8e92-0dfcbd81acde tempest-ProjectReaderTests-2085471397 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:52:24 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-f5383aa3-b9e1-4bf6-8e92-0dfcbd81acde tempest-ProjectReaderTests-2085471397 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:52:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f5383aa3-b9e1-4bf6-8e92-0dfcbd81acde tempest-ProjectReaderTests-2085471397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-44996459-b0f2-47ad-859e-094c740607f1 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:24 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-44996459-b0f2-47ad-859e-094c740607f1 1073741824 Sep 10 16:52:24 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:24 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-bc39f257-49ea-42e1-a458-28dc318f2721 tempest-SnapshotDependencyTests-741204092 None] Create snapshot completed successfully Sep 10 16:52:24 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f5383aa3-b9e1-4bf6-8e92-0dfcbd81acde tempest-ProjectReaderTests-2085471397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-44996459-b0f2-47ad-859e-094c740607f1 1073741824" returned: 0 in 0.615s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f5383aa3-b9e1-4bf6-8e92-0dfcbd81acde tempest-ProjectReaderTests-2085471397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-44996459-b0f2-47ad-859e-094c740607f1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:24 devstack sudo[103340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-44996459-b0f2-47ad-859e-094c740607f1 Sep 10 16:52:24 devstack sudo[103340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:25 devstack sudo[103340]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f5383aa3-b9e1-4bf6-8e92-0dfcbd81acde tempest-ProjectReaderTests-2085471397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-44996459-b0f2-47ad-859e-094c740607f1" returned: 0 in 0.343s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f5383aa3-b9e1-4bf6-8e92-0dfcbd81acde tempest-ProjectReaderTests-2085471397 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f5383aa3-b9e1-4bf6-8e92-0dfcbd81acde tempest-ProjectReaderTests-2085471397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f5383aa3-b9e1-4bf6-8e92-0dfcbd81acde tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acc042ca-2b6e-4de6-9be2-6efa344ca073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44996459-b0f2-47ad-859e-094c740607f1', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f5383aa3-b9e1-4bf6-8e92-0dfcbd81acde tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd430673-0b0c-4eff-8660-eaf05cf42857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:25 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-f5383aa3-b9e1-4bf6-8e92-0dfcbd81acde tempest-ProjectReaderTests-2085471397 None] Volume volume-44996459-b0f2-47ad-859e-094c740607f1 (44996459-b0f2-47ad-859e-094c740607f1): created successfully Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f5383aa3-b9e1-4bf6-8e92-0dfcbd81acde tempest-ProjectReaderTests-2085471397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd430673-0b0c-4eff-8660-eaf05cf42857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f5383aa3-b9e1-4bf6-8e92-0dfcbd81acde tempest-ProjectReaderTests-2085471397 None] Flow 'volume_create_manager' (8ad60696-9e37-4110-be16-d27c19fc6be5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:52:25 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-f5383aa3-b9e1-4bf6-8e92-0dfcbd81acde tempest-ProjectReaderTests-2085471397 None] Created volume successfully. Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Flow 'volume_create_manager' (e022f344-803f-4ba3-8db7-1c54cdbb174f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da2dfa7-11df-4fc9-a992-60a0ad2b3d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da2dfa7-11df-4fc9-a992-60a0ad2b3d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a64523d0-24f1-4dd9-9dd5-2351f5596c9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87c4e7e64cf641ff9f118356bc8091f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=892aee84-02d0-42f5-ad19-ffe8f05f23bf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:52:26Z,use_quota=True,user_id='cf0433446c854dddbce3e4657e4ec9d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71c1e0eb-1888-4b5b-a610-85782b470b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71c1e0eb-1888-4b5b-a610-85782b470b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48d48af1-4189-469a-bfa4-c1e9c4304674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48d48af1-4189-469a-bfa4-c1e9c4304674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a64523d0-24f1-4dd9-9dd5-2351f5596c9f', 'volume_name': 'volume-a64523d0-24f1-4dd9-9dd5-2351f5596c9f', 'volume_size': 1, 'snapshot_id': '892aee84-02d0-42f5-ad19-ffe8f05f23bf'}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b9e444-9a6e-488f-9d41-de8dacad7229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b9e444-9a6e-488f-9d41-de8dacad7229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44fe9ca1-7404-481f-846f-a4942f326380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:25 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Volume a64523d0-24f1-4dd9-9dd5-2351f5596c9f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a64523d0-24f1-4dd9-9dd5-2351f5596c9f', 'volume_size': 1, 'snapshot_id': '892aee84-02d0-42f5-ad19-ffe8f05f23bf'} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Acquiring lock "cinder-quobyte-892aee84-02d0-42f5-ad19-ffe8f05f23bf-a64523d0-24f1-4dd9-9dd5-2351f5596c9f" by "_create_volume_from_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Lock "cinder-quobyte-892aee84-02d0-42f5-ad19-ffe8f05f23bf-a64523d0-24f1-4dd9-9dd5-2351f5596c9f" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Creating volume a64523d0-24f1-4dd9-9dd5-2351f5596c9f from snapshot 892aee84-02d0-42f5-ad19-ffe8f05f23bf {{(pid=88189) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Acquiring lock "cinder-quobyte-a64523d0-24f1-4dd9-9dd5-2351f5596c9f" by "_copy_volume_from_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Lock "cinder-quobyte-a64523d0-24f1-4dd9-9dd5-2351f5596c9f" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] snapshot: 892aee84-02d0-42f5-ad19-ffe8f05f23bf, volume: a64523d0-24f1-4dd9-9dd5-2351f5596c9f, {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fee0bd-392c-4d89-a50f-793039da7812]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:52:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d.892aee84-02d0-42f5-ad19-ffe8f05f23bf {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:26 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-10245964-404f-4ecd-abd6-65efe3894f3a tempest-ProjectReaderTests-2085471397 None] Acquiring lock "cinder-44996459-b0f2-47ad-859e-094c740607f1-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:52:26 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-10245964-404f-4ecd-abd6-65efe3894f3a tempest-ProjectReaderTests-2085471397 None] Lock "cinder-44996459-b0f2-47ad-859e-094c740607f1-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:52:26 devstack sudo[103349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d.892aee84-02d0-42f5-ad19-ffe8f05f23bf Sep 10 16:52:26 devstack sudo[103349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:26 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-10245964-404f-4ecd-abd6-65efe3894f3a tempest-ProjectReaderTests-2085471397 None] Acquiring lock "cinder-quobyte-44996459-b0f2-47ad-859e-094c740607f1" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:52:26 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-10245964-404f-4ecd-abd6-65efe3894f3a tempest-ProjectReaderTests-2085471397 None] Lock "cinder-quobyte-44996459-b0f2-47ad-859e-094c740607f1" acquired by "delete_volume" :: waited 0.023s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:52:26 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e5d633-b0ad-459e-9d4d-3aea55030a07]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:52:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-10245964-404f-4ecd-abd6-65efe3894f3a tempest-ProjectReaderTests-2085471397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-44996459-b0f2-47ad-859e-094c740607f1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:26 devstack sudo[103351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-44996459-b0f2-47ad-859e-094c740607f1 Sep 10 16:52:26 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:26 devstack sudo[103349]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d.892aee84-02d0-42f5-ad19-ffe8f05f23bf" returned: 0 in 0.706s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:52:26 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[49544fd9-e992-4860-a087-dc6607a976d7]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:52:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:26 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-10245964-404f-4ecd-abd6-65efe3894f3a tempest-ProjectReaderTests-2085471397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-44996459-b0f2-47ad-859e-094c740607f1" returned: 0 in 0.519s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-10245964-404f-4ecd-abd6-65efe3894f3a tempest-ProjectReaderTests-2085471397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-44996459-b0f2-47ad-859e-094c740607f1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:26 devstack sudo[103358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d Sep 10 16:52:26 devstack sudo[103358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:26 devstack sudo[103360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-44996459-b0f2-47ad-859e-094c740607f1 Sep 10 16:52:26 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:27 devstack sudo[103358]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d" returned: 0 in 0.455s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] will copy from snapshot at /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 16:52:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Creating direct copy from snapshot {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 16:52:27 devstack cinder-volume[88189]: DEBUG cinder.utils [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Path /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a64523d0-24f1-4dd9-9dd5-2351f5596c9f not found in is_blk_device check {{(pid=88189) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 16:52:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a64523d0-24f1-4dd9-9dd5-2351f5596c9f {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:27 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-10245964-404f-4ecd-abd6-65efe3894f3a tempest-ProjectReaderTests-2085471397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-44996459-b0f2-47ad-859e-094c740607f1" returned: 0 in 0.400s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:27 devstack sudo[103367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a64523d0-24f1-4dd9-9dd5-2351f5596c9f Sep 10 16:52:27 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:27 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-10245964-404f-4ecd-abd6-65efe3894f3a tempest-ProjectReaderTests-2085471397 None] Lock "cinder-quobyte-44996459-b0f2-47ad-859e-094c740607f1" released by "delete_volume" :: held 0.985s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:52:27 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-10245964-404f-4ecd-abd6-65efe3894f3a tempest-ProjectReaderTests-2085471397 None] Created reservations ['0b252216-6758-466d-afe7-790c13cd6c58', '7b87eed3-f93d-4921-9019-1b0f9070ac88', '9083a458-7e84-4bbe-9042-5921b5aa61ac', 'c2ccdd17-8910-47fe-a959-847278f10c2a'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:52:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-10245964-404f-4ecd-abd6-65efe3894f3a tempest-ProjectReaderTests-2085471397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-10245964-404f-4ecd-abd6-65efe3894f3a tempest-ProjectReaderTests-2085471397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-10245964-404f-4ecd-abd6-65efe3894f3a tempest-ProjectReaderTests-2085471397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:52:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-10245964-404f-4ecd-abd6-65efe3894f3a tempest-ProjectReaderTests-2085471397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:52:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-10245964-404f-4ecd-abd6-65efe3894f3a tempest-ProjectReaderTests-2085471397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-10245964-404f-4ecd-abd6-65efe3894f3a tempest-ProjectReaderTests-2085471397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:27 devstack sudo[103369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:52:27 devstack sudo[103369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:27 devstack sudo[103369]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-10245964-404f-4ecd-abd6-65efe3894f3a tempest-ProjectReaderTests-2085471397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.367s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:27 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-10245964-404f-4ecd-abd6-65efe3894f3a tempest-ProjectReaderTests-2085471397 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:52:27 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-10245964-404f-4ecd-abd6-65efe3894f3a tempest-ProjectReaderTests-2085471397 None] Deleted volume successfully. Sep 10 16:52:27 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-10245964-404f-4ecd-abd6-65efe3894f3a tempest-ProjectReaderTests-2085471397 None] Lock "cinder-44996459-b0f2-47ad-859e-094c740607f1-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:52:33 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a64523d0-24f1-4dd9-9dd5-2351f5596c9f" returned: 0 in 6.375s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:33 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Image conversion details: src /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d, size 1024.00 MB, duration 6.38 sec, destination /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a64523d0-24f1-4dd9-9dd5-2351f5596c9f {{(pid=88189) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 16:52:33 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Converted 1024.00 MB image at 160.58 MB/s Sep 10 16:52:33 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a64523d0-24f1-4dd9-9dd5-2351f5596c9f is being set with open permissions: ugo+rw Sep 10 16:52:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a64523d0-24f1-4dd9-9dd5-2351f5596c9f {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:33 devstack sudo[103384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a64523d0-24f1-4dd9-9dd5-2351f5596c9f Sep 10 16:52:33 devstack sudo[103384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:33 devstack sudo[103384]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a64523d0-24f1-4dd9-9dd5-2351f5596c9f" returned: 0 in 0.283s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:33 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Lock "cinder-quobyte-a64523d0-24f1-4dd9-9dd5-2351f5596c9f" released by "_copy_volume_from_snapshot" :: held 7.946s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:52:33 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Lock "cinder-quobyte-892aee84-02d0-42f5-ad19-ffe8f05f23bf-a64523d0-24f1-4dd9-9dd5-2351f5596c9f" released by "_create_volume_from_snapshot" :: held 8.044s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:52:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.062s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44fe9ca1-7404-481f-846f-a4942f326380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a64523d0-24f1-4dd9-9dd5-2351f5596c9f', 'volume_size': 1, 'snapshot_id': '892aee84-02d0-42f5-ad19-ffe8f05f23bf'}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da039657-1e9d-4f31-ae6b-339ac8d1e3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:33 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Volume volume-a64523d0-24f1-4dd9-9dd5-2351f5596c9f (a64523d0-24f1-4dd9-9dd5-2351f5596c9f): created successfully Sep 10 16:52:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da039657-1e9d-4f31-ae6b-339ac8d1e3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Flow 'volume_create_manager' (e022f344-803f-4ba3-8db7-1c54cdbb174f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:52:34 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-d2fa4e2d-2da8-4e10-9019-38de22ac5d21 tempest-SnapshotDependencyTests-741204092 None] Created volume successfully. Sep 10 16:52:34 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b641aad5-b602-472f-b1b6-69adad0ce200 tempest-SnapshotDependencyTests-741204092 None] Acquiring lock "cinder-892aee84-02d0-42f5-ad19-ffe8f05f23bf-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:52:34 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b641aad5-b602-472f-b1b6-69adad0ce200 tempest-SnapshotDependencyTests-741204092 None] Lock "cinder-892aee84-02d0-42f5-ad19-ffe8f05f23bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:52:34 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b641aad5-b602-472f-b1b6-69adad0ce200 tempest-SnapshotDependencyTests-741204092 None] Acquiring lock "cinder-quobyte-40ab28f6-0915-417e-b5f2-a5f6b8f1019d" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:52:34 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b641aad5-b602-472f-b1b6-69adad0ce200 tempest-SnapshotDependencyTests-741204092 None] Lock "cinder-quobyte-40ab28f6-0915-417e-b5f2-a5f6b8f1019d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:52:34 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b641aad5-b602-472f-b1b6-69adad0ce200 tempest-SnapshotDependencyTests-741204092 None] Acquiring lock "cinder-quobyte-892aee84-02d0-42f5-ad19-ffe8f05f23bf" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:52:34 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b641aad5-b602-472f-b1b6-69adad0ce200 tempest-SnapshotDependencyTests-741204092 None] Lock "cinder-quobyte-892aee84-02d0-42f5-ad19-ffe8f05f23bf" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:52:34 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-b641aad5-b602-472f-b1b6-69adad0ce200 tempest-SnapshotDependencyTests-741204092 None] Deleting offline snapshot 892aee84-02d0-42f5-ad19-ffe8f05f23bf of volume 40ab28f6-0915-417e-b5f2-a5f6b8f1019d {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:52:34 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-b641aad5-b602-472f-b1b6-69adad0ce200 tempest-SnapshotDependencyTests-741204092 None] snapshot_file for this snap is: volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d.892aee84-02d0-42f5-ad19-ffe8f05f23bf {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:52:34 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4254043b-707c-4f34-8b15-ba233a6709b7]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:52:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b641aad5-b602-472f-b1b6-69adad0ce200 tempest-SnapshotDependencyTests-741204092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d.892aee84-02d0-42f5-ad19-ffe8f05f23bf {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:35 devstack sudo[103387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d.892aee84-02d0-42f5-ad19-ffe8f05f23bf Sep 10 16:52:35 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:35 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b641aad5-b602-472f-b1b6-69adad0ce200 tempest-SnapshotDependencyTests-741204092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d.892aee84-02d0-42f5-ad19-ffe8f05f23bf" returned: 0 in 0.421s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:35 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-b641aad5-b602-472f-b1b6-69adad0ce200 tempest-SnapshotDependencyTests-741204092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:52:35 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e67902-d2d2-4abb-b610-5277918613bf]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:52:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b641aad5-b602-472f-b1b6-69adad0ce200 tempest-SnapshotDependencyTests-741204092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:35 devstack sudo[103393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d Sep 10 16:52:35 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:36 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b641aad5-b602-472f-b1b6-69adad0ce200 tempest-SnapshotDependencyTests-741204092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d" returned: 0 in 0.646s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b641aad5-b602-472f-b1b6-69adad0ce200 tempest-SnapshotDependencyTests-741204092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d.892aee84-02d0-42f5-ad19-ffe8f05f23bf {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:36 devstack sudo[103398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d.892aee84-02d0-42f5-ad19-ffe8f05f23bf Sep 10 16:52:36 devstack sudo[103398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:36 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-66661b10-659f-4673-ab53-dc269d7f996b tempest-VolumesGetTest-2060595714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:52:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-66661b10-659f-4673-ab53-dc269d7f996b tempest-VolumesGetTest-2060595714 None] Flow 'volume_create_manager' (20104f26-d0b8-4f12-9181-3c05ced0e427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:52:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-66661b10-659f-4673-ab53-dc269d7f996b tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fabf642-1dc4-4dc3-8e01-dc6e84c840fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-66661b10-659f-4673-ab53-dc269d7f996b tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fabf642-1dc4-4dc3-8e01-dc6e84c840fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-341304356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53eb9d1f-b5ac-4b05-a3b0-7d807fbc96de,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='842073a1662740d5a7d0a4150349dc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:52:36Z,use_quota=True,user_id='c67a14f8b0464a299ebeb3caef9a0947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-66661b10-659f-4673-ab53-dc269d7f996b tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba18f97-b384-46c0-b977-105b2dba8fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-66661b10-659f-4673-ab53-dc269d7f996b tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba18f97-b384-46c0-b977-105b2dba8fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-66661b10-659f-4673-ab53-dc269d7f996b tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a63955d7-ee48-4425-8266-cf1829064859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-66661b10-659f-4673-ab53-dc269d7f996b tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a63955d7-ee48-4425-8266-cf1829064859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53eb9d1f-b5ac-4b05-a3b0-7d807fbc96de', 'volume_name': 'volume-53eb9d1f-b5ac-4b05-a3b0-7d807fbc96de', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-66661b10-659f-4673-ab53-dc269d7f996b tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a238c774-34af-4f7e-b77e-1a9d0eae97bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-66661b10-659f-4673-ab53-dc269d7f996b tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a238c774-34af-4f7e-b77e-1a9d0eae97bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-66661b10-659f-4673-ab53-dc269d7f996b tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a786a92f-fd86-4df7-9b28-894887a6c33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:36 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-66661b10-659f-4673-ab53-dc269d7f996b tempest-VolumesGetTest-2060595714 None] Volume 53eb9d1f-b5ac-4b05-a3b0-7d807fbc96de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53eb9d1f-b5ac-4b05-a3b0-7d807fbc96de', 'volume_size': 1} Sep 10 16:52:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-66661b10-659f-4673-ab53-dc269d7f996b tempest-VolumesGetTest-2060595714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-66661b10-659f-4673-ab53-dc269d7f996b tempest-VolumesGetTest-2060595714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:36 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-66661b10-659f-4673-ab53-dc269d7f996b tempest-VolumesGetTest-2060595714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-341304356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53eb9d1f-b5ac-4b05-a3b0-7d807fbc96de,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='842073a1662740d5a7d0a4150349dc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:52:36Z,use_quota=True,user_id='c67a14f8b0464a299ebeb3caef9a0947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:52:36 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-66661b10-659f-4673-ab53-dc269d7f996b tempest-VolumesGetTest-2060595714 None] Creating volume 53eb9d1f-b5ac-4b05-a3b0-7d807fbc96de {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:52:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-66661b10-659f-4673-ab53-dc269d7f996b tempest-VolumesGetTest-2060595714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-66661b10-659f-4673-ab53-dc269d7f996b tempest-VolumesGetTest-2060595714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:36 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-66661b10-659f-4673-ab53-dc269d7f996b tempest-VolumesGetTest-2060595714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:52:36 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-66661b10-659f-4673-ab53-dc269d7f996b tempest-VolumesGetTest-2060595714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:52:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-66661b10-659f-4673-ab53-dc269d7f996b tempest-VolumesGetTest-2060595714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:36 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-66661b10-659f-4673-ab53-dc269d7f996b tempest-VolumesGetTest-2060595714 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:52:36 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-66661b10-659f-4673-ab53-dc269d7f996b tempest-VolumesGetTest-2060595714 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:52:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-66661b10-659f-4673-ab53-dc269d7f996b tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53eb9d1f-b5ac-4b05-a3b0-7d807fbc96de 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:36 devstack sudo[103400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53eb9d1f-b5ac-4b05-a3b0-7d807fbc96de 1073741824 Sep 10 16:52:36 devstack sudo[103400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:36 devstack sudo[103398]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b641aad5-b602-472f-b1b6-69adad0ce200 tempest-SnapshotDependencyTests-741204092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d.892aee84-02d0-42f5-ad19-ffe8f05f23bf" returned: 0 in 0.396s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b641aad5-b602-472f-b1b6-69adad0ce200 tempest-SnapshotDependencyTests-741204092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d.892aee84-02d0-42f5-ad19-ffe8f05f23bf {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:36 devstack sudo[103405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d.892aee84-02d0-42f5-ad19-ffe8f05f23bf Sep 10 16:52:36 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:36 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b641aad5-b602-472f-b1b6-69adad0ce200 tempest-SnapshotDependencyTests-741204092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d.892aee84-02d0-42f5-ad19-ffe8f05f23bf" returned: 0 in 0.291s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:36 devstack sudo[103400]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-66661b10-659f-4673-ab53-dc269d7f996b tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53eb9d1f-b5ac-4b05-a3b0-7d807fbc96de 1073741824" returned: 0 in 0.542s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b641aad5-b602-472f-b1b6-69adad0ce200 tempest-SnapshotDependencyTests-741204092 None] Lock "cinder-quobyte-892aee84-02d0-42f5-ad19-ffe8f05f23bf" released by "_delete_snapshot" :: held 1.877s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:52:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b641aad5-b602-472f-b1b6-69adad0ce200 tempest-SnapshotDependencyTests-741204092 None] Lock "cinder-quobyte-40ab28f6-0915-417e-b5f2-a5f6b8f1019d" released by "delete_snapshot" :: held 1.909s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:52:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-66661b10-659f-4673-ab53-dc269d7f996b tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53eb9d1f-b5ac-4b05-a3b0-7d807fbc96de {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:36 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-b641aad5-b602-472f-b1b6-69adad0ce200 tempest-SnapshotDependencyTests-741204092 None] Created reservations ['87024b38-afa4-499a-815c-4a814da497e7', 'c8601eef-a9c1-4aaa-91b2-9869a71dae2a', '7d444744-bab6-4d37-bf7a-2804026a5de2', 'd2369256-d095-47ac-afed-c75eb13ba22a'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:52:36 devstack sudo[103412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53eb9d1f-b5ac-4b05-a3b0-7d807fbc96de Sep 10 16:52:36 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:36 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-b641aad5-b602-472f-b1b6-69adad0ce200 tempest-SnapshotDependencyTests-741204092 None] Delete snapshot completed successfully. Sep 10 16:52:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b641aad5-b602-472f-b1b6-69adad0ce200 tempest-SnapshotDependencyTests-741204092 None] Lock "cinder-892aee84-02d0-42f5-ad19-ffe8f05f23bf-delete_snapshot" released by "delete_snapshot" :: held 2.072s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:52:37 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5a7338da-4460-4914-b6f1-514039b4f7db tempest-SnapshotDependencyTests-741204092 None] Acquiring lock "cinder-40ab28f6-0915-417e-b5f2-a5f6b8f1019d-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:52:37 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5a7338da-4460-4914-b6f1-514039b4f7db tempest-SnapshotDependencyTests-741204092 None] Lock "cinder-40ab28f6-0915-417e-b5f2-a5f6b8f1019d-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:52:37 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5a7338da-4460-4914-b6f1-514039b4f7db tempest-SnapshotDependencyTests-741204092 None] Acquiring lock "cinder-quobyte-40ab28f6-0915-417e-b5f2-a5f6b8f1019d" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:52:37 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-66661b10-659f-4673-ab53-dc269d7f996b tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53eb9d1f-b5ac-4b05-a3b0-7d807fbc96de" returned: 0 in 0.429s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:37 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-66661b10-659f-4673-ab53-dc269d7f996b tempest-VolumesGetTest-2060595714 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:52:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-66661b10-659f-4673-ab53-dc269d7f996b tempest-VolumesGetTest-2060595714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:37 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5a7338da-4460-4914-b6f1-514039b4f7db tempest-SnapshotDependencyTests-741204092 None] Lock "cinder-quobyte-40ab28f6-0915-417e-b5f2-a5f6b8f1019d" acquired by "delete_volume" :: waited 0.044s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:52:37 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-66661b10-659f-4673-ab53-dc269d7f996b tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a786a92f-fd86-4df7-9b28-894887a6c33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53eb9d1f-b5ac-4b05-a3b0-7d807fbc96de', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:37 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-66661b10-659f-4673-ab53-dc269d7f996b tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (927edb1f-82bc-48a9-ba65-044bc793c087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:37 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa337e5-7ce3-4a70-ac8f-4e1edd874d2e]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:52:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5a7338da-4460-4914-b6f1-514039b4f7db tempest-SnapshotDependencyTests-741204092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:37 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-66661b10-659f-4673-ab53-dc269d7f996b tempest-VolumesGetTest-2060595714 None] Volume volume-53eb9d1f-b5ac-4b05-a3b0-7d807fbc96de (53eb9d1f-b5ac-4b05-a3b0-7d807fbc96de): created successfully Sep 10 16:52:37 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-66661b10-659f-4673-ab53-dc269d7f996b tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (927edb1f-82bc-48a9-ba65-044bc793c087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:37 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-66661b10-659f-4673-ab53-dc269d7f996b tempest-VolumesGetTest-2060595714 None] Flow 'volume_create_manager' (20104f26-d0b8-4f12-9181-3c05ced0e427) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:52:37 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-66661b10-659f-4673-ab53-dc269d7f996b tempest-VolumesGetTest-2060595714 None] Created volume successfully. Sep 10 16:52:37 devstack sudo[103415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d Sep 10 16:52:37 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:37 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5a7338da-4460-4914-b6f1-514039b4f7db tempest-SnapshotDependencyTests-741204092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d" returned: 0 in 0.378s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5a7338da-4460-4914-b6f1-514039b4f7db tempest-SnapshotDependencyTests-741204092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:37 devstack sudo[103420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d Sep 10 16:52:37 devstack sudo[103420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:37 devstack sudo[103420]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5a7338da-4460-4914-b6f1-514039b4f7db tempest-SnapshotDependencyTests-741204092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-40ab28f6-0915-417e-b5f2-a5f6b8f1019d" returned: 0 in 0.252s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:37 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5a7338da-4460-4914-b6f1-514039b4f7db tempest-SnapshotDependencyTests-741204092 None] Lock "cinder-quobyte-40ab28f6-0915-417e-b5f2-a5f6b8f1019d" released by "delete_volume" :: held 0.711s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:52:38 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-5a7338da-4460-4914-b6f1-514039b4f7db tempest-SnapshotDependencyTests-741204092 None] Created reservations ['a6984957-3c48-4273-87cd-fb56e7492728', 'a4454e45-3f5d-4ae5-b66b-4ee2686f65ba', '18fc9f2b-c297-40f8-a560-98dbb917ce82', '459b2958-7b8c-4f1b-8869-ef4134931ace'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:52:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5a7338da-4460-4914-b6f1-514039b4f7db tempest-SnapshotDependencyTests-741204092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5a7338da-4460-4914-b6f1-514039b4f7db tempest-SnapshotDependencyTests-741204092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:38 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-5a7338da-4460-4914-b6f1-514039b4f7db tempest-SnapshotDependencyTests-741204092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:52:38 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-5a7338da-4460-4914-b6f1-514039b4f7db tempest-SnapshotDependencyTests-741204092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:52:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5a7338da-4460-4914-b6f1-514039b4f7db tempest-SnapshotDependencyTests-741204092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5a7338da-4460-4914-b6f1-514039b4f7db tempest-SnapshotDependencyTests-741204092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:38 devstack sudo[103423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:52:38 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:38 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-113cabb3-b796-43c3-87b6-8693390d01c5 tempest-SnapshotDependencyTests-741204092 None] Acquiring lock "cinder-a64523d0-24f1-4dd9-9dd5-2351f5596c9f-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:52:38 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-113cabb3-b796-43c3-87b6-8693390d01c5 tempest-SnapshotDependencyTests-741204092 None] Lock "cinder-a64523d0-24f1-4dd9-9dd5-2351f5596c9f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:52:38 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-113cabb3-b796-43c3-87b6-8693390d01c5 tempest-SnapshotDependencyTests-741204092 None] Acquiring lock "cinder-quobyte-a64523d0-24f1-4dd9-9dd5-2351f5596c9f" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:52:38 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-113cabb3-b796-43c3-87b6-8693390d01c5 tempest-SnapshotDependencyTests-741204092 None] Lock "cinder-quobyte-a64523d0-24f1-4dd9-9dd5-2351f5596c9f" acquired by "delete_volume" :: waited 0.029s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:52:38 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18af6a1-613a-4373-b3f9-e43003e0bd5a]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:52:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-113cabb3-b796-43c3-87b6-8693390d01c5 tempest-SnapshotDependencyTests-741204092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a64523d0-24f1-4dd9-9dd5-2351f5596c9f {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:38 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5a7338da-4460-4914-b6f1-514039b4f7db tempest-SnapshotDependencyTests-741204092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.383s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:38 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-5a7338da-4460-4914-b6f1-514039b4f7db tempest-SnapshotDependencyTests-741204092 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:52:38 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-5a7338da-4460-4914-b6f1-514039b4f7db tempest-SnapshotDependencyTests-741204092 None] Deleted volume successfully. Sep 10 16:52:38 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5a7338da-4460-4914-b6f1-514039b4f7db tempest-SnapshotDependencyTests-741204092 None] Lock "cinder-40ab28f6-0915-417e-b5f2-a5f6b8f1019d-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:52:38 devstack sudo[103426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a64523d0-24f1-4dd9-9dd5-2351f5596c9f Sep 10 16:52:38 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:38 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-113cabb3-b796-43c3-87b6-8693390d01c5 tempest-SnapshotDependencyTests-741204092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a64523d0-24f1-4dd9-9dd5-2351f5596c9f" returned: 0 in 0.436s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-113cabb3-b796-43c3-87b6-8693390d01c5 tempest-SnapshotDependencyTests-741204092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a64523d0-24f1-4dd9-9dd5-2351f5596c9f {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:38 devstack sudo[103431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a64523d0-24f1-4dd9-9dd5-2351f5596c9f Sep 10 16:52:38 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:39 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-113cabb3-b796-43c3-87b6-8693390d01c5 tempest-SnapshotDependencyTests-741204092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a64523d0-24f1-4dd9-9dd5-2351f5596c9f" returned: 0 in 0.302s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:39 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-113cabb3-b796-43c3-87b6-8693390d01c5 tempest-SnapshotDependencyTests-741204092 None] Lock "cinder-quobyte-a64523d0-24f1-4dd9-9dd5-2351f5596c9f" released by "delete_volume" :: held 0.810s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:52:39 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-de0197a7-251b-454e-b8e4-bfe64ab8486d tempest-VolumesGetTest-2060595714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:52:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-de0197a7-251b-454e-b8e4-bfe64ab8486d tempest-VolumesGetTest-2060595714 None] Flow 'volume_create_manager' (9084b895-73af-47f7-903e-720e464bdc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:52:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-de0197a7-251b-454e-b8e4-bfe64ab8486d tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (492b576d-89a0-4646-9fe3-c8341384c8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-de0197a7-251b-454e-b8e4-bfe64ab8486d tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (492b576d-89a0-4646-9fe3-c8341384c8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:52:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-499603359',display_name='tempest-VolumesGetTest-Volume-2090390958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d12293ba-d53e-4a35-8085-20ac5a220477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842073a1662740d5a7d0a4150349dc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:52:39Z,use_quota=True,user_id='c67a14f8b0464a299ebeb3caef9a0947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-de0197a7-251b-454e-b8e4-bfe64ab8486d tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (529efab3-a64a-4a68-8ff2-7c93cd44b1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-de0197a7-251b-454e-b8e4-bfe64ab8486d tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (529efab3-a64a-4a68-8ff2-7c93cd44b1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-de0197a7-251b-454e-b8e4-bfe64ab8486d tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c75de04c-8dce-48b1-833f-4d15c53287a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-de0197a7-251b-454e-b8e4-bfe64ab8486d tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c75de04c-8dce-48b1-833f-4d15c53287a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd12293ba-d53e-4a35-8085-20ac5a220477', 'volume_name': 'volume-d12293ba-d53e-4a35-8085-20ac5a220477', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-de0197a7-251b-454e-b8e4-bfe64ab8486d tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f82b1e28-7d00-42d4-a049-89b2d5b5e81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-de0197a7-251b-454e-b8e4-bfe64ab8486d tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f82b1e28-7d00-42d4-a049-89b2d5b5e81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-de0197a7-251b-454e-b8e4-bfe64ab8486d tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f63f02-b226-49cc-8130-036eaa69eba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:39 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-de0197a7-251b-454e-b8e4-bfe64ab8486d tempest-VolumesGetTest-2060595714 None] Volume d12293ba-d53e-4a35-8085-20ac5a220477: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d12293ba-d53e-4a35-8085-20ac5a220477', 'volume_size': 1} Sep 10 16:52:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-de0197a7-251b-454e-b8e4-bfe64ab8486d tempest-VolumesGetTest-2060595714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-de0197a7-251b-454e-b8e4-bfe64ab8486d tempest-VolumesGetTest-2060595714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:39 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-de0197a7-251b-454e-b8e4-bfe64ab8486d tempest-VolumesGetTest-2060595714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:52:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-499603359',display_name='tempest-VolumesGetTest-Volume-2090390958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d12293ba-d53e-4a35-8085-20ac5a220477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842073a1662740d5a7d0a4150349dc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:52:39Z,use_quota=True,user_id='c67a14f8b0464a299ebeb3caef9a0947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:52:39 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-de0197a7-251b-454e-b8e4-bfe64ab8486d tempest-VolumesGetTest-2060595714 None] Creating volume d12293ba-d53e-4a35-8085-20ac5a220477 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:52:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-de0197a7-251b-454e-b8e4-bfe64ab8486d tempest-VolumesGetTest-2060595714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-de0197a7-251b-454e-b8e4-bfe64ab8486d tempest-VolumesGetTest-2060595714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:39 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-de0197a7-251b-454e-b8e4-bfe64ab8486d tempest-VolumesGetTest-2060595714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:52:39 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-de0197a7-251b-454e-b8e4-bfe64ab8486d tempest-VolumesGetTest-2060595714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:52:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-de0197a7-251b-454e-b8e4-bfe64ab8486d tempest-VolumesGetTest-2060595714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:39 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-de0197a7-251b-454e-b8e4-bfe64ab8486d tempest-VolumesGetTest-2060595714 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:52:39 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-de0197a7-251b-454e-b8e4-bfe64ab8486d tempest-VolumesGetTest-2060595714 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:52:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-de0197a7-251b-454e-b8e4-bfe64ab8486d tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d12293ba-d53e-4a35-8085-20ac5a220477 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:39 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-113cabb3-b796-43c3-87b6-8693390d01c5 tempest-SnapshotDependencyTests-741204092 None] Created reservations ['fe5c4f41-1770-4c6a-82d5-96743b95291e', '09e57c0a-575e-4969-bb10-14fdcbc632b0', '0a2de66b-ef6f-4053-9ac0-48e295c1eda7', '4589440f-d12e-456e-a6cb-c8b439c0f328'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:52:39 devstack sudo[103434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d12293ba-d53e-4a35-8085-20ac5a220477 1073741824 Sep 10 16:52:39 devstack sudo[103434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-113cabb3-b796-43c3-87b6-8693390d01c5 tempest-SnapshotDependencyTests-741204092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-113cabb3-b796-43c3-87b6-8693390d01c5 tempest-SnapshotDependencyTests-741204092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:39 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-113cabb3-b796-43c3-87b6-8693390d01c5 tempest-SnapshotDependencyTests-741204092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:52:39 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-113cabb3-b796-43c3-87b6-8693390d01c5 tempest-SnapshotDependencyTests-741204092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:52:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-113cabb3-b796-43c3-87b6-8693390d01c5 tempest-SnapshotDependencyTests-741204092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-113cabb3-b796-43c3-87b6-8693390d01c5 tempest-SnapshotDependencyTests-741204092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:39 devstack sudo[103436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:52:39 devstack sudo[103436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:39 devstack sudo[103436]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-113cabb3-b796-43c3-87b6-8693390d01c5 tempest-SnapshotDependencyTests-741204092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.363s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:39 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-113cabb3-b796-43c3-87b6-8693390d01c5 tempest-SnapshotDependencyTests-741204092 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:52:39 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-113cabb3-b796-43c3-87b6-8693390d01c5 tempest-SnapshotDependencyTests-741204092 None] Deleted volume successfully. Sep 10 16:52:39 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-113cabb3-b796-43c3-87b6-8693390d01c5 tempest-SnapshotDependencyTests-741204092 None] Lock "cinder-a64523d0-24f1-4dd9-9dd5-2351f5596c9f-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:52:40 devstack sudo[103434]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-de0197a7-251b-454e-b8e4-bfe64ab8486d tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d12293ba-d53e-4a35-8085-20ac5a220477 1073741824" returned: 0 in 0.662s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-de0197a7-251b-454e-b8e4-bfe64ab8486d tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d12293ba-d53e-4a35-8085-20ac5a220477 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:40 devstack sudo[103443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d12293ba-d53e-4a35-8085-20ac5a220477 Sep 10 16:52:40 devstack sudo[103443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:40 devstack sudo[103443]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-de0197a7-251b-454e-b8e4-bfe64ab8486d tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d12293ba-d53e-4a35-8085-20ac5a220477" returned: 0 in 0.287s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:40 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-de0197a7-251b-454e-b8e4-bfe64ab8486d tempest-VolumesGetTest-2060595714 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:52:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-de0197a7-251b-454e-b8e4-bfe64ab8486d tempest-VolumesGetTest-2060595714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-de0197a7-251b-454e-b8e4-bfe64ab8486d tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f63f02-b226-49cc-8130-036eaa69eba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d12293ba-d53e-4a35-8085-20ac5a220477', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-de0197a7-251b-454e-b8e4-bfe64ab8486d tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e81c2074-9d57-4eb7-bf3a-81cf4e8ada51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:40 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-de0197a7-251b-454e-b8e4-bfe64ab8486d tempest-VolumesGetTest-2060595714 None] Volume volume-d12293ba-d53e-4a35-8085-20ac5a220477 (d12293ba-d53e-4a35-8085-20ac5a220477): created successfully Sep 10 16:52:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-de0197a7-251b-454e-b8e4-bfe64ab8486d tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e81c2074-9d57-4eb7-bf3a-81cf4e8ada51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-de0197a7-251b-454e-b8e4-bfe64ab8486d tempest-VolumesGetTest-2060595714 None] Flow 'volume_create_manager' (9084b895-73af-47f7-903e-720e464bdc56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:52:40 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-de0197a7-251b-454e-b8e4-bfe64ab8486d tempest-VolumesGetTest-2060595714 None] Created volume successfully. Sep 10 16:52:41 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d4bf318d-1d4d-4cac-9a56-b86a0aa36916 tempest-VolumesGetTest-2060595714 None] Acquiring lock "cinder-d12293ba-d53e-4a35-8085-20ac5a220477-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:52:41 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d4bf318d-1d4d-4cac-9a56-b86a0aa36916 tempest-VolumesGetTest-2060595714 None] Lock "cinder-d12293ba-d53e-4a35-8085-20ac5a220477-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:52:41 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d4bf318d-1d4d-4cac-9a56-b86a0aa36916 tempest-VolumesGetTest-2060595714 None] Acquiring lock "cinder-quobyte-d12293ba-d53e-4a35-8085-20ac5a220477" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:52:41 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d4bf318d-1d4d-4cac-9a56-b86a0aa36916 tempest-VolumesGetTest-2060595714 None] Lock "cinder-quobyte-d12293ba-d53e-4a35-8085-20ac5a220477" acquired by "delete_volume" :: waited 0.022s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:52:41 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[849ab956-7288-448b-b0d7-b44c6c734055]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:52:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d4bf318d-1d4d-4cac-9a56-b86a0aa36916 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d12293ba-d53e-4a35-8085-20ac5a220477 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:41 devstack sudo[103448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d12293ba-d53e-4a35-8085-20ac5a220477 Sep 10 16:52:41 devstack sudo[103448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:42 devstack sudo[103448]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d4bf318d-1d4d-4cac-9a56-b86a0aa36916 tempest-VolumesGetTest-2060595714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d12293ba-d53e-4a35-8085-20ac5a220477" returned: 0 in 0.435s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d4bf318d-1d4d-4cac-9a56-b86a0aa36916 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d12293ba-d53e-4a35-8085-20ac5a220477 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:42 devstack sudo[103453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d12293ba-d53e-4a35-8085-20ac5a220477 Sep 10 16:52:42 devstack sudo[103453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:42 devstack sudo[103453]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d4bf318d-1d4d-4cac-9a56-b86a0aa36916 tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d12293ba-d53e-4a35-8085-20ac5a220477" returned: 0 in 0.274s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:42 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d4bf318d-1d4d-4cac-9a56-b86a0aa36916 tempest-VolumesGetTest-2060595714 None] Lock "cinder-quobyte-d12293ba-d53e-4a35-8085-20ac5a220477" released by "delete_volume" :: held 0.772s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:52:42 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-d4bf318d-1d4d-4cac-9a56-b86a0aa36916 tempest-VolumesGetTest-2060595714 None] Created reservations ['1ac022f5-ac4b-4a20-8de3-3e7c4916260e', '2074b1c6-0559-4d66-af52-dd1826f5547e', 'ead6b832-46f2-4715-b66f-674eb2c760bb', '572eda06-2472-4c79-bfb6-2282526386a7'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:52:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d4bf318d-1d4d-4cac-9a56-b86a0aa36916 tempest-VolumesGetTest-2060595714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d4bf318d-1d4d-4cac-9a56-b86a0aa36916 tempest-VolumesGetTest-2060595714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:42 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d4bf318d-1d4d-4cac-9a56-b86a0aa36916 tempest-VolumesGetTest-2060595714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:52:42 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d4bf318d-1d4d-4cac-9a56-b86a0aa36916 tempest-VolumesGetTest-2060595714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:52:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d4bf318d-1d4d-4cac-9a56-b86a0aa36916 tempest-VolumesGetTest-2060595714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d4bf318d-1d4d-4cac-9a56-b86a0aa36916 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:42 devstack sudo[103456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:52:42 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:42 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-54be3583-9477-4e73-a76f-e2369639bfad tempest-VolumesGetTest-2060595714 None] Acquiring lock "cinder-53eb9d1f-b5ac-4b05-a3b0-7d807fbc96de-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:52:42 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-54be3583-9477-4e73-a76f-e2369639bfad tempest-VolumesGetTest-2060595714 None] Lock "cinder-53eb9d1f-b5ac-4b05-a3b0-7d807fbc96de-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:52:43 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-54be3583-9477-4e73-a76f-e2369639bfad tempest-VolumesGetTest-2060595714 None] Acquiring lock "cinder-quobyte-53eb9d1f-b5ac-4b05-a3b0-7d807fbc96de" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:52:43 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d4bf318d-1d4d-4cac-9a56-b86a0aa36916 tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.434s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:43 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-d4bf318d-1d4d-4cac-9a56-b86a0aa36916 tempest-VolumesGetTest-2060595714 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:52:43 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-d4bf318d-1d4d-4cac-9a56-b86a0aa36916 tempest-VolumesGetTest-2060595714 None] Deleted volume successfully. Sep 10 16:52:43 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-54be3583-9477-4e73-a76f-e2369639bfad tempest-VolumesGetTest-2060595714 None] Lock "cinder-quobyte-53eb9d1f-b5ac-4b05-a3b0-7d807fbc96de" acquired by "delete_volume" :: waited 0.059s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:52:43 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec65d20-09c1-4a3d-b806-4fb37f704a4a]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:52:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-54be3583-9477-4e73-a76f-e2369639bfad tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53eb9d1f-b5ac-4b05-a3b0-7d807fbc96de {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:43 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d4bf318d-1d4d-4cac-9a56-b86a0aa36916 tempest-VolumesGetTest-2060595714 None] Lock "cinder-d12293ba-d53e-4a35-8085-20ac5a220477-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:52:43 devstack sudo[103459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53eb9d1f-b5ac-4b05-a3b0-7d807fbc96de Sep 10 16:52:43 devstack sudo[103459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:43 devstack sudo[103459]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-54be3583-9477-4e73-a76f-e2369639bfad tempest-VolumesGetTest-2060595714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53eb9d1f-b5ac-4b05-a3b0-7d807fbc96de" returned: 0 in 0.450s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-54be3583-9477-4e73-a76f-e2369639bfad tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53eb9d1f-b5ac-4b05-a3b0-7d807fbc96de {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:43 devstack sudo[103464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53eb9d1f-b5ac-4b05-a3b0-7d807fbc96de Sep 10 16:52:43 devstack sudo[103464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:43 devstack sudo[103464]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-54be3583-9477-4e73-a76f-e2369639bfad tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53eb9d1f-b5ac-4b05-a3b0-7d807fbc96de" returned: 0 in 0.262s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:43 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-54be3583-9477-4e73-a76f-e2369639bfad tempest-VolumesGetTest-2060595714 None] Lock "cinder-quobyte-53eb9d1f-b5ac-4b05-a3b0-7d807fbc96de" released by "delete_volume" :: held 0.801s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:52:43 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-54be3583-9477-4e73-a76f-e2369639bfad tempest-VolumesGetTest-2060595714 None] Created reservations ['ded51982-1c23-4729-9955-8afeb5887edc', '59b66d29-fec5-4034-92e1-1350b04bf1c7', 'e30a8f73-4542-4b05-9129-8c35f8dd4b93', '2e0f2766-14eb-4841-b738-521c674b0c54'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-54be3583-9477-4e73-a76f-e2369639bfad tempest-VolumesGetTest-2060595714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-54be3583-9477-4e73-a76f-e2369639bfad tempest-VolumesGetTest-2060595714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-54be3583-9477-4e73-a76f-e2369639bfad tempest-VolumesGetTest-2060595714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-54be3583-9477-4e73-a76f-e2369639bfad tempest-VolumesGetTest-2060595714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-54be3583-9477-4e73-a76f-e2369639bfad tempest-VolumesGetTest-2060595714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-54be3583-9477-4e73-a76f-e2369639bfad tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:44 devstack sudo[103467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:52:44 devstack sudo[103467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-895110a7-2e9a-457d-814d-d348ba16b87b tempest-TestImageHashVerification-1458119380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-895110a7-2e9a-457d-814d-d348ba16b87b tempest-TestImageHashVerification-1458119380 None] Flow 'volume_create_manager' (e17f3026-4656-479f-8dee-e47e5e792f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-895110a7-2e9a-457d-814d-d348ba16b87b tempest-TestImageHashVerification-1458119380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d35d6a3c-b7aa-461d-b5da-e01abe52e533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-895110a7-2e9a-457d-814d-d348ba16b87b tempest-TestImageHashVerification-1458119380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d35d6a3c-b7aa-461d-b5da-e01abe52e533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1876035155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be1aff36-d818-45c7-bf14-eb4e94d8e606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a96a8bc95c6476f9329b1ba6afbbe4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:52:44Z,use_quota=True,user_id='6bf471fe53ce42d58612a5b6f465205a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-895110a7-2e9a-457d-814d-d348ba16b87b tempest-TestImageHashVerification-1458119380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69accd19-c254-44b5-8358-e36e6f504d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-895110a7-2e9a-457d-814d-d348ba16b87b tempest-TestImageHashVerification-1458119380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69accd19-c254-44b5-8358-e36e6f504d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-895110a7-2e9a-457d-814d-d348ba16b87b tempest-TestImageHashVerification-1458119380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6630bdd-324d-4693-b7ea-12235ad8aa00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-895110a7-2e9a-457d-814d-d348ba16b87b tempest-TestImageHashVerification-1458119380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6630bdd-324d-4693-b7ea-12235ad8aa00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be1aff36-d818-45c7-bf14-eb4e94d8e606', 'volume_name': 'volume-be1aff36-d818-45c7-bf14-eb4e94d8e606', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-895110a7-2e9a-457d-814d-d348ba16b87b tempest-TestImageHashVerification-1458119380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b915c20b-76d3-4e24-a2de-0472f126d1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-895110a7-2e9a-457d-814d-d348ba16b87b tempest-TestImageHashVerification-1458119380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b915c20b-76d3-4e24-a2de-0472f126d1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-895110a7-2e9a-457d-814d-d348ba16b87b tempest-TestImageHashVerification-1458119380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb02aeaf-e395-4ffe-ac20-475bbdcbd901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:44 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-895110a7-2e9a-457d-814d-d348ba16b87b tempest-TestImageHashVerification-1458119380 None] Volume be1aff36-d818-45c7-bf14-eb4e94d8e606: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be1aff36-d818-45c7-bf14-eb4e94d8e606', 'volume_size': 1} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-895110a7-2e9a-457d-814d-d348ba16b87b tempest-TestImageHashVerification-1458119380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-895110a7-2e9a-457d-814d-d348ba16b87b tempest-TestImageHashVerification-1458119380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-895110a7-2e9a-457d-814d-d348ba16b87b tempest-TestImageHashVerification-1458119380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1876035155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be1aff36-d818-45c7-bf14-eb4e94d8e606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a96a8bc95c6476f9329b1ba6afbbe4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:52:44Z,use_quota=True,user_id='6bf471fe53ce42d58612a5b6f465205a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-895110a7-2e9a-457d-814d-d348ba16b87b tempest-TestImageHashVerification-1458119380 None] Creating volume be1aff36-d818-45c7-bf14-eb4e94d8e606 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-895110a7-2e9a-457d-814d-d348ba16b87b tempest-TestImageHashVerification-1458119380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-895110a7-2e9a-457d-814d-d348ba16b87b tempest-TestImageHashVerification-1458119380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-895110a7-2e9a-457d-814d-d348ba16b87b tempest-TestImageHashVerification-1458119380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-895110a7-2e9a-457d-814d-d348ba16b87b tempest-TestImageHashVerification-1458119380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-895110a7-2e9a-457d-814d-d348ba16b87b tempest-TestImageHashVerification-1458119380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-895110a7-2e9a-457d-814d-d348ba16b87b tempest-TestImageHashVerification-1458119380 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:52:44 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-895110a7-2e9a-457d-814d-d348ba16b87b tempest-TestImageHashVerification-1458119380 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-895110a7-2e9a-457d-814d-d348ba16b87b tempest-TestImageHashVerification-1458119380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be1aff36-d818-45c7-bf14-eb4e94d8e606 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:44 devstack sudo[103469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be1aff36-d818-45c7-bf14-eb4e94d8e606 1073741824 Sep 10 16:52:44 devstack sudo[103469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:44 devstack sudo[103467]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-54be3583-9477-4e73-a76f-e2369639bfad tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.369s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-54be3583-9477-4e73-a76f-e2369639bfad tempest-VolumesGetTest-2060595714 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:52:44 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-54be3583-9477-4e73-a76f-e2369639bfad tempest-VolumesGetTest-2060595714 None] Deleted volume successfully. Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-54be3583-9477-4e73-a76f-e2369639bfad tempest-VolumesGetTest-2060595714 None] Lock "cinder-53eb9d1f-b5ac-4b05-a3b0-7d807fbc96de-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d6cab60-ec41-4f83-b974-c1ecf990ae6a tempest-VolumesGetTest-2060595714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0d6cab60-ec41-4f83-b974-c1ecf990ae6a tempest-VolumesGetTest-2060595714 None] Flow 'volume_create_manager' (d0d239fc-1537-44b6-b217-7cfb8fa32a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0d6cab60-ec41-4f83-b974-c1ecf990ae6a tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (085ece21-9e4a-43ef-a9d5-b9052bdda8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0d6cab60-ec41-4f83-b974-c1ecf990ae6a tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (085ece21-9e4a-43ef-a9d5-b9052bdda8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-52796208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0512097d-9917-477d-a080-ef25ce4a9ad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842073a1662740d5a7d0a4150349dc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:52:45Z,use_quota=True,user_id='c67a14f8b0464a299ebeb3caef9a0947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0d6cab60-ec41-4f83-b974-c1ecf990ae6a tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9aca450-317e-49c1-8738-da5f1ba9ce4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0d6cab60-ec41-4f83-b974-c1ecf990ae6a tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9aca450-317e-49c1-8738-da5f1ba9ce4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:44 devstack sudo[103469]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0d6cab60-ec41-4f83-b974-c1ecf990ae6a tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (735b0500-a13f-42ee-b355-5ebfa52b0d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0d6cab60-ec41-4f83-b974-c1ecf990ae6a tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (735b0500-a13f-42ee-b355-5ebfa52b0d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0512097d-9917-477d-a080-ef25ce4a9ad7', 'volume_name': 'volume-0512097d-9917-477d-a080-ef25ce4a9ad7', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0d6cab60-ec41-4f83-b974-c1ecf990ae6a tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f327abf7-d8f9-4302-992a-b0681bd3e947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0d6cab60-ec41-4f83-b974-c1ecf990ae6a tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f327abf7-d8f9-4302-992a-b0681bd3e947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0d6cab60-ec41-4f83-b974-c1ecf990ae6a tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c4594f1-5ae9-4829-834b-05926297b5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:44 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-0d6cab60-ec41-4f83-b974-c1ecf990ae6a tempest-VolumesGetTest-2060595714 None] Volume 0512097d-9917-477d-a080-ef25ce4a9ad7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0512097d-9917-477d-a080-ef25ce4a9ad7', 'volume_size': 1} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0d6cab60-ec41-4f83-b974-c1ecf990ae6a tempest-VolumesGetTest-2060595714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-895110a7-2e9a-457d-814d-d348ba16b87b tempest-TestImageHashVerification-1458119380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be1aff36-d818-45c7-bf14-eb4e94d8e606 1073741824" returned: 0 in 0.630s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-895110a7-2e9a-457d-814d-d348ba16b87b tempest-TestImageHashVerification-1458119380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be1aff36-d818-45c7-bf14-eb4e94d8e606 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:44 devstack sudo[103475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be1aff36-d818-45c7-bf14-eb4e94d8e606 Sep 10 16:52:44 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:45 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-895110a7-2e9a-457d-814d-d348ba16b87b tempest-TestImageHashVerification-1458119380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be1aff36-d818-45c7-bf14-eb4e94d8e606" returned: 0 in 0.278s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:45 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-895110a7-2e9a-457d-814d-d348ba16b87b tempest-TestImageHashVerification-1458119380 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:52:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-895110a7-2e9a-457d-814d-d348ba16b87b tempest-TestImageHashVerification-1458119380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0d6cab60-ec41-4f83-b974-c1ecf990ae6a tempest-VolumesGetTest-2060595714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.322s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:45 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0d6cab60-ec41-4f83-b974-c1ecf990ae6a tempest-VolumesGetTest-2060595714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-52796208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0512097d-9917-477d-a080-ef25ce4a9ad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842073a1662740d5a7d0a4150349dc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:52:45Z,use_quota=True,user_id='c67a14f8b0464a299ebeb3caef9a0947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:52:45 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-0d6cab60-ec41-4f83-b974-c1ecf990ae6a tempest-VolumesGetTest-2060595714 None] Creating volume 0512097d-9917-477d-a080-ef25ce4a9ad7 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:52:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0d6cab60-ec41-4f83-b974-c1ecf990ae6a tempest-VolumesGetTest-2060595714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0d6cab60-ec41-4f83-b974-c1ecf990ae6a tempest-VolumesGetTest-2060595714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:45 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0d6cab60-ec41-4f83-b974-c1ecf990ae6a tempest-VolumesGetTest-2060595714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:52:45 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0d6cab60-ec41-4f83-b974-c1ecf990ae6a tempest-VolumesGetTest-2060595714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:52:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0d6cab60-ec41-4f83-b974-c1ecf990ae6a tempest-VolumesGetTest-2060595714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:45 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0d6cab60-ec41-4f83-b974-c1ecf990ae6a tempest-VolumesGetTest-2060595714 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:52:45 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-0d6cab60-ec41-4f83-b974-c1ecf990ae6a tempest-VolumesGetTest-2060595714 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:52:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0d6cab60-ec41-4f83-b974-c1ecf990ae6a tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-895110a7-2e9a-457d-814d-d348ba16b87b tempest-TestImageHashVerification-1458119380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb02aeaf-e395-4ffe-ac20-475bbdcbd901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be1aff36-d818-45c7-bf14-eb4e94d8e606', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-895110a7-2e9a-457d-814d-d348ba16b87b tempest-TestImageHashVerification-1458119380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656c3693-29a5-4ec2-aebf-3495a3a0614d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:45 devstack sudo[103478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7 1073741824 Sep 10 16:52:45 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:45 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-895110a7-2e9a-457d-814d-d348ba16b87b tempest-TestImageHashVerification-1458119380 None] Volume volume-be1aff36-d818-45c7-bf14-eb4e94d8e606 (be1aff36-d818-45c7-bf14-eb4e94d8e606): created successfully Sep 10 16:52:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-895110a7-2e9a-457d-814d-d348ba16b87b tempest-TestImageHashVerification-1458119380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656c3693-29a5-4ec2-aebf-3495a3a0614d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:45 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-895110a7-2e9a-457d-814d-d348ba16b87b tempest-TestImageHashVerification-1458119380 None] Flow 'volume_create_manager' (e17f3026-4656-479f-8dee-e47e5e792f51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:52:45 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-895110a7-2e9a-457d-814d-d348ba16b87b tempest-TestImageHashVerification-1458119380 None] Created volume successfully. Sep 10 16:52:45 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0d6cab60-ec41-4f83-b974-c1ecf990ae6a tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7 1073741824" returned: 0 in 0.524s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0d6cab60-ec41-4f83-b974-c1ecf990ae6a tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:45 devstack sudo[103484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7 Sep 10 16:52:45 devstack sudo[103484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:46 devstack sudo[103484]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0d6cab60-ec41-4f83-b974-c1ecf990ae6a tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7" returned: 0 in 0.250s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:46 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0d6cab60-ec41-4f83-b974-c1ecf990ae6a tempest-VolumesGetTest-2060595714 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:52:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0d6cab60-ec41-4f83-b974-c1ecf990ae6a tempest-VolumesGetTest-2060595714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0d6cab60-ec41-4f83-b974-c1ecf990ae6a tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c4594f1-5ae9-4829-834b-05926297b5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0512097d-9917-477d-a080-ef25ce4a9ad7', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0d6cab60-ec41-4f83-b974-c1ecf990ae6a tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad7428d4-0317-4aaf-9c2c-f74c9a62e8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:46 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-0d6cab60-ec41-4f83-b974-c1ecf990ae6a tempest-VolumesGetTest-2060595714 None] Volume volume-0512097d-9917-477d-a080-ef25ce4a9ad7 (0512097d-9917-477d-a080-ef25ce4a9ad7): created successfully Sep 10 16:52:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0d6cab60-ec41-4f83-b974-c1ecf990ae6a tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad7428d4-0317-4aaf-9c2c-f74c9a62e8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0d6cab60-ec41-4f83-b974-c1ecf990ae6a tempest-VolumesGetTest-2060595714 None] Flow 'volume_create_manager' (d0d239fc-1537-44b6-b217-7cfb8fa32a4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:52:46 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-0d6cab60-ec41-4f83-b974-c1ecf990ae6a tempest-VolumesGetTest-2060595714 None] Created volume successfully. Sep 10 16:52:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ab72d90d-45b8-4d3e-bb5e-ee6891a66ddc tempest-TestImageHashVerification-1458119380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ab72d90d-45b8-4d3e-bb5e-ee6891a66ddc tempest-TestImageHashVerification-1458119380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:47 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4da3ae5-683a-470f-b5c8-193d1062267e]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:52:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ab72d90d-45b8-4d3e-bb5e-ee6891a66ddc tempest-TestImageHashVerification-1458119380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be1aff36-d818-45c7-bf14-eb4e94d8e606 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:47 devstack sudo[103488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be1aff36-d818-45c7-bf14-eb4e94d8e606 Sep 10 16:52:47 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:47 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:52:47 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Flow 'volume_create_manager' (747fdcdd-2f00-401e-bb58-7d67e7ceb987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:52:47 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (867c6a9a-7145-4843-a372-afba0c6e8864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:47 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (867c6a9a-7145-4843-a372-afba0c6e8864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-160620756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8013c38d-8e91-49eb-9871-6de1f153ffbf,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='842073a1662740d5a7d0a4150349dc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:52:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=0512097d-9917-477d-a080-ef25ce4a9ad7,status='creating',terminated_at=None,updated_at=2026-09-10T14:52:47Z,use_quota=True,user_id='c67a14f8b0464a299ebeb3caef9a0947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:47 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faec815d-b1b3-48f6-8301-8c124785f700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:47 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faec815d-b1b3-48f6-8301-8c124785f700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:47 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a915ecad-1d62-4766-a5c2-eadaf1bf806e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:47 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a915ecad-1d62-4766-a5c2-eadaf1bf806e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8013c38d-8e91-49eb-9871-6de1f153ffbf', 'volume_name': 'volume-8013c38d-8e91-49eb-9871-6de1f153ffbf', 'volume_size': 1, 'source_volid': '0512097d-9917-477d-a080-ef25ce4a9ad7', 'source_volstatus': 'available'}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:47 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (142b2f32-e800-4e8c-8e08-4e990a0f2112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:47 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (142b2f32-e800-4e8c-8e08-4e990a0f2112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:52:47 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6774b9d0-b30e-42fa-a874-c01c52a81fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:52:47 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Volume 8013c38d-8e91-49eb-9871-6de1f153ffbf: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8013c38d-8e91-49eb-9871-6de1f153ffbf', 'volume_size': 1, 'source_volid': '0512097d-9917-477d-a080-ef25ce4a9ad7', 'source_volstatus': 'available'} Sep 10 16:52:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:47 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ab72d90d-45b8-4d3e-bb5e-ee6891a66ddc tempest-TestImageHashVerification-1458119380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be1aff36-d818-45c7-bf14-eb4e94d8e606" returned: 0 in 0.380s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:47 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e127998-f5a9-4c68-bee9-8db6b54ecf8d]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:52:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ab72d90d-45b8-4d3e-bb5e-ee6891a66ddc tempest-TestImageHashVerification-1458119380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be1aff36-d818-45c7-bf14-eb4e94d8e606 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:47 devstack sudo[103494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be1aff36-d818-45c7-bf14-eb4e94d8e606 Sep 10 16:52:47 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:48 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ab72d90d-45b8-4d3e-bb5e-ee6891a66ddc tempest-TestImageHashVerification-1458119380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be1aff36-d818-45c7-bf14-eb4e94d8e606" returned: 0 in 0.378s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ab72d90d-45b8-4d3e-bb5e-ee6891a66ddc tempest-TestImageHashVerification-1458119380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be1aff36-d818-45c7-bf14-eb4e94d8e606 /opt/stack/data/cinder/conversion/be1aff36-d818-45c7-bf14-eb4e94d8e606.temp_image.33bfdbff-ea3d-4940-9525-f578d393df210algw_tj.img {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:48 devstack sudo[103499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be1aff36-d818-45c7-bf14-eb4e94d8e606 /opt/stack/data/cinder/conversion/be1aff36-d818-45c7-bf14-eb4e94d8e606.temp_image.33bfdbff-ea3d-4940-9525-f578d393df210algw_tj.img Sep 10 16:52:48 devstack sudo[103499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:52:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:52:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:52:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:52:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:52:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:52:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:49 devstack sudo[103511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:52:49 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:50 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.580s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:50 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:52:50 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager._thread_info {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:52:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread count: 28 {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 16:52:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread info: [<_MainThread(MainThread, started 125792070905984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 16:52:52 devstack sudo[103499]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ab72d90d-45b8-4d3e-bb5e-ee6891a66ddc tempest-TestImageHashVerification-1458119380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be1aff36-d818-45c7-bf14-eb4e94d8e606 /opt/stack/data/cinder/conversion/be1aff36-d818-45c7-bf14-eb4e94d8e606.temp_image.33bfdbff-ea3d-4940-9525-f578d393df210algw_tj.img" returned: 0 in 4.866s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:52 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc52fd7-1d47-4067-8b47-5ee5eccad6c6]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:52:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ab72d90d-45b8-4d3e-bb5e-ee6891a66ddc tempest-TestImageHashVerification-1458119380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be1aff36-d818-45c7-bf14-eb4e94d8e606 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:52:53 devstack sudo[103516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be1aff36-d818-45c7-bf14-eb4e94d8e606 Sep 10 16:52:53 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:52:53 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root Sep 10 16:52:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ab72d90d-45b8-4d3e-bb5e-ee6891a66ddc tempest-TestImageHashVerification-1458119380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be1aff36-d818-45c7-bf14-eb4e94d8e606" returned: 0 in 0.566s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:52:53 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-ab72d90d-45b8-4d3e-bb5e-ee6891a66ddc tempest-TestImageHashVerification-1458119380 None] Image conversion details: src /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be1aff36-d818-45c7-bf14-eb4e94d8e606, size 1024.00 MB, duration 4.87 sec, destination /opt/stack/data/cinder/conversion/be1aff36-d818-45c7-bf14-eb4e94d8e606.temp_image.33bfdbff-ea3d-4940-9525-f578d393df210algw_tj.img {{(pid=88189) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 16:52:53 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-ab72d90d-45b8-4d3e-bb5e-ee6891a66ddc tempest-TestImageHashVerification-1458119380 None] Converted 1024.00 MB image at 210.36 MB/s Sep 10 16:52:53 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=113,cinder:INSERT=44,cinder:UPDATE=152,cinder:DELETE=16 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:52:53 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=112,cinder:INSERT=39,cinder:UPDATE=151,cinder:DELETE=11 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:52:53 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-ab72d90d-45b8-4d3e-bb5e-ee6891a66ddc tempest-TestImageHashVerification-1458119380 None] 33bfdbff-ea3d-4940-9525-f578d393df21 was raw, no need to convert to raw {{(pid=88189) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 10 16:53:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ab72d90d-45b8-4d3e-bb5e-ee6891a66ddc tempest-TestImageHashVerification-1458119380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.011s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:53:12 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ab72d90d-45b8-4d3e-bb5e-ee6891a66ddc tempest-TestImageHashVerification-1458119380 None] Uploaded volume to glance image-id: 33bfdbff-ea3d-4940-9525-f578d393df21. {{(pid=88189) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 10 16:53:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 24.677s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:53:12 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Cloning volume 0512097d-9917-477d-a080-ef25ce4a9ad7 to volume 8013c38d-8e91-49eb-9871-6de1f153ffbf Sep 10 16:53:12 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-ab72d90d-45b8-4d3e-bb5e-ee6891a66ddc tempest-TestImageHashVerification-1458119380 None] Copy volume to image completed successfully. Sep 10 16:53:12 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Creating offline snapshot f07840fa-f192-4396-aaee-c81bbb607912 of volume 0512097d-9917-477d-a080-ef25ce4a9ad7 {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:53:12 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d0e337-962f-4628-819a-15c229a2b9a0]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:53:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:12 devstack sudo[103528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7 Sep 10 16:53:12 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:12 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7" returned: 0 in 0.348s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7.f07840fa-f192-4396-aaee-c81bbb607912 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:12 devstack sudo[103533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7.f07840fa-f192-4396-aaee-c81bbb607912 1G Sep 10 16:53:12 devstack sudo[103533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:13 devstack sudo[103533]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7.f07840fa-f192-4396-aaee-c81bbb607912 1G" returned: 0 in 0.381s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0512097d-9917-477d-a080-ef25ce4a9ad7 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7.f07840fa-f192-4396-aaee-c81bbb607912 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:13 devstack sudo[103538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0512097d-9917-477d-a080-ef25ce4a9ad7 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7.f07840fa-f192-4396-aaee-c81bbb607912 Sep 10 16:53:13 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:13 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0512097d-9917-477d-a080-ef25ce4a9ad7 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7.f07840fa-f192-4396-aaee-c81bbb607912" returned: 0 in 0.302s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:13 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7.f07840fa-f192-4396-aaee-c81bbb607912 is being set with open permissions: ugo+rw Sep 10 16:53:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7.f07840fa-f192-4396-aaee-c81bbb607912 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:13 devstack sudo[103543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7.f07840fa-f192-4396-aaee-c81bbb607912 Sep 10 16:53:13 devstack sudo[103543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:13 devstack sudo[103543]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7.f07840fa-f192-4396-aaee-c81bbb607912" returned: 0 in 0.240s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:13 devstack sudo[103546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7.info Sep 10 16:53:13 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:13 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5557907c-4d74-4614-9da5-0aedec087ddd tempest-TestImageHashVerification-1458119380 None] Acquiring lock "cinder-be1aff36-d818-45c7-bf14-eb4e94d8e606-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:53:13 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5557907c-4d74-4614-9da5-0aedec087ddd tempest-TestImageHashVerification-1458119380 None] Lock "cinder-be1aff36-d818-45c7-bf14-eb4e94d8e606-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:53:13 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5557907c-4d74-4614-9da5-0aedec087ddd tempest-TestImageHashVerification-1458119380 None] Acquiring lock "cinder-quobyte-be1aff36-d818-45c7-bf14-eb4e94d8e606" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:53:13 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5557907c-4d74-4614-9da5-0aedec087ddd tempest-TestImageHashVerification-1458119380 None] Lock "cinder-quobyte-be1aff36-d818-45c7-bf14-eb4e94d8e606" acquired by "delete_volume" :: waited 0.017s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:53:13 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9728a3e6-ee50-41d7-95cb-785ac4aef47c]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:53:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5557907c-4d74-4614-9da5-0aedec087ddd tempest-TestImageHashVerification-1458119380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be1aff36-d818-45c7-bf14-eb4e94d8e606 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:13 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7.info" returned: 0 in 0.290s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:13 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7.info is being set with open permissions: ugo+rw Sep 10 16:53:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:13 devstack sudo[103550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7.info Sep 10 16:53:13 devstack sudo[103550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:14 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be1aff36-d818-45c7-bf14-eb4e94d8e606 Sep 10 16:53:14 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:14 devstack sudo[103550]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7.info" returned: 0 in 0.251s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:14 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Acquiring lock "cinder-quobyte-8013c38d-8e91-49eb-9871-6de1f153ffbf" by "_copy_volume_from_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:53:14 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Lock "cinder-quobyte-8013c38d-8e91-49eb-9871-6de1f153ffbf" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:53:14 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] snapshot: f07840fa-f192-4396-aaee-c81bbb607912, volume: 8013c38d-8e91-49eb-9871-6de1f153ffbf, {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 16:53:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:53:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:53:14 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:53:14 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:53:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:53:14 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[749580fd-a3e7-4267-b327-0141706d4939]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:53:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7.f07840fa-f192-4396-aaee-c81bbb607912 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:14 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5557907c-4d74-4614-9da5-0aedec087ddd tempest-TestImageHashVerification-1458119380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be1aff36-d818-45c7-bf14-eb4e94d8e606" returned: 0 in 0.374s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5557907c-4d74-4614-9da5-0aedec087ddd tempest-TestImageHashVerification-1458119380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be1aff36-d818-45c7-bf14-eb4e94d8e606 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:14 devstack sudo[103558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be1aff36-d818-45c7-bf14-eb4e94d8e606 Sep 10 16:53:14 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:14 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7.f07840fa-f192-4396-aaee-c81bbb607912 Sep 10 16:53:14 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:14 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5557907c-4d74-4614-9da5-0aedec087ddd tempest-TestImageHashVerification-1458119380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be1aff36-d818-45c7-bf14-eb4e94d8e606" returned: 0 in 0.266s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:14 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5557907c-4d74-4614-9da5-0aedec087ddd tempest-TestImageHashVerification-1458119380 None] Lock "cinder-quobyte-be1aff36-d818-45c7-bf14-eb4e94d8e606" released by "delete_volume" :: held 0.676s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:53:14 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7.f07840fa-f192-4396-aaee-c81bbb607912" returned: 0 in 0.369s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:14 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0512097d-9917-477d-a080-ef25ce4a9ad7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:53:14 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-5557907c-4d74-4614-9da5-0aedec087ddd tempest-TestImageHashVerification-1458119380 None] Created reservations ['2258e00d-ef86-44e6-903e-d84d0f392ae2', 'f21c0087-d28d-47cb-aae1-750b5d7592b5', '132fed86-1926-4a35-9576-7c064ac586e3', 'c317b677-43ca-4a7c-83bb-4cef0e613a7f'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:53:14 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ada9ed1-b279-464c-bc9f-28724431ea23]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:53:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5557907c-4d74-4614-9da5-0aedec087ddd tempest-TestImageHashVerification-1458119380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:53:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5557907c-4d74-4614-9da5-0aedec087ddd tempest-TestImageHashVerification-1458119380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:53:14 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-5557907c-4d74-4614-9da5-0aedec087ddd tempest-TestImageHashVerification-1458119380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:53:14 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-5557907c-4d74-4614-9da5-0aedec087ddd tempest-TestImageHashVerification-1458119380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:53:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5557907c-4d74-4614-9da5-0aedec087ddd tempest-TestImageHashVerification-1458119380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:53:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5557907c-4d74-4614-9da5-0aedec087ddd tempest-TestImageHashVerification-1458119380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:14 devstack sudo[103566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:53:14 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:14 devstack sudo[103565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7 Sep 10 16:53:14 devstack sudo[103565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:14 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5557907c-4d74-4614-9da5-0aedec087ddd tempest-TestImageHashVerification-1458119380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.272s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:14 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-5557907c-4d74-4614-9da5-0aedec087ddd tempest-TestImageHashVerification-1458119380 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:53:14 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-5557907c-4d74-4614-9da5-0aedec087ddd tempest-TestImageHashVerification-1458119380 None] Deleted volume successfully. Sep 10 16:53:15 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5557907c-4d74-4614-9da5-0aedec087ddd tempest-TestImageHashVerification-1458119380 None] Lock "cinder-be1aff36-d818-45c7-bf14-eb4e94d8e606-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:53:15 devstack sudo[103565]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7" returned: 0 in 0.412s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] will copy from snapshot at /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7 {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 16:53:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Creating direct copy from snapshot {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 16:53:15 devstack cinder-volume[88189]: DEBUG cinder.utils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Path /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8013c38d-8e91-49eb-9871-6de1f153ffbf not found in is_blk_device check {{(pid=88189) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 16:53:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8013c38d-8e91-49eb-9871-6de1f153ffbf {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:15 devstack sudo[103573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8013c38d-8e91-49eb-9871-6de1f153ffbf Sep 10 16:53:15 devstack sudo[103573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:19 devstack sudo[103573]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8013c38d-8e91-49eb-9871-6de1f153ffbf" returned: 0 in 4.863s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:19 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Image conversion details: src /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7, size 1024.00 MB, duration 4.86 sec, destination /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8013c38d-8e91-49eb-9871-6de1f153ffbf {{(pid=88189) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 16:53:19 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Converted 1024.00 MB image at 210.53 MB/s Sep 10 16:53:19 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8013c38d-8e91-49eb-9871-6de1f153ffbf is being set with open permissions: ugo+rw Sep 10 16:53:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8013c38d-8e91-49eb-9871-6de1f153ffbf {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:19 devstack sudo[103624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8013c38d-8e91-49eb-9871-6de1f153ffbf Sep 10 16:53:19 devstack sudo[103624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:20 devstack sudo[103624]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8013c38d-8e91-49eb-9871-6de1f153ffbf" returned: 0 in 0.239s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:20 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Lock "cinder-quobyte-8013c38d-8e91-49eb-9871-6de1f153ffbf" released by "_copy_volume_from_snapshot" :: held 5.950s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:53:20 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Acquiring lock "cinder-quobyte-f07840fa-f192-4396-aaee-c81bbb607912" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:53:20 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Lock "cinder-quobyte-f07840fa-f192-4396-aaee-c81bbb607912" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:53:20 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Deleting offline snapshot f07840fa-f192-4396-aaee-c81bbb607912 of volume 0512097d-9917-477d-a080-ef25ce4a9ad7 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:53:20 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] snapshot_file for this snap is: volume-0512097d-9917-477d-a080-ef25ce4a9ad7.f07840fa-f192-4396-aaee-c81bbb607912 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:53:20 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7009e118-4635-41f2-8019-bd16d7c22070]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:53:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7.f07840fa-f192-4396-aaee-c81bbb607912 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:20 devstack sudo[103627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7.f07840fa-f192-4396-aaee-c81bbb607912 Sep 10 16:53:20 devstack sudo[103627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:20 devstack sudo[103627]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7.f07840fa-f192-4396-aaee-c81bbb607912" returned: 0 in 0.349s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:20 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0512097d-9917-477d-a080-ef25ce4a9ad7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:53:20 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeebde79-814c-43c9-a738-352cbd6c3aa2]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:53:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:20 devstack sudo[103633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7 Sep 10 16:53:20 devstack sudo[103633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:21 devstack sudo[103633]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7" returned: 0 in 0.595s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7.f07840fa-f192-4396-aaee-c81bbb607912 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:21 devstack sudo[103638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7.f07840fa-f192-4396-aaee-c81bbb607912 Sep 10 16:53:21 devstack sudo[103638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:21 devstack sudo[103638]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7.f07840fa-f192-4396-aaee-c81bbb607912" returned: 0 in 0.351s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7.f07840fa-f192-4396-aaee-c81bbb607912 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:21 devstack sudo[103644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7.f07840fa-f192-4396-aaee-c81bbb607912 Sep 10 16:53:21 devstack sudo[103644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:21 devstack sudo[103644]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7.f07840fa-f192-4396-aaee-c81bbb607912" returned: 0 in 0.258s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Lock "cinder-quobyte-f07840fa-f192-4396-aaee-c81bbb607912" released by "_delete_snapshot" :: held 1.641s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:53:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.588s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:53:21 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6774b9d0-b30e-42fa-a874-c01c52a81fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8013c38d-8e91-49eb-9871-6de1f153ffbf', 'volume_size': 1, 'source_volid': '0512097d-9917-477d-a080-ef25ce4a9ad7', 'source_volstatus': 'available'}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:53:21 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (128698b3-df70-49ad-bebd-030aa1586f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:53:21 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Volume volume-8013c38d-8e91-49eb-9871-6de1f153ffbf (8013c38d-8e91-49eb-9871-6de1f153ffbf): created successfully Sep 10 16:53:21 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (128698b3-df70-49ad-bebd-030aa1586f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:53:21 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Flow 'volume_create_manager' (747fdcdd-2f00-401e-bb58-7d67e7ceb987) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:53:21 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-a098479a-6085-4b35-8242-24a85084ad33 tempest-VolumesGetTest-2060595714 None] Created volume successfully. Sep 10 16:53:22 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7188635-146d-43b5-a1bd-66ead2e14b53 tempest-VolumesGetTest-2060595714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:53:22 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c7188635-146d-43b5-a1bd-66ead2e14b53 tempest-VolumesGetTest-2060595714 None] Flow 'volume_create_manager' (9734db77-1494-4360-8d19-d7bab1bb93fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:53:22 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c7188635-146d-43b5-a1bd-66ead2e14b53 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d3013b3-6714-40c5-bf65-29ae820353f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:53:22 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c7188635-146d-43b5-a1bd-66ead2e14b53 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d3013b3-6714-40c5-bf65-29ae820353f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:53:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-661567893',display_name='tempest-VolumesGetTest-Volume-149279357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67f03d0a-0baf-4a8a-9703-e5cc29869aac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842073a1662740d5a7d0a4150349dc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:53:23Z,use_quota=True,user_id='c67a14f8b0464a299ebeb3caef9a0947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:53:22 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c7188635-146d-43b5-a1bd-66ead2e14b53 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed005619-011f-44ae-8811-9772ba775e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:53:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c7188635-146d-43b5-a1bd-66ead2e14b53 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed005619-011f-44ae-8811-9772ba775e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:53:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c7188635-146d-43b5-a1bd-66ead2e14b53 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cfe8f3e-9dc2-42ae-9a30-06a05fd8930f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:53:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c7188635-146d-43b5-a1bd-66ead2e14b53 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cfe8f3e-9dc2-42ae-9a30-06a05fd8930f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67f03d0a-0baf-4a8a-9703-e5cc29869aac', 'volume_name': 'volume-67f03d0a-0baf-4a8a-9703-e5cc29869aac', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:53:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c7188635-146d-43b5-a1bd-66ead2e14b53 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (182794f9-7b5a-4d7a-9ecd-85a38d8ec418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:53:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c7188635-146d-43b5-a1bd-66ead2e14b53 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (182794f9-7b5a-4d7a-9ecd-85a38d8ec418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:53:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c7188635-146d-43b5-a1bd-66ead2e14b53 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c704e4-2878-45df-97a9-a4667b71d96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:53:23 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-c7188635-146d-43b5-a1bd-66ead2e14b53 tempest-VolumesGetTest-2060595714 None] Volume 67f03d0a-0baf-4a8a-9703-e5cc29869aac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67f03d0a-0baf-4a8a-9703-e5cc29869aac', 'volume_size': 1} Sep 10 16:53:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c7188635-146d-43b5-a1bd-66ead2e14b53 tempest-VolumesGetTest-2060595714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:53:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c7188635-146d-43b5-a1bd-66ead2e14b53 tempest-VolumesGetTest-2060595714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:53:23 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c7188635-146d-43b5-a1bd-66ead2e14b53 tempest-VolumesGetTest-2060595714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:53:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-661567893',display_name='tempest-VolumesGetTest-Volume-149279357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67f03d0a-0baf-4a8a-9703-e5cc29869aac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842073a1662740d5a7d0a4150349dc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:53:23Z,use_quota=True,user_id='c67a14f8b0464a299ebeb3caef9a0947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:53:23 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-c7188635-146d-43b5-a1bd-66ead2e14b53 tempest-VolumesGetTest-2060595714 None] Creating volume 67f03d0a-0baf-4a8a-9703-e5cc29869aac {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:53:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c7188635-146d-43b5-a1bd-66ead2e14b53 tempest-VolumesGetTest-2060595714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:53:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c7188635-146d-43b5-a1bd-66ead2e14b53 tempest-VolumesGetTest-2060595714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:53:23 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c7188635-146d-43b5-a1bd-66ead2e14b53 tempest-VolumesGetTest-2060595714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:53:23 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c7188635-146d-43b5-a1bd-66ead2e14b53 tempest-VolumesGetTest-2060595714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:53:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c7188635-146d-43b5-a1bd-66ead2e14b53 tempest-VolumesGetTest-2060595714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:53:23 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c7188635-146d-43b5-a1bd-66ead2e14b53 tempest-VolumesGetTest-2060595714 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:53:23 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-c7188635-146d-43b5-a1bd-66ead2e14b53 tempest-VolumesGetTest-2060595714 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:53:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c7188635-146d-43b5-a1bd-66ead2e14b53 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-67f03d0a-0baf-4a8a-9703-e5cc29869aac 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:23 devstack sudo[103647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-67f03d0a-0baf-4a8a-9703-e5cc29869aac 1073741824 Sep 10 16:53:23 devstack sudo[103647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:23 devstack sudo[103647]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c7188635-146d-43b5-a1bd-66ead2e14b53 tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-67f03d0a-0baf-4a8a-9703-e5cc29869aac 1073741824" returned: 0 in 0.415s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c7188635-146d-43b5-a1bd-66ead2e14b53 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-67f03d0a-0baf-4a8a-9703-e5cc29869aac {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:23 devstack sudo[103653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-67f03d0a-0baf-4a8a-9703-e5cc29869aac Sep 10 16:53:23 devstack sudo[103653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:23 devstack sudo[103653]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c7188635-146d-43b5-a1bd-66ead2e14b53 tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-67f03d0a-0baf-4a8a-9703-e5cc29869aac" returned: 0 in 0.255s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:23 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c7188635-146d-43b5-a1bd-66ead2e14b53 tempest-VolumesGetTest-2060595714 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:53:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c7188635-146d-43b5-a1bd-66ead2e14b53 tempest-VolumesGetTest-2060595714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:53:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c7188635-146d-43b5-a1bd-66ead2e14b53 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c704e4-2878-45df-97a9-a4667b71d96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67f03d0a-0baf-4a8a-9703-e5cc29869aac', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:53:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c7188635-146d-43b5-a1bd-66ead2e14b53 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e30d9ac0-3b8c-492a-a9fe-ce18496252b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:53:23 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-c7188635-146d-43b5-a1bd-66ead2e14b53 tempest-VolumesGetTest-2060595714 None] Volume volume-67f03d0a-0baf-4a8a-9703-e5cc29869aac (67f03d0a-0baf-4a8a-9703-e5cc29869aac): created successfully Sep 10 16:53:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c7188635-146d-43b5-a1bd-66ead2e14b53 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e30d9ac0-3b8c-492a-a9fe-ce18496252b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:53:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c7188635-146d-43b5-a1bd-66ead2e14b53 tempest-VolumesGetTest-2060595714 None] Flow 'volume_create_manager' (9734db77-1494-4360-8d19-d7bab1bb93fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:53:23 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-c7188635-146d-43b5-a1bd-66ead2e14b53 tempest-VolumesGetTest-2060595714 None] Created volume successfully. Sep 10 16:53:24 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-034fc6a5-7175-4908-8962-6de20b142229 tempest-VolumesGetTest-2060595714 None] Acquiring lock "cinder-67f03d0a-0baf-4a8a-9703-e5cc29869aac-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:53:24 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-034fc6a5-7175-4908-8962-6de20b142229 tempest-VolumesGetTest-2060595714 None] Lock "cinder-67f03d0a-0baf-4a8a-9703-e5cc29869aac-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:53:24 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-034fc6a5-7175-4908-8962-6de20b142229 tempest-VolumesGetTest-2060595714 None] Acquiring lock "cinder-quobyte-67f03d0a-0baf-4a8a-9703-e5cc29869aac" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:53:24 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-034fc6a5-7175-4908-8962-6de20b142229 tempest-VolumesGetTest-2060595714 None] Lock "cinder-quobyte-67f03d0a-0baf-4a8a-9703-e5cc29869aac" acquired by "delete_volume" :: waited 0.023s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:53:24 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83973e5-2b3d-402b-85bd-a484ceff64e0]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:53:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-034fc6a5-7175-4908-8962-6de20b142229 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-67f03d0a-0baf-4a8a-9703-e5cc29869aac {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:24 devstack sudo[103657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-67f03d0a-0baf-4a8a-9703-e5cc29869aac Sep 10 16:53:24 devstack sudo[103657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:24 devstack sudo[103657]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-034fc6a5-7175-4908-8962-6de20b142229 tempest-VolumesGetTest-2060595714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-67f03d0a-0baf-4a8a-9703-e5cc29869aac" returned: 0 in 0.383s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-034fc6a5-7175-4908-8962-6de20b142229 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-67f03d0a-0baf-4a8a-9703-e5cc29869aac {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:24 devstack sudo[103662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-67f03d0a-0baf-4a8a-9703-e5cc29869aac Sep 10 16:53:24 devstack sudo[103662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:24 devstack sudo[103662]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-034fc6a5-7175-4908-8962-6de20b142229 tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-67f03d0a-0baf-4a8a-9703-e5cc29869aac" returned: 0 in 0.247s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:24 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-034fc6a5-7175-4908-8962-6de20b142229 tempest-VolumesGetTest-2060595714 None] Lock "cinder-quobyte-67f03d0a-0baf-4a8a-9703-e5cc29869aac" released by "delete_volume" :: held 0.672s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:53:24 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-034fc6a5-7175-4908-8962-6de20b142229 tempest-VolumesGetTest-2060595714 None] Created reservations ['7a215df7-47c9-42ea-bea5-19a1c143126a', '586262c3-7fec-485c-bda8-2b3ea65f6523', '26d47f78-8022-45fd-be71-34a3a442c156', 'acfc56d2-cf14-4d07-bd7c-08fab70c4ae9'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:53:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-034fc6a5-7175-4908-8962-6de20b142229 tempest-VolumesGetTest-2060595714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:53:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-034fc6a5-7175-4908-8962-6de20b142229 tempest-VolumesGetTest-2060595714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:53:24 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-034fc6a5-7175-4908-8962-6de20b142229 tempest-VolumesGetTest-2060595714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:53:24 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-034fc6a5-7175-4908-8962-6de20b142229 tempest-VolumesGetTest-2060595714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:53:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-034fc6a5-7175-4908-8962-6de20b142229 tempest-VolumesGetTest-2060595714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:53:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-034fc6a5-7175-4908-8962-6de20b142229 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:24 devstack sudo[103665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:53:24 devstack sudo[103665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:25 devstack sudo[103665]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-034fc6a5-7175-4908-8962-6de20b142229 tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.245s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:25 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-034fc6a5-7175-4908-8962-6de20b142229 tempest-VolumesGetTest-2060595714 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:53:25 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-034fc6a5-7175-4908-8962-6de20b142229 tempest-VolumesGetTest-2060595714 None] Deleted volume successfully. Sep 10 16:53:25 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-034fc6a5-7175-4908-8962-6de20b142229 tempest-VolumesGetTest-2060595714 None] Lock "cinder-67f03d0a-0baf-4a8a-9703-e5cc29869aac-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:53:25 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-0c19d360-03da-4f50-a30a-30665dc9ca04 tempest-VolumesGetTest-2060595714 None] Acquiring lock "cinder-8013c38d-8e91-49eb-9871-6de1f153ffbf-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:53:25 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-0c19d360-03da-4f50-a30a-30665dc9ca04 tempest-VolumesGetTest-2060595714 None] Lock "cinder-8013c38d-8e91-49eb-9871-6de1f153ffbf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:53:25 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-0c19d360-03da-4f50-a30a-30665dc9ca04 tempest-VolumesGetTest-2060595714 None] Acquiring lock "cinder-quobyte-8013c38d-8e91-49eb-9871-6de1f153ffbf" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:53:25 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-0c19d360-03da-4f50-a30a-30665dc9ca04 tempest-VolumesGetTest-2060595714 None] Lock "cinder-quobyte-8013c38d-8e91-49eb-9871-6de1f153ffbf" acquired by "delete_volume" :: waited 0.023s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:53:25 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[292d8c01-ce37-456b-a181-4655e0ffdee8]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:53:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0c19d360-03da-4f50-a30a-30665dc9ca04 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8013c38d-8e91-49eb-9871-6de1f153ffbf {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:25 devstack sudo[103674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8013c38d-8e91-49eb-9871-6de1f153ffbf Sep 10 16:53:25 devstack sudo[103674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:25 devstack sudo[103674]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0c19d360-03da-4f50-a30a-30665dc9ca04 tempest-VolumesGetTest-2060595714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8013c38d-8e91-49eb-9871-6de1f153ffbf" returned: 0 in 0.413s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0c19d360-03da-4f50-a30a-30665dc9ca04 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8013c38d-8e91-49eb-9871-6de1f153ffbf {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:25 devstack sudo[103679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8013c38d-8e91-49eb-9871-6de1f153ffbf Sep 10 16:53:25 devstack sudo[103679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:26 devstack sudo[103679]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0c19d360-03da-4f50-a30a-30665dc9ca04 tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8013c38d-8e91-49eb-9871-6de1f153ffbf" returned: 0 in 0.252s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:26 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-0c19d360-03da-4f50-a30a-30665dc9ca04 tempest-VolumesGetTest-2060595714 None] Lock "cinder-quobyte-8013c38d-8e91-49eb-9871-6de1f153ffbf" released by "delete_volume" :: held 0.713s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:53:26 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-0c19d360-03da-4f50-a30a-30665dc9ca04 tempest-VolumesGetTest-2060595714 None] Created reservations ['643d8ed3-0acb-42b5-abe5-be68481db021', '38312812-eea2-413e-a837-78bf97af0349', '0620d209-4dca-43c3-9d7b-bf51d22b0a0a', '73d83b63-3313-4422-96fd-6da99aba50e3'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:53:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0c19d360-03da-4f50-a30a-30665dc9ca04 tempest-VolumesGetTest-2060595714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:53:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0c19d360-03da-4f50-a30a-30665dc9ca04 tempest-VolumesGetTest-2060595714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:53:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0c19d360-03da-4f50-a30a-30665dc9ca04 tempest-VolumesGetTest-2060595714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:53:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0c19d360-03da-4f50-a30a-30665dc9ca04 tempest-VolumesGetTest-2060595714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:53:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0c19d360-03da-4f50-a30a-30665dc9ca04 tempest-VolumesGetTest-2060595714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:53:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0c19d360-03da-4f50-a30a-30665dc9ca04 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:26 devstack sudo[103682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:53:26 devstack sudo[103682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:26 devstack sudo[103682]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:26 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a07aeff1-12f4-4a94-a161-df77227f6bc7 tempest-VolumesGetTest-2060595714 None] Acquiring lock "cinder-0512097d-9917-477d-a080-ef25ce4a9ad7-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:53:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0c19d360-03da-4f50-a30a-30665dc9ca04 tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.302s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:26 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-0c19d360-03da-4f50-a30a-30665dc9ca04 tempest-VolumesGetTest-2060595714 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:53:26 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-0c19d360-03da-4f50-a30a-30665dc9ca04 tempest-VolumesGetTest-2060595714 None] Deleted volume successfully. Sep 10 16:53:26 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a07aeff1-12f4-4a94-a161-df77227f6bc7 tempest-VolumesGetTest-2060595714 None] Lock "cinder-0512097d-9917-477d-a080-ef25ce4a9ad7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:53:26 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-0c19d360-03da-4f50-a30a-30665dc9ca04 tempest-VolumesGetTest-2060595714 None] Lock "cinder-8013c38d-8e91-49eb-9871-6de1f153ffbf-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:53:26 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a07aeff1-12f4-4a94-a161-df77227f6bc7 tempest-VolumesGetTest-2060595714 None] Acquiring lock "cinder-quobyte-0512097d-9917-477d-a080-ef25ce4a9ad7" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:53:26 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a07aeff1-12f4-4a94-a161-df77227f6bc7 tempest-VolumesGetTest-2060595714 None] Lock "cinder-quobyte-0512097d-9917-477d-a080-ef25ce4a9ad7" acquired by "delete_volume" :: waited 0.017s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:53:26 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8316f2-85bb-44c3-8046-248a140cf2d9]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:53:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a07aeff1-12f4-4a94-a161-df77227f6bc7 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:26 devstack sudo[103686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7 Sep 10 16:53:26 devstack sudo[103686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:27 devstack sudo[103686]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a07aeff1-12f4-4a94-a161-df77227f6bc7 tempest-VolumesGetTest-2060595714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7" returned: 0 in 0.380s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a07aeff1-12f4-4a94-a161-df77227f6bc7 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:27 devstack sudo[103691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7 Sep 10 16:53:27 devstack sudo[103691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:27 devstack sudo[103691]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a07aeff1-12f4-4a94-a161-df77227f6bc7 tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0512097d-9917-477d-a080-ef25ce4a9ad7" returned: 0 in 0.286s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:27 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a07aeff1-12f4-4a94-a161-df77227f6bc7 tempest-VolumesGetTest-2060595714 None] Lock "cinder-quobyte-0512097d-9917-477d-a080-ef25ce4a9ad7" released by "delete_volume" :: held 0.735s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:53:27 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-a07aeff1-12f4-4a94-a161-df77227f6bc7 tempest-VolumesGetTest-2060595714 None] Created reservations ['a4eb62c3-3f0e-4ca6-918c-d3d64f44d80b', '36f209c4-f8bd-481a-be3f-9001b6156a0c', '92d1abbf-ec0c-41a5-a08a-981509a9aee1', 'e3ac83bf-98a1-479e-979e-d09bbead18b3'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:53:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a07aeff1-12f4-4a94-a161-df77227f6bc7 tempest-VolumesGetTest-2060595714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:53:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a07aeff1-12f4-4a94-a161-df77227f6bc7 tempest-VolumesGetTest-2060595714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:53:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-a07aeff1-12f4-4a94-a161-df77227f6bc7 tempest-VolumesGetTest-2060595714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:53:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-a07aeff1-12f4-4a94-a161-df77227f6bc7 tempest-VolumesGetTest-2060595714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:53:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a07aeff1-12f4-4a94-a161-df77227f6bc7 tempest-VolumesGetTest-2060595714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:53:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a07aeff1-12f4-4a94-a161-df77227f6bc7 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:27 devstack sudo[103694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:53:27 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:27 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a07aeff1-12f4-4a94-a161-df77227f6bc7 tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.261s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:27 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-a07aeff1-12f4-4a94-a161-df77227f6bc7 tempest-VolumesGetTest-2060595714 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:53:27 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-a07aeff1-12f4-4a94-a161-df77227f6bc7 tempest-VolumesGetTest-2060595714 None] Deleted volume successfully. Sep 10 16:53:27 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a07aeff1-12f4-4a94-a161-df77227f6bc7 tempest-VolumesGetTest-2060595714 None] Lock "cinder-0512097d-9917-477d-a080-ef25ce4a9ad7-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:53:28 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:53:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Flow 'volume_create_manager' (08d86cbf-5f8c-41d9-bac9-646590452780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:53:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d42d2d2-1087-403d-abd3-046a69ba5016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:53:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d42d2d2-1087-403d-abd3-046a69ba5016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-941851249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2213b289-badf-4da1-badf-b991824d9ae1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='842073a1662740d5a7d0a4150349dc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:53:28Z,use_quota=True,user_id='c67a14f8b0464a299ebeb3caef9a0947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:53:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7e95ee1-d77f-43ef-b4f6-cbd5c34204e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:53:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7e95ee1-d77f-43ef-b4f6-cbd5c34204e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:53:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1681c57-5325-44dc-a86e-93057d0d55e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:53:28 devstack cinder-volume[88189]: DEBUG cinder.image.glance [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Creating Keystone auth plugin from conf {{(pid=88189) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 16:53:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1681c57-5325-44dc-a86e-93057d0d55e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2213b289-badf-4da1-badf-b991824d9ae1', 'volume_name': 'volume-2213b289-badf-4da1-badf-b991824d9ae1', 'volume_size': 1, 'image_id': '5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dbb77788940a4d64b2cf7dbf5431f2a1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'created_at': datetime.datetime(2026, 9, 10, 14, 32, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 14, 32, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:53:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa03d837-9153-4b04-8da3-aa9a86f68aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:53:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa03d837-9153-4b04-8da3-aa9a86f68aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:53:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2a135a-1478-40c9-9eed-50471923859a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:53:28 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Volume 2213b289-badf-4da1-badf-b991824d9ae1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2213b289-badf-4da1-badf-b991824d9ae1', 'volume_size': 1, 'image_id': '5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dbb77788940a4d64b2cf7dbf5431f2a1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'created_at': datetime.datetime(2026, 9, 10, 14, 32, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 14, 32, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 16:53:28 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Trying to clone 2213b289-badf-4da1-badf-b991824d9ae1 from image 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'metadata': {}}]). {{(pid=88189) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 16:53:29 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_wyz6k6bbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88189) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 16:53:29 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Image download 20.69 MB at 20.69 MB/s Sep 10 16:53:29 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adb8a4a-77e2-46dd-8903-775ae492b8f6]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:53:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_wyz6k6bbdevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:29 devstack sudo[103698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_wyz6k6bbdevstack@QuobyteHD Sep 10 16:53:29 devstack sudo[103698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:29 devstack sudo[103698]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_wyz6k6bbdevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:29 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Temporary image 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 is fetched for user c67a14f8b0464a299ebeb3caef9a0947. {{(pid=88189) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 16:53:29 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[344ce574-18af-49d8-9890-9a6c8c057efa]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:53:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_wyz6k6bbdevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:29 devstack sudo[103703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_wyz6k6bbdevstack@QuobyteHD Sep 10 16:53:29 devstack sudo[103703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:30 devstack sudo[103703]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_wyz6k6bbdevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:53:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:53:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-941851249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2213b289-badf-4da1-badf-b991824d9ae1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='842073a1662740d5a7d0a4150349dc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:53:28Z,use_quota=True,user_id='c67a14f8b0464a299ebeb3caef9a0947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:53:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Creating volume 2213b289-badf-4da1-badf-b991824d9ae1 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:53:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:53:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:53:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:53:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:53:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:53:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:53:30 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:53:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2213b289-badf-4da1-badf-b991824d9ae1 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:30 devstack sudo[103708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2213b289-badf-4da1-badf-b991824d9ae1 1073741824 Sep 10 16:53:30 devstack sudo[103708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:30 devstack sudo[103708]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2213b289-badf-4da1-badf-b991824d9ae1 1073741824" returned: 0 in 0.496s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2213b289-badf-4da1-badf-b991824d9ae1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:30 devstack sudo[103715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2213b289-badf-4da1-badf-b991824d9ae1 Sep 10 16:53:30 devstack sudo[103715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:30 devstack sudo[103715]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2213b289-badf-4da1-badf-b991824d9ae1" returned: 0 in 0.243s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:53:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:53:30 devstack cinder-volume[88189]: DEBUG cinder.volume.volume_utils [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Attempting download of 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'metadata': {}}])) to volume 2213b289-badf-4da1-badf-b991824d9ae1. {{(pid=88189) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 16:53:30 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37e2c5b-9b3d-4d36-ba69-9530b790dfaf]: (4, 'raw') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:53:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_x7bhr6am {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:31 devstack sudo[103718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_x7bhr6am Sep 10 16:53:31 devstack sudo[103718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:31 devstack sudo[103718]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_x7bhr6am" returned: 0 in 0.340s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_x7bhr6am {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:31 devstack sudo[103722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_x7bhr6am Sep 10 16:53:31 devstack sudo[103722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:31 devstack sudo[103722]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_x7bhr6am" returned: 1 in 0.350s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_x7bhr6am' failed. Not Retrying. {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 16:53:31 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8347ee2-6351-4b1b-a774-7d1f71a57863]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:53:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_wyz6k6bbdevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:31 devstack sudo[103726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_wyz6k6bbdevstack@QuobyteHD Sep 10 16:53:31 devstack sudo[103726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:31 devstack sudo[103726]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_wyz6k6bbdevstack@QuobyteHD" returned: 0 in 0.333s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:31 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 was qcow2, converting to qcow2 {{(pid=88189) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 16:53:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_wyz6k6bbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2213b289-badf-4da1-badf-b991824d9ae1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:32 devstack sudo[103731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_wyz6k6bbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2213b289-badf-4da1-badf-b991824d9ae1 Sep 10 16:53:32 devstack sudo[103731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:33 devstack sudo[103731]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_wyz6k6bbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2213b289-badf-4da1-badf-b991824d9ae1" returned: 0 in 1.727s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:33 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1_wyz6k6bbdevstack@QuobyteHD, size 112.00 MB, duration 1.73 sec, destination /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2213b289-badf-4da1-badf-b991824d9ae1 {{(pid=88189) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 16:53:33 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Converted 112.00 MB image at 64.79 MB/s Sep 10 16:53:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2213b289-badf-4da1-badf-b991824d9ae1 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:33 devstack sudo[103739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2213b289-badf-4da1-badf-b991824d9ae1 1G Sep 10 16:53:33 devstack sudo[103739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:34 devstack sudo[103739]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2213b289-badf-4da1-badf-b991824d9ae1 1G" returned: 0 in 0.392s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:34 devstack cinder-volume[88189]: DEBUG cinder.volume.volume_utils [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Downloaded image 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'metadata': {}}])) to volume 2213b289-badf-4da1-badf-b991824d9ae1 successfully. {{(pid=88189) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 16:53:34 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Temporary image 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 for user c67a14f8b0464a299ebeb3caef9a0947 is deleted. {{(pid=88189) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 16:53:34 devstack cinder-volume[88189]: DEBUG cinder.volume.volume_utils [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Marking volume 2213b289-badf-4da1-badf-b991824d9ae1 as bootable. {{(pid=88189) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 16:53:34 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Copying metadata from image 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 to 2213b289-badf-4da1-badf-b991824d9ae1. {{(pid=88189) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 16:53:34 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Creating volume glance metadata for volume 2213b289-badf-4da1-badf-b991824d9ae1 backed by image 5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88189) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 16:53:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2a135a-1478-40c9-9eed-50471923859a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2213b289-badf-4da1-badf-b991824d9ae1', 'volume_size': 1, 'image_id': '5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dbb77788940a4d64b2cf7dbf5431f2a1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1', 'created_at': datetime.datetime(2026, 9, 10, 14, 32, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 14, 32, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fd6fa1f-f0fa-466d-b7d9-e05af8fd48e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:53:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f86888f-47ff-4377-9479-b95c9b660bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:53:34 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Volume volume-2213b289-badf-4da1-badf-b991824d9ae1 (2213b289-badf-4da1-badf-b991824d9ae1): created successfully Sep 10 16:53:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f86888f-47ff-4377-9479-b95c9b660bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:53:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Flow 'volume_create_manager' (08d86cbf-5f8c-41d9-bac9-646590452780) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:53:34 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-5f6dd2c6-6ad5-4df4-ac3b-15578e6d1338 tempest-VolumesGetTest-2060595714 None] Created volume successfully. Sep 10 16:53:35 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4c4b565-90e2-4f86-98b9-17dde6705ac7 tempest-VolumesGetTest-2060595714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:53:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c4c4b565-90e2-4f86-98b9-17dde6705ac7 tempest-VolumesGetTest-2060595714 None] Flow 'volume_create_manager' (a4aff241-2f29-4e15-a62a-f8639c9b1275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:53:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c4c4b565-90e2-4f86-98b9-17dde6705ac7 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2195bc2-e50e-4abb-b656-691988cd4cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:53:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c4c4b565-90e2-4f86-98b9-17dde6705ac7 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2195bc2-e50e-4abb-b656-691988cd4cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:53:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1733622286',display_name='tempest-VolumesGetTest-Volume-1073182675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeddbaf8-a694-46c7-b071-a035c7dc469b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842073a1662740d5a7d0a4150349dc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:53:36Z,use_quota=True,user_id='c67a14f8b0464a299ebeb3caef9a0947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:53:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c4c4b565-90e2-4f86-98b9-17dde6705ac7 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3f8417-2920-479e-b98f-b9d84c02ddaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:53:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c4c4b565-90e2-4f86-98b9-17dde6705ac7 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3f8417-2920-479e-b98f-b9d84c02ddaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:53:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c4c4b565-90e2-4f86-98b9-17dde6705ac7 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ed3b9b-8245-4df3-91c7-ff2a16faa5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:53:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c4c4b565-90e2-4f86-98b9-17dde6705ac7 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ed3b9b-8245-4df3-91c7-ff2a16faa5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeddbaf8-a694-46c7-b071-a035c7dc469b', 'volume_name': 'volume-aeddbaf8-a694-46c7-b071-a035c7dc469b', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:53:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c4c4b565-90e2-4f86-98b9-17dde6705ac7 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0289982-ae75-47d3-b12e-1a284b1d702e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:53:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c4c4b565-90e2-4f86-98b9-17dde6705ac7 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0289982-ae75-47d3-b12e-1a284b1d702e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:53:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c4c4b565-90e2-4f86-98b9-17dde6705ac7 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb42b81-2913-4dfa-913f-2fd14727d945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:53:35 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-c4c4b565-90e2-4f86-98b9-17dde6705ac7 tempest-VolumesGetTest-2060595714 None] Volume aeddbaf8-a694-46c7-b071-a035c7dc469b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeddbaf8-a694-46c7-b071-a035c7dc469b', 'volume_size': 1} Sep 10 16:53:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c4c4b565-90e2-4f86-98b9-17dde6705ac7 tempest-VolumesGetTest-2060595714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:53:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c4c4b565-90e2-4f86-98b9-17dde6705ac7 tempest-VolumesGetTest-2060595714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:53:35 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c4c4b565-90e2-4f86-98b9-17dde6705ac7 tempest-VolumesGetTest-2060595714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:53:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1733622286',display_name='tempest-VolumesGetTest-Volume-1073182675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeddbaf8-a694-46c7-b071-a035c7dc469b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842073a1662740d5a7d0a4150349dc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:53:36Z,use_quota=True,user_id='c67a14f8b0464a299ebeb3caef9a0947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:53:35 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-c4c4b565-90e2-4f86-98b9-17dde6705ac7 tempest-VolumesGetTest-2060595714 None] Creating volume aeddbaf8-a694-46c7-b071-a035c7dc469b {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:53:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c4c4b565-90e2-4f86-98b9-17dde6705ac7 tempest-VolumesGetTest-2060595714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:53:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c4c4b565-90e2-4f86-98b9-17dde6705ac7 tempest-VolumesGetTest-2060595714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:53:35 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c4c4b565-90e2-4f86-98b9-17dde6705ac7 tempest-VolumesGetTest-2060595714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:53:35 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c4c4b565-90e2-4f86-98b9-17dde6705ac7 tempest-VolumesGetTest-2060595714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:53:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c4c4b565-90e2-4f86-98b9-17dde6705ac7 tempest-VolumesGetTest-2060595714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:53:35 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c4c4b565-90e2-4f86-98b9-17dde6705ac7 tempest-VolumesGetTest-2060595714 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:53:35 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-c4c4b565-90e2-4f86-98b9-17dde6705ac7 tempest-VolumesGetTest-2060595714 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:53:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c4c4b565-90e2-4f86-98b9-17dde6705ac7 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-aeddbaf8-a694-46c7-b071-a035c7dc469b 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:35 devstack sudo[103744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-aeddbaf8-a694-46c7-b071-a035c7dc469b 1073741824 Sep 10 16:53:35 devstack sudo[103744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:36 devstack sudo[103744]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c4c4b565-90e2-4f86-98b9-17dde6705ac7 tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-aeddbaf8-a694-46c7-b071-a035c7dc469b 1073741824" returned: 0 in 0.477s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c4c4b565-90e2-4f86-98b9-17dde6705ac7 tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-aeddbaf8-a694-46c7-b071-a035c7dc469b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:36 devstack sudo[103750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-aeddbaf8-a694-46c7-b071-a035c7dc469b Sep 10 16:53:36 devstack sudo[103750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:36 devstack sudo[103750]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c4c4b565-90e2-4f86-98b9-17dde6705ac7 tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-aeddbaf8-a694-46c7-b071-a035c7dc469b" returned: 0 in 0.263s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:36 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c4c4b565-90e2-4f86-98b9-17dde6705ac7 tempest-VolumesGetTest-2060595714 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:53:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c4c4b565-90e2-4f86-98b9-17dde6705ac7 tempest-VolumesGetTest-2060595714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:53:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c4c4b565-90e2-4f86-98b9-17dde6705ac7 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb42b81-2913-4dfa-913f-2fd14727d945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeddbaf8-a694-46c7-b071-a035c7dc469b', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:53:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c4c4b565-90e2-4f86-98b9-17dde6705ac7 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc0b92be-21ab-4196-9637-1970c8960bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:53:36 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-c4c4b565-90e2-4f86-98b9-17dde6705ac7 tempest-VolumesGetTest-2060595714 None] Volume volume-aeddbaf8-a694-46c7-b071-a035c7dc469b (aeddbaf8-a694-46c7-b071-a035c7dc469b): created successfully Sep 10 16:53:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c4c4b565-90e2-4f86-98b9-17dde6705ac7 tempest-VolumesGetTest-2060595714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc0b92be-21ab-4196-9637-1970c8960bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:53:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-c4c4b565-90e2-4f86-98b9-17dde6705ac7 tempest-VolumesGetTest-2060595714 None] Flow 'volume_create_manager' (a4aff241-2f29-4e15-a62a-f8639c9b1275) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:53:36 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-c4c4b565-90e2-4f86-98b9-17dde6705ac7 tempest-VolumesGetTest-2060595714 None] Created volume successfully. Sep 10 16:53:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-108ae5c9-c75f-46a0-bbb2-259ce75159fa tempest-VolumesGetTest-2060595714 None] Acquiring lock "cinder-aeddbaf8-a694-46c7-b071-a035c7dc469b-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:53:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-108ae5c9-c75f-46a0-bbb2-259ce75159fa tempest-VolumesGetTest-2060595714 None] Lock "cinder-aeddbaf8-a694-46c7-b071-a035c7dc469b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:53:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-108ae5c9-c75f-46a0-bbb2-259ce75159fa tempest-VolumesGetTest-2060595714 None] Acquiring lock "cinder-quobyte-aeddbaf8-a694-46c7-b071-a035c7dc469b" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:53:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-108ae5c9-c75f-46a0-bbb2-259ce75159fa tempest-VolumesGetTest-2060595714 None] Lock "cinder-quobyte-aeddbaf8-a694-46c7-b071-a035c7dc469b" acquired by "delete_volume" :: waited 0.018s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:53:36 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b76772-71e6-4933-8e45-187345597588]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:53:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-108ae5c9-c75f-46a0-bbb2-259ce75159fa tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-aeddbaf8-a694-46c7-b071-a035c7dc469b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:36 devstack sudo[103753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-aeddbaf8-a694-46c7-b071-a035c7dc469b Sep 10 16:53:36 devstack sudo[103753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:37 devstack sudo[103753]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-108ae5c9-c75f-46a0-bbb2-259ce75159fa tempest-VolumesGetTest-2060595714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-aeddbaf8-a694-46c7-b071-a035c7dc469b" returned: 0 in 0.396s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-108ae5c9-c75f-46a0-bbb2-259ce75159fa tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-aeddbaf8-a694-46c7-b071-a035c7dc469b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:37 devstack sudo[103758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-aeddbaf8-a694-46c7-b071-a035c7dc469b Sep 10 16:53:37 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:37 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-108ae5c9-c75f-46a0-bbb2-259ce75159fa tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-aeddbaf8-a694-46c7-b071-a035c7dc469b" returned: 0 in 0.277s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:37 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-108ae5c9-c75f-46a0-bbb2-259ce75159fa tempest-VolumesGetTest-2060595714 None] Lock "cinder-quobyte-aeddbaf8-a694-46c7-b071-a035c7dc469b" released by "delete_volume" :: held 0.718s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:53:37 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-108ae5c9-c75f-46a0-bbb2-259ce75159fa tempest-VolumesGetTest-2060595714 None] Created reservations ['9370d8f7-9604-4291-b520-ed1ab05562eb', '0c5e7c4f-91d1-4251-8a7f-2aeb98f02529', 'a8f77ddb-01d0-4a16-94c0-4f7e5eb56125', 'fd34591e-b73c-4e0c-a3e9-301a04a656b1'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:53:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-108ae5c9-c75f-46a0-bbb2-259ce75159fa tempest-VolumesGetTest-2060595714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:53:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-108ae5c9-c75f-46a0-bbb2-259ce75159fa tempest-VolumesGetTest-2060595714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:53:37 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-108ae5c9-c75f-46a0-bbb2-259ce75159fa tempest-VolumesGetTest-2060595714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:53:37 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-108ae5c9-c75f-46a0-bbb2-259ce75159fa tempest-VolumesGetTest-2060595714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:53:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-108ae5c9-c75f-46a0-bbb2-259ce75159fa tempest-VolumesGetTest-2060595714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:53:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-108ae5c9-c75f-46a0-bbb2-259ce75159fa tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:37 devstack sudo[103761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:53:37 devstack sudo[103761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:37 devstack sudo[103761]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-108ae5c9-c75f-46a0-bbb2-259ce75159fa tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.270s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:37 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-108ae5c9-c75f-46a0-bbb2-259ce75159fa tempest-VolumesGetTest-2060595714 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:53:37 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-108ae5c9-c75f-46a0-bbb2-259ce75159fa tempest-VolumesGetTest-2060595714 None] Deleted volume successfully. Sep 10 16:53:38 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-108ae5c9-c75f-46a0-bbb2-259ce75159fa tempest-VolumesGetTest-2060595714 None] Lock "cinder-aeddbaf8-a694-46c7-b071-a035c7dc469b-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:53:38 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9d0a33c4-34aa-4dc0-800f-9fdd71c36bdb tempest-VolumesGetTest-2060595714 None] Acquiring lock "cinder-2213b289-badf-4da1-badf-b991824d9ae1-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:53:38 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9d0a33c4-34aa-4dc0-800f-9fdd71c36bdb tempest-VolumesGetTest-2060595714 None] Lock "cinder-2213b289-badf-4da1-badf-b991824d9ae1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:53:38 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9d0a33c4-34aa-4dc0-800f-9fdd71c36bdb tempest-VolumesGetTest-2060595714 None] Acquiring lock "cinder-quobyte-2213b289-badf-4da1-badf-b991824d9ae1" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:53:38 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9d0a33c4-34aa-4dc0-800f-9fdd71c36bdb tempest-VolumesGetTest-2060595714 None] Lock "cinder-quobyte-2213b289-badf-4da1-badf-b991824d9ae1" acquired by "delete_volume" :: waited 0.020s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:53:38 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbcd52f-6223-4bf4-802d-b80aabc12ae0]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:53:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9d0a33c4-34aa-4dc0-800f-9fdd71c36bdb tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2213b289-badf-4da1-badf-b991824d9ae1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:38 devstack sudo[103764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2213b289-badf-4da1-badf-b991824d9ae1 Sep 10 16:53:38 devstack sudo[103764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:38 devstack sudo[103764]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9d0a33c4-34aa-4dc0-800f-9fdd71c36bdb tempest-VolumesGetTest-2060595714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2213b289-badf-4da1-badf-b991824d9ae1" returned: 0 in 0.498s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9d0a33c4-34aa-4dc0-800f-9fdd71c36bdb tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2213b289-badf-4da1-badf-b991824d9ae1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:38 devstack sudo[103769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2213b289-badf-4da1-badf-b991824d9ae1 Sep 10 16:53:38 devstack sudo[103769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:38 devstack sudo[103769]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9d0a33c4-34aa-4dc0-800f-9fdd71c36bdb tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2213b289-badf-4da1-badf-b991824d9ae1" returned: 0 in 0.288s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:38 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9d0a33c4-34aa-4dc0-800f-9fdd71c36bdb tempest-VolumesGetTest-2060595714 None] Lock "cinder-quobyte-2213b289-badf-4da1-badf-b991824d9ae1" released by "delete_volume" :: held 0.852s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:53:39 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-9d0a33c4-34aa-4dc0-800f-9fdd71c36bdb tempest-VolumesGetTest-2060595714 None] Created reservations ['b3dbf321-d0e4-4807-a5ef-95aa76f44e92', '4c9e5db8-86ab-4826-bc8b-588409396aee', '4ec2918b-122c-4135-ad62-2c642f785a70', '7f87e3fa-b886-470c-855c-61daf9686219'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:53:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9d0a33c4-34aa-4dc0-800f-9fdd71c36bdb tempest-VolumesGetTest-2060595714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:53:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9d0a33c4-34aa-4dc0-800f-9fdd71c36bdb tempest-VolumesGetTest-2060595714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:53:39 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9d0a33c4-34aa-4dc0-800f-9fdd71c36bdb tempest-VolumesGetTest-2060595714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:53:39 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9d0a33c4-34aa-4dc0-800f-9fdd71c36bdb tempest-VolumesGetTest-2060595714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:53:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9d0a33c4-34aa-4dc0-800f-9fdd71c36bdb tempest-VolumesGetTest-2060595714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:53:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9d0a33c4-34aa-4dc0-800f-9fdd71c36bdb tempest-VolumesGetTest-2060595714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:39 devstack sudo[103772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:53:39 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:39 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9d0a33c4-34aa-4dc0-800f-9fdd71c36bdb tempest-VolumesGetTest-2060595714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.321s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:39 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-9d0a33c4-34aa-4dc0-800f-9fdd71c36bdb tempest-VolumesGetTest-2060595714 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:53:39 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-9d0a33c4-34aa-4dc0-800f-9fdd71c36bdb tempest-VolumesGetTest-2060595714 None] Deleted volume successfully. Sep 10 16:53:39 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9d0a33c4-34aa-4dc0-800f-9fdd71c36bdb tempest-VolumesGetTest-2060595714 None] Lock "cinder-2213b289-badf-4da1-badf-b991824d9ae1-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:53:43 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd5e2bac-82fa-439b-9aeb-6c57db0e1d41 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:53:43 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fd5e2bac-82fa-439b-9aeb-6c57db0e1d41 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Flow 'volume_create_manager' (d7655a6d-3a1d-49f3-a909-4b820a8d6d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:53:43 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fd5e2bac-82fa-439b-9aeb-6c57db0e1d41 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bc741ad-8b14-4698-a8ac-080128348edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:53:43 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fd5e2bac-82fa-439b-9aeb-6c57db0e1d41 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bc741ad-8b14-4698-a8ac-080128348edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-5651255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=073bba95-75ef-4d49-a707-778d8a98e5b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bba7b7c4d6334016b8ecf3961fff267a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:53:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:53:43Z,use_quota=True,user_id='7db8cd357c9946ca9bfc60ac26d3bfec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:53:43 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fd5e2bac-82fa-439b-9aeb-6c57db0e1d41 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7bf5fa9-1ff8-49ea-a787-a014f8b40902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:53:43 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fd5e2bac-82fa-439b-9aeb-6c57db0e1d41 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7bf5fa9-1ff8-49ea-a787-a014f8b40902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:53:43 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fd5e2bac-82fa-439b-9aeb-6c57db0e1d41 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fb743ab-b0d5-4713-abd3-c87a44669686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:53:43 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fd5e2bac-82fa-439b-9aeb-6c57db0e1d41 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fb743ab-b0d5-4713-abd3-c87a44669686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '073bba95-75ef-4d49-a707-778d8a98e5b5', 'volume_name': 'volume-073bba95-75ef-4d49-a707-778d8a98e5b5', 'volume_size': 2}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:53:43 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fd5e2bac-82fa-439b-9aeb-6c57db0e1d41 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84046ea9-80ee-461e-a39d-9e6bb384e25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:53:43 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fd5e2bac-82fa-439b-9aeb-6c57db0e1d41 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84046ea9-80ee-461e-a39d-9e6bb384e25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:53:43 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fd5e2bac-82fa-439b-9aeb-6c57db0e1d41 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59096a94-07a9-4cbd-8460-c70bda9a3814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:53:43 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-fd5e2bac-82fa-439b-9aeb-6c57db0e1d41 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Volume 073bba95-75ef-4d49-a707-778d8a98e5b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-073bba95-75ef-4d49-a707-778d8a98e5b5', 'volume_size': 2} Sep 10 16:53:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-fd5e2bac-82fa-439b-9aeb-6c57db0e1d41 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:53:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-fd5e2bac-82fa-439b-9aeb-6c57db0e1d41 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:53:43 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-fd5e2bac-82fa-439b-9aeb-6c57db0e1d41 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-5651255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=073bba95-75ef-4d49-a707-778d8a98e5b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bba7b7c4d6334016b8ecf3961fff267a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:53:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:53:43Z,use_quota=True,user_id='7db8cd357c9946ca9bfc60ac26d3bfec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:53:43 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-fd5e2bac-82fa-439b-9aeb-6c57db0e1d41 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Creating volume 073bba95-75ef-4d49-a707-778d8a98e5b5 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:53:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-fd5e2bac-82fa-439b-9aeb-6c57db0e1d41 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:53:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-fd5e2bac-82fa-439b-9aeb-6c57db0e1d41 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:53:43 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-fd5e2bac-82fa-439b-9aeb-6c57db0e1d41 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:53:43 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-fd5e2bac-82fa-439b-9aeb-6c57db0e1d41 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:53:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-fd5e2bac-82fa-439b-9aeb-6c57db0e1d41 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:53:43 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-fd5e2bac-82fa-439b-9aeb-6c57db0e1d41 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:53:43 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-fd5e2bac-82fa-439b-9aeb-6c57db0e1d41 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:53:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fd5e2bac-82fa-439b-9aeb-6c57db0e1d41 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5 2147483648 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:43 devstack sudo[103776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5 2147483648 Sep 10 16:53:43 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:44 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fd5e2bac-82fa-439b-9aeb-6c57db0e1d41 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5 2147483648" returned: 0 in 0.606s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fd5e2bac-82fa-439b-9aeb-6c57db0e1d41 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:44 devstack sudo[103782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5 Sep 10 16:53:44 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:44 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fd5e2bac-82fa-439b-9aeb-6c57db0e1d41 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5" returned: 0 in 0.264s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:44 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-fd5e2bac-82fa-439b-9aeb-6c57db0e1d41 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:53:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-fd5e2bac-82fa-439b-9aeb-6c57db0e1d41 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:53:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fd5e2bac-82fa-439b-9aeb-6c57db0e1d41 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59096a94-07a9-4cbd-8460-c70bda9a3814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-073bba95-75ef-4d49-a707-778d8a98e5b5', 'volume_size': 2}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:53:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fd5e2bac-82fa-439b-9aeb-6c57db0e1d41 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f610c15-8403-4b5c-a063-705f1cf2e468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:53:44 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-fd5e2bac-82fa-439b-9aeb-6c57db0e1d41 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Volume volume-073bba95-75ef-4d49-a707-778d8a98e5b5 (073bba95-75ef-4d49-a707-778d8a98e5b5): created successfully Sep 10 16:53:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fd5e2bac-82fa-439b-9aeb-6c57db0e1d41 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f610c15-8403-4b5c-a063-705f1cf2e468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:53:44 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-fd5e2bac-82fa-439b-9aeb-6c57db0e1d41 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Flow 'volume_create_manager' (d7655a6d-3a1d-49f3-a909-4b820a8d6d9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:53:44 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-fd5e2bac-82fa-439b-9aeb-6c57db0e1d41 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Created volume successfully. Sep 10 16:53:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f66fceb8-9d6c-4356-b50c-92e6651e22a4 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:53:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f66fceb8-9d6c-4356-b50c-92e6651e22a4 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:53:45 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-f66fceb8-9d6c-4356-b50c-92e6651e22a4 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Creating offline snapshot e47f3982-e276-4861-a07e-c77034078901 of volume 073bba95-75ef-4d49-a707-778d8a98e5b5 {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:53:45 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdaef83-a800-451e-a4df-c972f1d32d62]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:53:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f66fceb8-9d6c-4356-b50c-92e6651e22a4 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:45 devstack sudo[103785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5 Sep 10 16:53:45 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:46 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f66fceb8-9d6c-4356-b50c-92e6651e22a4 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5" returned: 0 in 0.426s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f66fceb8-9d6c-4356-b50c-92e6651e22a4 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5.e47f3982-e276-4861-a07e-c77034078901 2G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:46 devstack sudo[103790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5.e47f3982-e276-4861-a07e-c77034078901 2G Sep 10 16:53:46 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:46 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f66fceb8-9d6c-4356-b50c-92e6651e22a4 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5.e47f3982-e276-4861-a07e-c77034078901 2G" returned: 0 in 0.466s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f66fceb8-9d6c-4356-b50c-92e6651e22a4 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-073bba95-75ef-4d49-a707-778d8a98e5b5 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5.e47f3982-e276-4861-a07e-c77034078901 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:46 devstack sudo[103795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-073bba95-75ef-4d49-a707-778d8a98e5b5 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5.e47f3982-e276-4861-a07e-c77034078901 Sep 10 16:53:46 devstack sudo[103795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:46 devstack sudo[103795]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f66fceb8-9d6c-4356-b50c-92e6651e22a4 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-073bba95-75ef-4d49-a707-778d8a98e5b5 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5.e47f3982-e276-4861-a07e-c77034078901" returned: 0 in 0.332s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:46 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-f66fceb8-9d6c-4356-b50c-92e6651e22a4 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5.e47f3982-e276-4861-a07e-c77034078901 is being set with open permissions: ugo+rw Sep 10 16:53:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f66fceb8-9d6c-4356-b50c-92e6651e22a4 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5.e47f3982-e276-4861-a07e-c77034078901 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:47 devstack sudo[103801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5.e47f3982-e276-4861-a07e-c77034078901 Sep 10 16:53:47 devstack sudo[103801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:47 devstack sudo[103801]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f66fceb8-9d6c-4356-b50c-92e6651e22a4 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5.e47f3982-e276-4861-a07e-c77034078901" returned: 0 in 0.272s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f66fceb8-9d6c-4356-b50c-92e6651e22a4 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:47 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5.info Sep 10 16:53:47 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:47 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f66fceb8-9d6c-4356-b50c-92e6651e22a4 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5.info" returned: 0 in 0.305s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:47 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-f66fceb8-9d6c-4356-b50c-92e6651e22a4 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5.info is being set with open permissions: ugo+rw Sep 10 16:53:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f66fceb8-9d6c-4356-b50c-92e6651e22a4 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:47 devstack sudo[103807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5.info Sep 10 16:53:47 devstack sudo[103807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:47 devstack sudo[103807]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f66fceb8-9d6c-4356-b50c-92e6651e22a4 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5.info" returned: 0 in 0.254s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f66fceb8-9d6c-4356-b50c-92e6651e22a4 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.186s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:53:47 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-f66fceb8-9d6c-4356-b50c-92e6651e22a4 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Create snapshot completed successfully Sep 10 16:53:48 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-291b0f62-9a8f-4c6a-b09b-90f828fe8ca1 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Acquiring lock "cinder-e47f3982-e276-4861-a07e-c77034078901-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:53:48 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-291b0f62-9a8f-4c6a-b09b-90f828fe8ca1 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Lock "cinder-e47f3982-e276-4861-a07e-c77034078901-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:53:48 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-291b0f62-9a8f-4c6a-b09b-90f828fe8ca1 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Acquiring lock "cinder-quobyte-073bba95-75ef-4d49-a707-778d8a98e5b5" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:53:48 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-291b0f62-9a8f-4c6a-b09b-90f828fe8ca1 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Lock "cinder-quobyte-073bba95-75ef-4d49-a707-778d8a98e5b5" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:53:48 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-291b0f62-9a8f-4c6a-b09b-90f828fe8ca1 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Acquiring lock "cinder-quobyte-e47f3982-e276-4861-a07e-c77034078901" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:53:49 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-291b0f62-9a8f-4c6a-b09b-90f828fe8ca1 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Lock "cinder-quobyte-e47f3982-e276-4861-a07e-c77034078901" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:53:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-291b0f62-9a8f-4c6a-b09b-90f828fe8ca1 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Deleting offline snapshot e47f3982-e276-4861-a07e-c77034078901 of volume 073bba95-75ef-4d49-a707-778d8a98e5b5 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:53:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-291b0f62-9a8f-4c6a-b09b-90f828fe8ca1 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] snapshot_file for this snap is: volume-073bba95-75ef-4d49-a707-778d8a98e5b5.e47f3982-e276-4861-a07e-c77034078901 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:53:49 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b781d6-bf09-47aa-94ef-4a0bb9bf5b3f]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:53:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-291b0f62-9a8f-4c6a-b09b-90f828fe8ca1 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5.e47f3982-e276-4861-a07e-c77034078901 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:49 devstack sudo[103810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5.e47f3982-e276-4861-a07e-c77034078901 Sep 10 16:53:49 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:49 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-291b0f62-9a8f-4c6a-b09b-90f828fe8ca1 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5.e47f3982-e276-4861-a07e-c77034078901" returned: 0 in 0.384s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-291b0f62-9a8f-4c6a-b09b-90f828fe8ca1 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-073bba95-75ef-4d49-a707-778d8a98e5b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:53:49 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ec28ce-462f-4717-9f53-2d9d36bdc617]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:53:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-291b0f62-9a8f-4c6a-b09b-90f828fe8ca1 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:53:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:53:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:53:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:53:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:53:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:53:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:49 devstack sudo[103816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:53:49 devstack sudo[103816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:49 devstack sudo[103815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5 Sep 10 16:53:49 devstack sudo[103815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:49 devstack sudo[103816]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.259s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:49 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:53:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager._thread_info {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:53:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread count: 28 {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 16:53:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread info: [<_MainThread(MainThread, started 125792070905984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 16:53:49 devstack sudo[103815]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-291b0f62-9a8f-4c6a-b09b-90f828fe8ca1 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5" returned: 0 in 0.414s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-291b0f62-9a8f-4c6a-b09b-90f828fe8ca1 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5.e47f3982-e276-4861-a07e-c77034078901 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:49 devstack sudo[103823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5.e47f3982-e276-4861-a07e-c77034078901 Sep 10 16:53:49 devstack sudo[103823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:50 devstack sudo[103823]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-291b0f62-9a8f-4c6a-b09b-90f828fe8ca1 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5.e47f3982-e276-4861-a07e-c77034078901" returned: 0 in 0.379s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-291b0f62-9a8f-4c6a-b09b-90f828fe8ca1 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5.e47f3982-e276-4861-a07e-c77034078901 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:50 devstack sudo[103828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5.e47f3982-e276-4861-a07e-c77034078901 Sep 10 16:53:50 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:50 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b151b48-b7ec-4d3c-ad0b-d6e475018f26 tempest-TestStampPattern-1658158979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:53:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8b151b48-b7ec-4d3c-ad0b-d6e475018f26 tempest-TestStampPattern-1658158979 None] Flow 'volume_create_manager' (60140769-3bca-44c1-82b0-359774dccce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:53:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8b151b48-b7ec-4d3c-ad0b-d6e475018f26 tempest-TestStampPattern-1658158979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae40bc5-4ada-45fe-a3a8-919f572d9002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:53:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8b151b48-b7ec-4d3c-ad0b-d6e475018f26 tempest-TestStampPattern-1658158979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae40bc5-4ada-45fe-a3a8-919f572d9002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-370378530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53216da1-2c1e-44b0-a133-4dc3267c4257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28bdb7ba75f14a36a9f105a55f20c57e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:53:50Z,use_quota=True,user_id='511204ba9af049b2aaa40f02dd3f4def',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:53:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8b151b48-b7ec-4d3c-ad0b-d6e475018f26 tempest-TestStampPattern-1658158979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3209bf1c-f5ca-4c75-b62f-46e545fc21c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:53:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8b151b48-b7ec-4d3c-ad0b-d6e475018f26 tempest-TestStampPattern-1658158979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3209bf1c-f5ca-4c75-b62f-46e545fc21c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:53:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8b151b48-b7ec-4d3c-ad0b-d6e475018f26 tempest-TestStampPattern-1658158979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9abaf73b-9a32-412b-9ce5-05518776c0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:53:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8b151b48-b7ec-4d3c-ad0b-d6e475018f26 tempest-TestStampPattern-1658158979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9abaf73b-9a32-412b-9ce5-05518776c0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53216da1-2c1e-44b0-a133-4dc3267c4257', 'volume_name': 'volume-53216da1-2c1e-44b0-a133-4dc3267c4257', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:53:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8b151b48-b7ec-4d3c-ad0b-d6e475018f26 tempest-TestStampPattern-1658158979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0d8a743-ae68-4a40-b850-3669f8c58bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:53:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8b151b48-b7ec-4d3c-ad0b-d6e475018f26 tempest-TestStampPattern-1658158979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0d8a743-ae68-4a40-b850-3669f8c58bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:53:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8b151b48-b7ec-4d3c-ad0b-d6e475018f26 tempest-TestStampPattern-1658158979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9763eaf5-32a6-49e6-a31d-8e701c153d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:53:50 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-8b151b48-b7ec-4d3c-ad0b-d6e475018f26 tempest-TestStampPattern-1658158979 None] Volume 53216da1-2c1e-44b0-a133-4dc3267c4257: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53216da1-2c1e-44b0-a133-4dc3267c4257', 'volume_size': 1} Sep 10 16:53:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8b151b48-b7ec-4d3c-ad0b-d6e475018f26 tempest-TestStampPattern-1658158979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:53:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8b151b48-b7ec-4d3c-ad0b-d6e475018f26 tempest-TestStampPattern-1658158979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:53:50 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8b151b48-b7ec-4d3c-ad0b-d6e475018f26 tempest-TestStampPattern-1658158979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-370378530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53216da1-2c1e-44b0-a133-4dc3267c4257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28bdb7ba75f14a36a9f105a55f20c57e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:53:50Z,use_quota=True,user_id='511204ba9af049b2aaa40f02dd3f4def',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:53:50 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-8b151b48-b7ec-4d3c-ad0b-d6e475018f26 tempest-TestStampPattern-1658158979 None] Creating volume 53216da1-2c1e-44b0-a133-4dc3267c4257 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:53:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8b151b48-b7ec-4d3c-ad0b-d6e475018f26 tempest-TestStampPattern-1658158979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:53:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8b151b48-b7ec-4d3c-ad0b-d6e475018f26 tempest-TestStampPattern-1658158979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:53:50 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8b151b48-b7ec-4d3c-ad0b-d6e475018f26 tempest-TestStampPattern-1658158979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:53:50 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8b151b48-b7ec-4d3c-ad0b-d6e475018f26 tempest-TestStampPattern-1658158979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:53:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8b151b48-b7ec-4d3c-ad0b-d6e475018f26 tempest-TestStampPattern-1658158979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:53:50 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8b151b48-b7ec-4d3c-ad0b-d6e475018f26 tempest-TestStampPattern-1658158979 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:53:50 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-8b151b48-b7ec-4d3c-ad0b-d6e475018f26 tempest-TestStampPattern-1658158979 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:53:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8b151b48-b7ec-4d3c-ad0b-d6e475018f26 tempest-TestStampPattern-1658158979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:50 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-291b0f62-9a8f-4c6a-b09b-90f828fe8ca1 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5.e47f3982-e276-4861-a07e-c77034078901" returned: 0 in 0.294s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:50 devstack sudo[103832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257 1073741824 Sep 10 16:53:50 devstack sudo[103832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:50 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-291b0f62-9a8f-4c6a-b09b-90f828fe8ca1 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Lock "cinder-quobyte-e47f3982-e276-4861-a07e-c77034078901" released by "_delete_snapshot" :: held 1.602s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:53:50 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-291b0f62-9a8f-4c6a-b09b-90f828fe8ca1 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Lock "cinder-quobyte-073bba95-75ef-4d49-a707-778d8a98e5b5" released by "delete_snapshot" :: held 1.623s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:53:50 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-291b0f62-9a8f-4c6a-b09b-90f828fe8ca1 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Created reservations ['47c5b1b2-08a4-4900-8ab9-ac310c32a47a', 'a2541cf6-e18e-4c59-b346-32b47cc59529', 'edcd970f-f7ce-4595-b7e5-09b49f40713e', 'ee9014ea-f644-43cc-a740-dc10d5896119'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:53:50 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-291b0f62-9a8f-4c6a-b09b-90f828fe8ca1 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Delete snapshot completed successfully. Sep 10 16:53:50 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-291b0f62-9a8f-4c6a-b09b-90f828fe8ca1 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Lock "cinder-e47f3982-e276-4861-a07e-c77034078901-delete_snapshot" released by "delete_snapshot" :: held 1.789s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:53:51 devstack sudo[103832]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8b151b48-b7ec-4d3c-ad0b-d6e475018f26 tempest-TestStampPattern-1658158979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257 1073741824" returned: 0 in 0.459s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8b151b48-b7ec-4d3c-ad0b-d6e475018f26 tempest-TestStampPattern-1658158979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:51 devstack sudo[103838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257 Sep 10 16:53:51 devstack sudo[103838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:51 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a723299d-b7a1-4084-a7fa-6e61b6553c65 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Acquiring lock "cinder-073bba95-75ef-4d49-a707-778d8a98e5b5-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:53:51 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a723299d-b7a1-4084-a7fa-6e61b6553c65 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Lock "cinder-073bba95-75ef-4d49-a707-778d8a98e5b5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:53:51 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a723299d-b7a1-4084-a7fa-6e61b6553c65 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Acquiring lock "cinder-quobyte-073bba95-75ef-4d49-a707-778d8a98e5b5" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:53:51 devstack sudo[103838]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:51 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a723299d-b7a1-4084-a7fa-6e61b6553c65 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Lock "cinder-quobyte-073bba95-75ef-4d49-a707-778d8a98e5b5" acquired by "delete_volume" :: waited 0.029s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:53:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8b151b48-b7ec-4d3c-ad0b-d6e475018f26 tempest-TestStampPattern-1658158979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257" returned: 0 in 0.378s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:51 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8b151b48-b7ec-4d3c-ad0b-d6e475018f26 tempest-TestStampPattern-1658158979 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:53:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8b151b48-b7ec-4d3c-ad0b-d6e475018f26 tempest-TestStampPattern-1658158979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:53:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8b151b48-b7ec-4d3c-ad0b-d6e475018f26 tempest-TestStampPattern-1658158979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9763eaf5-32a6-49e6-a31d-8e701c153d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53216da1-2c1e-44b0-a133-4dc3267c4257', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:53:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8b151b48-b7ec-4d3c-ad0b-d6e475018f26 tempest-TestStampPattern-1658158979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0b1c261-f2d9-4379-86f9-aee05fcbc41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:53:51 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a3fded-a61c-4672-b8b8-c8103b6177c7]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:53:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a723299d-b7a1-4084-a7fa-6e61b6553c65 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:51 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-8b151b48-b7ec-4d3c-ad0b-d6e475018f26 tempest-TestStampPattern-1658158979 None] Volume volume-53216da1-2c1e-44b0-a133-4dc3267c4257 (53216da1-2c1e-44b0-a133-4dc3267c4257): created successfully Sep 10 16:53:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8b151b48-b7ec-4d3c-ad0b-d6e475018f26 tempest-TestStampPattern-1658158979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0b1c261-f2d9-4379-86f9-aee05fcbc41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:53:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8b151b48-b7ec-4d3c-ad0b-d6e475018f26 tempest-TestStampPattern-1658158979 None] Flow 'volume_create_manager' (60140769-3bca-44c1-82b0-359774dccce3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:53:51 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-8b151b48-b7ec-4d3c-ad0b-d6e475018f26 tempest-TestStampPattern-1658158979 None] Created volume successfully. Sep 10 16:53:51 devstack sudo[103844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5 Sep 10 16:53:51 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:51 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a723299d-b7a1-4084-a7fa-6e61b6553c65 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5" returned: 0 in 0.434s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a723299d-b7a1-4084-a7fa-6e61b6553c65 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:51 devstack sudo[103849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5 Sep 10 16:53:51 devstack sudo[103849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:52 devstack sudo[103849]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a723299d-b7a1-4084-a7fa-6e61b6553c65 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-073bba95-75ef-4d49-a707-778d8a98e5b5" returned: 0 in 0.287s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:52 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a723299d-b7a1-4084-a7fa-6e61b6553c65 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Lock "cinder-quobyte-073bba95-75ef-4d49-a707-778d8a98e5b5" released by "delete_volume" :: held 0.841s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:53:52 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-a723299d-b7a1-4084-a7fa-6e61b6553c65 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Created reservations ['172d6598-5f8d-4755-8224-47a9f8ba62bf', 'b60002fd-ce85-4d35-ad52-58538212045f', '107d70a4-0532-4d05-af7a-c60b531e8cff', 'c922f694-2653-4692-b124-eeb2c5f02a99'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:53:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a723299d-b7a1-4084-a7fa-6e61b6553c65 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:53:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a723299d-b7a1-4084-a7fa-6e61b6553c65 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:53:52 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-a723299d-b7a1-4084-a7fa-6e61b6553c65 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:53:52 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-a723299d-b7a1-4084-a7fa-6e61b6553c65 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:53:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a723299d-b7a1-4084-a7fa-6e61b6553c65 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:53:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a723299d-b7a1-4084-a7fa-6e61b6553c65 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:53:52 devstack sudo[103852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:53:52 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:53:52 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root Sep 10 16:53:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a723299d-b7a1-4084-a7fa-6e61b6553c65 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.273s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:53:52 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-a723299d-b7a1-4084-a7fa-6e61b6553c65 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:53:52 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-a723299d-b7a1-4084-a7fa-6e61b6553c65 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Deleted volume successfully. Sep 10 16:53:52 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a723299d-b7a1-4084-a7fa-6e61b6553c65 tempest-VolumesSnapshotNegativeTestJSON-977682672 None] Lock "cinder-073bba95-75ef-4d49-a707-778d8a98e5b5-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:54:02 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=72,cinder:INSERT=26,cinder:UPDATE=76,cinder:DELETE=7 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:54:02 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:INSERT=28,cinder:UPDATE=93,cinder:SELECT=59,cinder:DELETE=7 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:54:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-4b677b91-f828-431b-b1e6-ce439c931c89 req-b9c3ddf8-1d04-4d90-93ae-333c9e9f6d66 tempest-TestStampPattern-1658158979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:54:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-4b677b91-f828-431b-b1e6-ce439c931c89 req-b9c3ddf8-1d04-4d90-93ae-333c9e9f6d66 tempest-TestStampPattern-1658158979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:54:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-4b677b91-f828-431b-b1e6-ce439c931c89 req-b9c3ddf8-1d04-4d90-93ae-333c9e9f6d66 tempest-TestStampPattern-1658158979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:54:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-4b677b91-f828-431b-b1e6-ce439c931c89 req-b9c3ddf8-1d04-4d90-93ae-333c9e9f6d66 tempest-TestStampPattern-1658158979 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8', 'name': 'volume-53216da1-2c1e-44b0-a133-4dc3267c4257', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '60558283-3668-417f-9603-d017e8f79b9f', 'enforce_multipath': True} {{(pid=88189) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 16:54:23 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-4b677b91-f828-431b-b1e6-ce439c931c89 req-b9c3ddf8-1d04-4d90-93ae-333c9e9f6d66 tempest-TestStampPattern-1658158979 None] attachment_update completed successfully. Sep 10 16:54:27 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7c49029-7778-4f18-a2fa-36dad5a98b03 tempest-TestMinimumBasicScenario-37194496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:54:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d7c49029-7778-4f18-a2fa-36dad5a98b03 tempest-TestMinimumBasicScenario-37194496 None] Flow 'volume_create_manager' (23968346-bae5-430b-880f-476e53a255d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:54:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d7c49029-7778-4f18-a2fa-36dad5a98b03 tempest-TestMinimumBasicScenario-37194496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (634b1442-820b-4556-b664-ff4c9411dcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:54:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d7c49029-7778-4f18-a2fa-36dad5a98b03 tempest-TestMinimumBasicScenario-37194496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (634b1442-820b-4556-b664-ff4c9411dcc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1217893167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7005b2ee-c9af-44de-9d2f-b78a10a443de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a65a88ccb4084988a033e2df7724e8b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:54:28Z,use_quota=True,user_id='0f7541e5f79c4495967ed4b01818ea21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:54:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d7c49029-7778-4f18-a2fa-36dad5a98b03 tempest-TestMinimumBasicScenario-37194496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49de4cd2-6e9e-45d1-82d2-fc8e98653a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:54:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d7c49029-7778-4f18-a2fa-36dad5a98b03 tempest-TestMinimumBasicScenario-37194496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49de4cd2-6e9e-45d1-82d2-fc8e98653a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:54:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d7c49029-7778-4f18-a2fa-36dad5a98b03 tempest-TestMinimumBasicScenario-37194496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b124e216-9a12-4da9-8eb8-77b4f1404e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:54:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d7c49029-7778-4f18-a2fa-36dad5a98b03 tempest-TestMinimumBasicScenario-37194496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b124e216-9a12-4da9-8eb8-77b4f1404e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7005b2ee-c9af-44de-9d2f-b78a10a443de', 'volume_name': 'volume-7005b2ee-c9af-44de-9d2f-b78a10a443de', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:54:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d7c49029-7778-4f18-a2fa-36dad5a98b03 tempest-TestMinimumBasicScenario-37194496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a97cc197-484f-4e8f-a1d4-46e31107605b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:54:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d7c49029-7778-4f18-a2fa-36dad5a98b03 tempest-TestMinimumBasicScenario-37194496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a97cc197-484f-4e8f-a1d4-46e31107605b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:54:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d7c49029-7778-4f18-a2fa-36dad5a98b03 tempest-TestMinimumBasicScenario-37194496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddbfa401-5a74-4f8a-a8a8-63252477ffc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:54:27 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-d7c49029-7778-4f18-a2fa-36dad5a98b03 tempest-TestMinimumBasicScenario-37194496 None] Volume 7005b2ee-c9af-44de-9d2f-b78a10a443de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7005b2ee-c9af-44de-9d2f-b78a10a443de', 'volume_size': 1} Sep 10 16:54:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d7c49029-7778-4f18-a2fa-36dad5a98b03 tempest-TestMinimumBasicScenario-37194496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:54:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d7c49029-7778-4f18-a2fa-36dad5a98b03 tempest-TestMinimumBasicScenario-37194496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:54:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d7c49029-7778-4f18-a2fa-36dad5a98b03 tempest-TestMinimumBasicScenario-37194496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1217893167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7005b2ee-c9af-44de-9d2f-b78a10a443de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a65a88ccb4084988a033e2df7724e8b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:54:28Z,use_quota=True,user_id='0f7541e5f79c4495967ed4b01818ea21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:54:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-d7c49029-7778-4f18-a2fa-36dad5a98b03 tempest-TestMinimumBasicScenario-37194496 None] Creating volume 7005b2ee-c9af-44de-9d2f-b78a10a443de {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:54:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d7c49029-7778-4f18-a2fa-36dad5a98b03 tempest-TestMinimumBasicScenario-37194496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:54:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d7c49029-7778-4f18-a2fa-36dad5a98b03 tempest-TestMinimumBasicScenario-37194496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:54:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d7c49029-7778-4f18-a2fa-36dad5a98b03 tempest-TestMinimumBasicScenario-37194496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:54:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d7c49029-7778-4f18-a2fa-36dad5a98b03 tempest-TestMinimumBasicScenario-37194496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:54:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d7c49029-7778-4f18-a2fa-36dad5a98b03 tempest-TestMinimumBasicScenario-37194496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:54:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d7c49029-7778-4f18-a2fa-36dad5a98b03 tempest-TestMinimumBasicScenario-37194496 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:54:27 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-d7c49029-7778-4f18-a2fa-36dad5a98b03 tempest-TestMinimumBasicScenario-37194496 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:54:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d7c49029-7778-4f18-a2fa-36dad5a98b03 tempest-TestMinimumBasicScenario-37194496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7005b2ee-c9af-44de-9d2f-b78a10a443de 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:54:27 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7005b2ee-c9af-44de-9d2f-b78a10a443de 1073741824 Sep 10 16:54:27 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:54:28 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Sep 10 16:54:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d7c49029-7778-4f18-a2fa-36dad5a98b03 tempest-TestMinimumBasicScenario-37194496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7005b2ee-c9af-44de-9d2f-b78a10a443de 1073741824" returned: 0 in 0.556s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:54:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d7c49029-7778-4f18-a2fa-36dad5a98b03 tempest-TestMinimumBasicScenario-37194496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7005b2ee-c9af-44de-9d2f-b78a10a443de {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:54:28 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7005b2ee-c9af-44de-9d2f-b78a10a443de Sep 10 16:54:28 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:54:28 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-6bc67e60-f9da-4b85-bb77-dabc92d308f0 req-3ae29f83-9d48-45a8-9b45-7aba795647a3 tempest-TestStampPattern-1658158979 None] Terminate volume connection completed successfully. Sep 10 16:54:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-6bc67e60-f9da-4b85-bb77-dabc92d308f0 req-3ae29f83-9d48-45a8-9b45-7aba795647a3 tempest-TestStampPattern-1658158979 None] Deleting attachment 60558283-3668-417f-9603-d017e8f79b9f. {{(pid=88189) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 16:54:28 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Sep 10 16:54:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d7c49029-7778-4f18-a2fa-36dad5a98b03 tempest-TestMinimumBasicScenario-37194496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7005b2ee-c9af-44de-9d2f-b78a10a443de" returned: 0 in 0.297s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:54:28 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d7c49029-7778-4f18-a2fa-36dad5a98b03 tempest-TestMinimumBasicScenario-37194496 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:54:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d7c49029-7778-4f18-a2fa-36dad5a98b03 tempest-TestMinimumBasicScenario-37194496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:54:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d7c49029-7778-4f18-a2fa-36dad5a98b03 tempest-TestMinimumBasicScenario-37194496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddbfa401-5a74-4f8a-a8a8-63252477ffc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7005b2ee-c9af-44de-9d2f-b78a10a443de', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:54:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d7c49029-7778-4f18-a2fa-36dad5a98b03 tempest-TestMinimumBasicScenario-37194496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30daa0d3-ab12-4597-8454-18b295bc02b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:54:28 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-d7c49029-7778-4f18-a2fa-36dad5a98b03 tempest-TestMinimumBasicScenario-37194496 None] Volume volume-7005b2ee-c9af-44de-9d2f-b78a10a443de (7005b2ee-c9af-44de-9d2f-b78a10a443de): created successfully Sep 10 16:54:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d7c49029-7778-4f18-a2fa-36dad5a98b03 tempest-TestMinimumBasicScenario-37194496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30daa0d3-ab12-4597-8454-18b295bc02b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:54:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d7c49029-7778-4f18-a2fa-36dad5a98b03 tempest-TestMinimumBasicScenario-37194496 None] Flow 'volume_create_manager' (23968346-bae5-430b-880f-476e53a255d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:54:28 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-d7c49029-7778-4f18-a2fa-36dad5a98b03 tempest-TestMinimumBasicScenario-37194496 None] Created volume successfully. Sep 10 16:54:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6f951d17-abc9-499d-a4d4-e7aeb243b505 tempest-TestStampPattern-1658158979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:54:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6f951d17-abc9-499d-a4d4-e7aeb243b505 tempest-TestStampPattern-1658158979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:54:29 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-6f951d17-abc9-499d-a4d4-e7aeb243b505 tempest-TestStampPattern-1658158979 None] Creating offline snapshot 31d11c10-2f83-499d-b8ef-7e6d9acbeec5 of volume 53216da1-2c1e-44b0-a133-4dc3267c4257 {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:54:29 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb22b919-600c-4b35-a96b-574ca88f3047]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:54:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6f951d17-abc9-499d-a4d4-e7aeb243b505 tempest-TestStampPattern-1658158979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:54:29 devstack sudo[104572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257 Sep 10 16:54:29 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:54:29 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root Sep 10 16:54:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6f951d17-abc9-499d-a4d4-e7aeb243b505 tempest-TestStampPattern-1658158979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257" returned: 0 in 0.380s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:54:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6f951d17-abc9-499d-a4d4-e7aeb243b505 tempest-TestStampPattern-1658158979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257.31d11c10-2f83-499d-b8ef-7e6d9acbeec5 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:54:30 devstack sudo[104577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257.31d11c10-2f83-499d-b8ef-7e6d9acbeec5 1G Sep 10 16:54:30 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:54:30 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root Sep 10 16:54:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6f951d17-abc9-499d-a4d4-e7aeb243b505 tempest-TestStampPattern-1658158979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257.31d11c10-2f83-499d-b8ef-7e6d9acbeec5 1G" returned: 0 in 0.566s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:54:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6f951d17-abc9-499d-a4d4-e7aeb243b505 tempest-TestStampPattern-1658158979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53216da1-2c1e-44b0-a133-4dc3267c4257 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257.31d11c10-2f83-499d-b8ef-7e6d9acbeec5 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:54:30 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53216da1-2c1e-44b0-a133-4dc3267c4257 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257.31d11c10-2f83-499d-b8ef-7e6d9acbeec5 Sep 10 16:54:30 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:54:30 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Sep 10 16:54:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6f951d17-abc9-499d-a4d4-e7aeb243b505 tempest-TestStampPattern-1658158979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53216da1-2c1e-44b0-a133-4dc3267c4257 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257.31d11c10-2f83-499d-b8ef-7e6d9acbeec5" returned: 0 in 0.358s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:54:30 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-6f951d17-abc9-499d-a4d4-e7aeb243b505 tempest-TestStampPattern-1658158979 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257.31d11c10-2f83-499d-b8ef-7e6d9acbeec5 is being set with open permissions: ugo+rw Sep 10 16:54:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6f951d17-abc9-499d-a4d4-e7aeb243b505 tempest-TestStampPattern-1658158979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257.31d11c10-2f83-499d-b8ef-7e6d9acbeec5 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:54:30 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257.31d11c10-2f83-499d-b8ef-7e6d9acbeec5 Sep 10 16:54:30 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:54:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-fb2ff105-3389-4cda-bb2b-3e2bbde9ed45 req-063acfd0-c868-4c8d-b6e0-85012550e5fc tempest-TestMinimumBasicScenario-37194496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:54:31 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Sep 10 16:54:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6f951d17-abc9-499d-a4d4-e7aeb243b505 tempest-TestStampPattern-1658158979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257.31d11c10-2f83-499d-b8ef-7e6d9acbeec5" returned: 0 in 0.250s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:54:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6f951d17-abc9-499d-a4d4-e7aeb243b505 tempest-TestStampPattern-1658158979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:54:31 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257.info Sep 10 16:54:31 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:54:31 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Sep 10 16:54:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6f951d17-abc9-499d-a4d4-e7aeb243b505 tempest-TestStampPattern-1658158979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257.info" returned: 0 in 0.262s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:54:31 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-6f951d17-abc9-499d-a4d4-e7aeb243b505 tempest-TestStampPattern-1658158979 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257.info is being set with open permissions: ugo+rw Sep 10 16:54:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6f951d17-abc9-499d-a4d4-e7aeb243b505 tempest-TestStampPattern-1658158979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:54:31 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257.info Sep 10 16:54:31 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:54:31 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Sep 10 16:54:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6f951d17-abc9-499d-a4d4-e7aeb243b505 tempest-TestStampPattern-1658158979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257.info" returned: 0 in 0.262s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:54:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6f951d17-abc9-499d-a4d4-e7aeb243b505 tempest-TestStampPattern-1658158979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.168s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:54:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-fb2ff105-3389-4cda-bb2b-3e2bbde9ed45 req-063acfd0-c868-4c8d-b6e0-85012550e5fc tempest-TestMinimumBasicScenario-37194496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.800s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:54:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-fb2ff105-3389-4cda-bb2b-3e2bbde9ed45 req-063acfd0-c868-4c8d-b6e0-85012550e5fc tempest-TestMinimumBasicScenario-37194496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:54:31 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-6f951d17-abc9-499d-a4d4-e7aeb243b505 tempest-TestStampPattern-1658158979 None] Create snapshot completed successfully Sep 10 16:54:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-fb2ff105-3389-4cda-bb2b-3e2bbde9ed45 req-063acfd0-c868-4c8d-b6e0-85012550e5fc tempest-TestMinimumBasicScenario-37194496 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8', 'name': 'volume-7005b2ee-c9af-44de-9d2f-b78a10a443de', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3ebe9e2a-98a5-4c9e-ad92-3edc1ae8c3ed', 'enforce_multipath': True} {{(pid=88189) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 16:54:31 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-fb2ff105-3389-4cda-bb2b-3e2bbde9ed45 req-063acfd0-c868-4c8d-b6e0-85012550e5fc tempest-TestMinimumBasicScenario-37194496 None] attachment_update completed successfully. Sep 10 16:54:40 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:54:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Flow 'volume_create_manager' (477471cc-eb06-4f46-8da2-f1283f3dcf35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:54:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd33bc13-26da-4579-9e0c-68e939998fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:54:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd33bc13-26da-4579-9e0c-68e939998fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-223355174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db173810-f941-426f-b60d-ace772213815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28bdb7ba75f14a36a9f105a55f20c57e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=31d11c10-2f83-499d-b8ef-7e6d9acbeec5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:54:41Z,use_quota=True,user_id='511204ba9af049b2aaa40f02dd3f4def',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:54:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e3bea8-5e3b-41d3-adef-294fe15f11f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:54:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e3bea8-5e3b-41d3-adef-294fe15f11f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:54:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e544b59e-f911-48c6-92cd-80a35c192b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:54:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e544b59e-f911-48c6-92cd-80a35c192b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'db173810-f941-426f-b60d-ace772213815', 'volume_name': 'volume-db173810-f941-426f-b60d-ace772213815', 'volume_size': 1, 'snapshot_id': '31d11c10-2f83-499d-b8ef-7e6d9acbeec5'}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:54:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (031a6cb0-ced7-4103-aaa7-cb426f4456f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:54:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (031a6cb0-ced7-4103-aaa7-cb426f4456f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:54:40 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a574bb9-9922-4222-ac85-3e37f3a73230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:54:40 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Volume db173810-f941-426f-b60d-ace772213815: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-db173810-f941-426f-b60d-ace772213815', 'volume_size': 1, 'snapshot_id': '31d11c10-2f83-499d-b8ef-7e6d9acbeec5'} Sep 10 16:54:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:54:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:54:40 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Acquiring lock "cinder-quobyte-31d11c10-2f83-499d-b8ef-7e6d9acbeec5-db173810-f941-426f-b60d-ace772213815" by "_create_volume_from_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:54:40 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Lock "cinder-quobyte-31d11c10-2f83-499d-b8ef-7e6d9acbeec5-db173810-f941-426f-b60d-ace772213815" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:54:40 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Creating volume db173810-f941-426f-b60d-ace772213815 from snapshot 31d11c10-2f83-499d-b8ef-7e6d9acbeec5 {{(pid=88189) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 10 16:54:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:54:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:54:40 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:54:40 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:54:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:54:40 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:54:40 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Acquiring lock "cinder-quobyte-db173810-f941-426f-b60d-ace772213815" by "_copy_volume_from_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:54:40 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Lock "cinder-quobyte-db173810-f941-426f-b60d-ace772213815" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:54:40 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] snapshot: 31d11c10-2f83-499d-b8ef-7e6d9acbeec5, volume: db173810-f941-426f-b60d-ace772213815, {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 16:54:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:54:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:54:40 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:54:40 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:54:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:54:40 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[af32057d-e1b4-41e2-8f9c-b0c0eaa55be2]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:54:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257.31d11c10-2f83-499d-b8ef-7e6d9acbeec5 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:54:40 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257.31d11c10-2f83-499d-b8ef-7e6d9acbeec5 Sep 10 16:54:40 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:54:41 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Sep 10 16:54:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257.31d11c10-2f83-499d-b8ef-7e6d9acbeec5" returned: 0 in 0.374s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:54:41 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53216da1-2c1e-44b0-a133-4dc3267c4257(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:54:41 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b55a7cf-eb4a-4181-801f-11c43efa98fe]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:54:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:54:41 devstack sudo[105067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257 Sep 10 16:54:41 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:54:41 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root Sep 10 16:54:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257" returned: 0 in 0.379s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:54:41 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] will copy from snapshot at /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257 {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 16:54:41 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Creating direct copy from snapshot {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 16:54:41 devstack cinder-volume[88189]: DEBUG cinder.utils [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Path /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-db173810-f941-426f-b60d-ace772213815 not found in is_blk_device check {{(pid=88189) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 16:54:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-db173810-f941-426f-b60d-ace772213815 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:54:41 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-db173810-f941-426f-b60d-ace772213815 Sep 10 16:54:41 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:54:48 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Sep 10 16:54:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-db173810-f941-426f-b60d-ace772213815" returned: 0 in 6.395s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:54:48 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Image conversion details: src /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257, size 1024.00 MB, duration 6.40 sec, destination /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-db173810-f941-426f-b60d-ace772213815 {{(pid=88189) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 16:54:48 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Converted 1024.00 MB image at 160.09 MB/s Sep 10 16:54:48 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-db173810-f941-426f-b60d-ace772213815 is being set with open permissions: ugo+rw Sep 10 16:54:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-db173810-f941-426f-b60d-ace772213815 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:54:48 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-db173810-f941-426f-b60d-ace772213815 Sep 10 16:54:48 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:54:48 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Sep 10 16:54:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-db173810-f941-426f-b60d-ace772213815" returned: 0 in 0.281s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:54:48 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Lock "cinder-quobyte-db173810-f941-426f-b60d-ace772213815" released by "_copy_volume_from_snapshot" :: held 7.514s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:54:48 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Lock "cinder-quobyte-31d11c10-2f83-499d-b8ef-7e6d9acbeec5-db173810-f941-426f-b60d-ace772213815" released by "_create_volume_from_snapshot" :: held 7.604s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:54:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.621s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:54:48 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a574bb9-9922-4222-ac85-3e37f3a73230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db173810-f941-426f-b60d-ace772213815', 'volume_size': 1, 'snapshot_id': '31d11c10-2f83-499d-b8ef-7e6d9acbeec5'}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:54:48 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eae18a0d-080f-4654-a462-4cc89e9d22cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:54:48 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Volume volume-db173810-f941-426f-b60d-ace772213815 (db173810-f941-426f-b60d-ace772213815): created successfully Sep 10 16:54:48 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eae18a0d-080f-4654-a462-4cc89e9d22cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:54:48 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Flow 'volume_create_manager' (477471cc-eb06-4f46-8da2-f1283f3dcf35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:54:48 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-239d9763-5252-446a-b965-6cfbfc4d5c65 tempest-TestStampPattern-1658158979 None] Created volume successfully. Sep 10 16:54:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:54:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:54:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:54:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:54:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:54:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:54:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:54:49 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:54:49 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:54:49 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Sep 10 16:54:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.314s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:54:49 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:54:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager._thread_info {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:54:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread count: 28 {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 16:54:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread info: [<_MainThread(MainThread, started 125792070905984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 16:54:58 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=24,cinder:UPDATE=10,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:54:58 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=22,cinder:UPDATE=11,cinder:DELETE=2,cinder:INSERT=2 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:55:19 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-d8a2b730-469c-481d-a702-8acaa097c101 req-0be5ce6f-9d7a-4213-ab03-e3cc374550c1 tempest-TestMinimumBasicScenario-37194496 None] Terminate volume connection completed successfully. Sep 10 16:55:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-d8a2b730-469c-481d-a702-8acaa097c101 req-0be5ce6f-9d7a-4213-ab03-e3cc374550c1 tempest-TestMinimumBasicScenario-37194496 None] Deleting attachment 3ebe9e2a-98a5-4c9e-ad92-3edc1ae8c3ed. {{(pid=88189) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 16:55:20 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-95ce4d46-9da8-409f-8277-8ec227ec9a10 tempest-TestMinimumBasicScenario-37194496 None] Acquiring lock "cinder-7005b2ee-c9af-44de-9d2f-b78a10a443de-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:55:20 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-95ce4d46-9da8-409f-8277-8ec227ec9a10 tempest-TestMinimumBasicScenario-37194496 None] Lock "cinder-7005b2ee-c9af-44de-9d2f-b78a10a443de-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:55:20 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-95ce4d46-9da8-409f-8277-8ec227ec9a10 tempest-TestMinimumBasicScenario-37194496 None] Acquiring lock "cinder-quobyte-7005b2ee-c9af-44de-9d2f-b78a10a443de" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:55:20 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-95ce4d46-9da8-409f-8277-8ec227ec9a10 tempest-TestMinimumBasicScenario-37194496 None] Lock "cinder-quobyte-7005b2ee-c9af-44de-9d2f-b78a10a443de" acquired by "delete_volume" :: waited 0.015s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:55:20 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[362cb22f-05ce-4187-a681-abbc02e6a0a4]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:55:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-95ce4d46-9da8-409f-8277-8ec227ec9a10 tempest-TestMinimumBasicScenario-37194496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7005b2ee-c9af-44de-9d2f-b78a10a443de {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:55:20 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7005b2ee-c9af-44de-9d2f-b78a10a443de Sep 10 16:55:20 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:55:20 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Sep 10 16:55:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-95ce4d46-9da8-409f-8277-8ec227ec9a10 tempest-TestMinimumBasicScenario-37194496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7005b2ee-c9af-44de-9d2f-b78a10a443de" returned: 0 in 0.357s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:55:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-95ce4d46-9da8-409f-8277-8ec227ec9a10 tempest-TestMinimumBasicScenario-37194496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7005b2ee-c9af-44de-9d2f-b78a10a443de {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:55:20 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7005b2ee-c9af-44de-9d2f-b78a10a443de Sep 10 16:55:20 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:55:20 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Sep 10 16:55:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-95ce4d46-9da8-409f-8277-8ec227ec9a10 tempest-TestMinimumBasicScenario-37194496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7005b2ee-c9af-44de-9d2f-b78a10a443de" returned: 0 in 0.253s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:55:20 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-95ce4d46-9da8-409f-8277-8ec227ec9a10 tempest-TestMinimumBasicScenario-37194496 None] Lock "cinder-quobyte-7005b2ee-c9af-44de-9d2f-b78a10a443de" released by "delete_volume" :: held 0.650s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:55:20 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-95ce4d46-9da8-409f-8277-8ec227ec9a10 tempest-TestMinimumBasicScenario-37194496 None] Created reservations ['3e3a9d06-09d6-4e63-8d7f-6dcb35f534dc', 'fe664cc3-f743-4a4b-8751-2841e12551fd', '505cb896-58a5-4903-9b56-d6a47dc7835c', '3f777cbd-8822-4039-940a-023bc53df0c7'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:55:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-95ce4d46-9da8-409f-8277-8ec227ec9a10 tempest-TestMinimumBasicScenario-37194496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:55:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-95ce4d46-9da8-409f-8277-8ec227ec9a10 tempest-TestMinimumBasicScenario-37194496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:55:20 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-95ce4d46-9da8-409f-8277-8ec227ec9a10 tempest-TestMinimumBasicScenario-37194496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:55:20 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-95ce4d46-9da8-409f-8277-8ec227ec9a10 tempest-TestMinimumBasicScenario-37194496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:55:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-95ce4d46-9da8-409f-8277-8ec227ec9a10 tempest-TestMinimumBasicScenario-37194496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:55:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-95ce4d46-9da8-409f-8277-8ec227ec9a10 tempest-TestMinimumBasicScenario-37194496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:55:20 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:55:20 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:55:21 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Sep 10 16:55:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-95ce4d46-9da8-409f-8277-8ec227ec9a10 tempest-TestMinimumBasicScenario-37194496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.238s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:55:21 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-95ce4d46-9da8-409f-8277-8ec227ec9a10 tempest-TestMinimumBasicScenario-37194496 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:55:21 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-95ce4d46-9da8-409f-8277-8ec227ec9a10 tempest-TestMinimumBasicScenario-37194496 None] Deleted volume successfully. Sep 10 16:55:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-95ce4d46-9da8-409f-8277-8ec227ec9a10 tempest-TestMinimumBasicScenario-37194496 None] Lock "cinder-7005b2ee-c9af-44de-9d2f-b78a10a443de-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:55:30 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=1 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:55:31 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:55:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-f6dada9e-baa0-4f73-aefb-ccb17b0e21c3 req-9fcd8b12-e3b4-4f00-b88d-4bdd164180da tempest-TestStampPattern-1658158979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:55:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-f6dada9e-baa0-4f73-aefb-ccb17b0e21c3 req-9fcd8b12-e3b4-4f00-b88d-4bdd164180da tempest-TestStampPattern-1658158979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:55:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-f6dada9e-baa0-4f73-aefb-ccb17b0e21c3 req-9fcd8b12-e3b4-4f00-b88d-4bdd164180da tempest-TestStampPattern-1658158979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:55:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-f6dada9e-baa0-4f73-aefb-ccb17b0e21c3 req-9fcd8b12-e3b4-4f00-b88d-4bdd164180da tempest-TestStampPattern-1658158979 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8', 'name': 'volume-db173810-f941-426f-b60d-ace772213815', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd77ad286-8ccb-4f65-b17a-9027fc9bce2e', 'enforce_multipath': True} {{(pid=88189) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 16:55:31 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-f6dada9e-baa0-4f73-aefb-ccb17b0e21c3 req-9fcd8b12-e3b4-4f00-b88d-4bdd164180da tempest-TestStampPattern-1658158979 None] attachment_update completed successfully. Sep 10 16:55:34 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-11c0c422-01a0-483c-8ef6-99395fa982f4 req-e552394b-c374-4420-894a-a401d53b4bbc tempest-TestStampPattern-1658158979 None] Terminate volume connection completed successfully. Sep 10 16:55:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-11c0c422-01a0-483c-8ef6-99395fa982f4 req-e552394b-c374-4420-894a-a401d53b4bbc tempest-TestStampPattern-1658158979 None] Deleting attachment d77ad286-8ccb-4f65-b17a-9027fc9bce2e. {{(pid=88189) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 16:55:39 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-157c0e88-25b8-4f69-9cf7-b35875fe6a3e tempest-TestStampPattern-1658158979 None] Acquiring lock "cinder-db173810-f941-426f-b60d-ace772213815-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:55:39 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-157c0e88-25b8-4f69-9cf7-b35875fe6a3e tempest-TestStampPattern-1658158979 None] Lock "cinder-db173810-f941-426f-b60d-ace772213815-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:55:39 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-157c0e88-25b8-4f69-9cf7-b35875fe6a3e tempest-TestStampPattern-1658158979 None] Acquiring lock "cinder-quobyte-db173810-f941-426f-b60d-ace772213815" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:55:39 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-157c0e88-25b8-4f69-9cf7-b35875fe6a3e tempest-TestStampPattern-1658158979 None] Lock "cinder-quobyte-db173810-f941-426f-b60d-ace772213815" acquired by "delete_volume" :: waited 0.017s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:55:39 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0ee0f8-e9f5-45a0-82a0-699a061c68d7]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:55:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-157c0e88-25b8-4f69-9cf7-b35875fe6a3e tempest-TestStampPattern-1658158979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-db173810-f941-426f-b60d-ace772213815 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:55:40 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-db173810-f941-426f-b60d-ace772213815 Sep 10 16:55:40 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:55:40 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Sep 10 16:55:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-157c0e88-25b8-4f69-9cf7-b35875fe6a3e tempest-TestStampPattern-1658158979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-db173810-f941-426f-b60d-ace772213815" returned: 0 in 0.383s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:55:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-157c0e88-25b8-4f69-9cf7-b35875fe6a3e tempest-TestStampPattern-1658158979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-db173810-f941-426f-b60d-ace772213815 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:55:40 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-db173810-f941-426f-b60d-ace772213815 Sep 10 16:55:40 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:55:40 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Sep 10 16:55:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-157c0e88-25b8-4f69-9cf7-b35875fe6a3e tempest-TestStampPattern-1658158979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-db173810-f941-426f-b60d-ace772213815" returned: 0 in 0.251s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:55:40 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-157c0e88-25b8-4f69-9cf7-b35875fe6a3e tempest-TestStampPattern-1658158979 None] Lock "cinder-quobyte-db173810-f941-426f-b60d-ace772213815" released by "delete_volume" :: held 0.690s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:55:40 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-157c0e88-25b8-4f69-9cf7-b35875fe6a3e tempest-TestStampPattern-1658158979 None] Created reservations ['2376fd1a-440a-4019-a350-47a51699683f', '317e536d-865b-4a34-b1c0-9b9f0fdf21ef', 'dbbe8a5e-3fd0-4ce7-869a-8b1439b964e2', '483fdea3-add2-4366-ae2a-0c0346b55b82'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:55:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-157c0e88-25b8-4f69-9cf7-b35875fe6a3e tempest-TestStampPattern-1658158979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:55:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-157c0e88-25b8-4f69-9cf7-b35875fe6a3e tempest-TestStampPattern-1658158979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:55:40 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-157c0e88-25b8-4f69-9cf7-b35875fe6a3e tempest-TestStampPattern-1658158979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:55:40 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-157c0e88-25b8-4f69-9cf7-b35875fe6a3e tempest-TestStampPattern-1658158979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:55:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-157c0e88-25b8-4f69-9cf7-b35875fe6a3e tempest-TestStampPattern-1658158979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:55:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-157c0e88-25b8-4f69-9cf7-b35875fe6a3e tempest-TestStampPattern-1658158979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:55:40 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:55:40 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:55:41 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Sep 10 16:55:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-157c0e88-25b8-4f69-9cf7-b35875fe6a3e tempest-TestStampPattern-1658158979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.267s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:55:41 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-157c0e88-25b8-4f69-9cf7-b35875fe6a3e tempest-TestStampPattern-1658158979 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:55:41 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-157c0e88-25b8-4f69-9cf7-b35875fe6a3e tempest-TestStampPattern-1658158979 None] Deleted volume successfully. Sep 10 16:55:41 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-157c0e88-25b8-4f69-9cf7-b35875fe6a3e tempest-TestStampPattern-1658158979 None] Lock "cinder-db173810-f941-426f-b60d-ace772213815-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:55:41 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-255315a0-a8ab-4ec6-bb90-4d507d575b8c tempest-TestStampPattern-1658158979 None] Acquiring lock "cinder-31d11c10-2f83-499d-b8ef-7e6d9acbeec5-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:55:41 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-255315a0-a8ab-4ec6-bb90-4d507d575b8c tempest-TestStampPattern-1658158979 None] Lock "cinder-31d11c10-2f83-499d-b8ef-7e6d9acbeec5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:55:41 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-255315a0-a8ab-4ec6-bb90-4d507d575b8c tempest-TestStampPattern-1658158979 None] Acquiring lock "cinder-quobyte-53216da1-2c1e-44b0-a133-4dc3267c4257" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:55:41 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-255315a0-a8ab-4ec6-bb90-4d507d575b8c tempest-TestStampPattern-1658158979 None] Lock "cinder-quobyte-53216da1-2c1e-44b0-a133-4dc3267c4257" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:55:41 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-255315a0-a8ab-4ec6-bb90-4d507d575b8c tempest-TestStampPattern-1658158979 None] Acquiring lock "cinder-quobyte-31d11c10-2f83-499d-b8ef-7e6d9acbeec5" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:55:41 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-255315a0-a8ab-4ec6-bb90-4d507d575b8c tempest-TestStampPattern-1658158979 None] Lock "cinder-quobyte-31d11c10-2f83-499d-b8ef-7e6d9acbeec5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:55:41 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-255315a0-a8ab-4ec6-bb90-4d507d575b8c tempest-TestStampPattern-1658158979 None] Deleting offline snapshot 31d11c10-2f83-499d-b8ef-7e6d9acbeec5 of volume 53216da1-2c1e-44b0-a133-4dc3267c4257 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:55:41 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-255315a0-a8ab-4ec6-bb90-4d507d575b8c tempest-TestStampPattern-1658158979 None] snapshot_file for this snap is: volume-53216da1-2c1e-44b0-a133-4dc3267c4257.31d11c10-2f83-499d-b8ef-7e6d9acbeec5 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:55:41 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f56f11-09b0-4996-a989-30dea4c4ab5f]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:55:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-255315a0-a8ab-4ec6-bb90-4d507d575b8c tempest-TestStampPattern-1658158979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257.31d11c10-2f83-499d-b8ef-7e6d9acbeec5 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:55:41 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257.31d11c10-2f83-499d-b8ef-7e6d9acbeec5 Sep 10 16:55:41 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:55:41 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Sep 10 16:55:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-255315a0-a8ab-4ec6-bb90-4d507d575b8c tempest-TestStampPattern-1658158979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257.31d11c10-2f83-499d-b8ef-7e6d9acbeec5" returned: 0 in 0.409s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:55:41 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-255315a0-a8ab-4ec6-bb90-4d507d575b8c tempest-TestStampPattern-1658158979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53216da1-2c1e-44b0-a133-4dc3267c4257(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:55:41 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d18ae93-8736-4152-8b10-da9bdbb013b3]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:55:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-255315a0-a8ab-4ec6-bb90-4d507d575b8c tempest-TestStampPattern-1658158979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:55:41 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257 Sep 10 16:55:41 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:55:42 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Sep 10 16:55:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-255315a0-a8ab-4ec6-bb90-4d507d575b8c tempest-TestStampPattern-1658158979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257" returned: 0 in 0.586s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:55:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-255315a0-a8ab-4ec6-bb90-4d507d575b8c tempest-TestStampPattern-1658158979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257.31d11c10-2f83-499d-b8ef-7e6d9acbeec5 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:55:42 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257.31d11c10-2f83-499d-b8ef-7e6d9acbeec5 Sep 10 16:55:42 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:55:42 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Sep 10 16:55:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-255315a0-a8ab-4ec6-bb90-4d507d575b8c tempest-TestStampPattern-1658158979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257.31d11c10-2f83-499d-b8ef-7e6d9acbeec5" returned: 0 in 0.392s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:55:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-255315a0-a8ab-4ec6-bb90-4d507d575b8c tempest-TestStampPattern-1658158979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257.31d11c10-2f83-499d-b8ef-7e6d9acbeec5 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:55:42 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257.31d11c10-2f83-499d-b8ef-7e6d9acbeec5 Sep 10 16:55:42 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:55:43 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Sep 10 16:55:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-255315a0-a8ab-4ec6-bb90-4d507d575b8c tempest-TestStampPattern-1658158979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257.31d11c10-2f83-499d-b8ef-7e6d9acbeec5" returned: 0 in 0.269s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:55:43 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-255315a0-a8ab-4ec6-bb90-4d507d575b8c tempest-TestStampPattern-1658158979 None] Lock "cinder-quobyte-31d11c10-2f83-499d-b8ef-7e6d9acbeec5" released by "_delete_snapshot" :: held 1.778s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:55:43 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-255315a0-a8ab-4ec6-bb90-4d507d575b8c tempest-TestStampPattern-1658158979 None] Lock "cinder-quobyte-53216da1-2c1e-44b0-a133-4dc3267c4257" released by "delete_snapshot" :: held 1.800s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:55:43 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-255315a0-a8ab-4ec6-bb90-4d507d575b8c tempest-TestStampPattern-1658158979 None] Created reservations ['29572d7a-6cfb-4994-8e48-f1a3bf3e447e', '2f552327-2d28-468d-8934-27661bcaba7a', '82616693-06d7-4d57-b3a1-fb765b5491d4', 'f05ba616-757b-49ce-9d55-c1357198fbdf'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:55:43 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-255315a0-a8ab-4ec6-bb90-4d507d575b8c tempest-TestStampPattern-1658158979 None] Delete snapshot completed successfully. Sep 10 16:55:43 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-255315a0-a8ab-4ec6-bb90-4d507d575b8c tempest-TestStampPattern-1658158979 None] Lock "cinder-31d11c10-2f83-499d-b8ef-7e6d9acbeec5-delete_snapshot" released by "delete_snapshot" :: held 1.979s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:55:49 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-494e1741-690e-45bf-80f8-a4f89124424e tempest-TestStampPattern-1658158979 None] Acquiring lock "cinder-53216da1-2c1e-44b0-a133-4dc3267c4257-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:55:49 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-494e1741-690e-45bf-80f8-a4f89124424e tempest-TestStampPattern-1658158979 None] Lock "cinder-53216da1-2c1e-44b0-a133-4dc3267c4257-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:55:49 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-494e1741-690e-45bf-80f8-a4f89124424e tempest-TestStampPattern-1658158979 None] Acquiring lock "cinder-quobyte-53216da1-2c1e-44b0-a133-4dc3267c4257" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:55:49 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-494e1741-690e-45bf-80f8-a4f89124424e tempest-TestStampPattern-1658158979 None] Lock "cinder-quobyte-53216da1-2c1e-44b0-a133-4dc3267c4257" acquired by "delete_volume" :: waited 0.021s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:55:49 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e8bc1e-f254-4e4b-9dc1-b98deac9ddaf]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:55:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-494e1741-690e-45bf-80f8-a4f89124424e tempest-TestStampPattern-1658158979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:55:49 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257 Sep 10 16:55:49 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:55:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:55:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:55:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:55:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:55:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:55:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:55:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:55:49 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Sep 10 16:55:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-494e1741-690e-45bf-80f8-a4f89124424e tempest-TestStampPattern-1658158979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257" returned: 0 in 0.385s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:55:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-494e1741-690e-45bf-80f8-a4f89124424e tempest-TestStampPattern-1658158979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:55:49 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:55:49 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:55:49 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257 Sep 10 16:55:49 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:55:49 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Sep 10 16:55:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.245s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:55:49 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:55:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager._thread_info {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:55:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread count: 28 {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 16:55:49 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Sep 10 16:55:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread info: [<_MainThread(MainThread, started 125792070905984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 16:55:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-494e1741-690e-45bf-80f8-a4f89124424e tempest-TestStampPattern-1658158979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-53216da1-2c1e-44b0-a133-4dc3267c4257" returned: 0 in 0.243s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:55:49 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-494e1741-690e-45bf-80f8-a4f89124424e tempest-TestStampPattern-1658158979 None] Lock "cinder-quobyte-53216da1-2c1e-44b0-a133-4dc3267c4257" released by "delete_volume" :: held 0.686s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:55:49 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-494e1741-690e-45bf-80f8-a4f89124424e tempest-TestStampPattern-1658158979 None] Created reservations ['f852ab09-3a60-42b1-94fd-b18fe4f6651f', '964c6330-40f8-41e1-a022-a5b101e38a66', '9e15524a-48fc-4c5f-8e5c-6c3b0f3576ca', '4aa03881-3c38-4d65-ae76-bb82603399cb'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:55:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-494e1741-690e-45bf-80f8-a4f89124424e tempest-TestStampPattern-1658158979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:55:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-494e1741-690e-45bf-80f8-a4f89124424e tempest-TestStampPattern-1658158979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:55:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-494e1741-690e-45bf-80f8-a4f89124424e tempest-TestStampPattern-1658158979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:55:50 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-494e1741-690e-45bf-80f8-a4f89124424e tempest-TestStampPattern-1658158979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:55:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-494e1741-690e-45bf-80f8-a4f89124424e tempest-TestStampPattern-1658158979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:55:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-494e1741-690e-45bf-80f8-a4f89124424e tempest-TestStampPattern-1658158979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:55:50 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:55:50 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:55:50 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Sep 10 16:55:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-494e1741-690e-45bf-80f8-a4f89124424e tempest-TestStampPattern-1658158979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.336s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:55:50 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-494e1741-690e-45bf-80f8-a4f89124424e tempest-TestStampPattern-1658158979 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:55:50 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-494e1741-690e-45bf-80f8-a4f89124424e tempest-TestStampPattern-1658158979 None] Deleted volume successfully. Sep 10 16:55:50 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-494e1741-690e-45bf-80f8-a4f89124424e tempest-TestStampPattern-1658158979 None] Lock "cinder-53216da1-2c1e-44b0-a133-4dc3267c4257-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:55:59 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=26,cinder:UPDATE=22,cinder:INSERT=9 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:56:00 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=21,cinder:UPDATE=25,cinder:INSERT=3,cinder:DELETE=2 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:56:09 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-00cbf2cf-cb63-48cd-b90c-dff0d8131094 tempest-CreateVolumesFromSnapshotTest-175896033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:56:09 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-00cbf2cf-cb63-48cd-b90c-dff0d8131094 tempest-CreateVolumesFromSnapshotTest-175896033 None] Flow 'volume_create_manager' (00774e02-a96f-4934-934c-b52fb040d236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:09 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-00cbf2cf-cb63-48cd-b90c-dff0d8131094 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce7d5017-80c4-4157-9566-60d40282a81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:09 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-00cbf2cf-cb63-48cd-b90c-dff0d8131094 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce7d5017-80c4-4157-9566-60d40282a81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-344468632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fac40ea-fcda-4f80-bbb5-0ced7bebbd79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a52c91bcc5c4e9f8df32a463c46fee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:09Z,use_quota=True,user_id='a61bc68977d8451baea6c4cd455c09dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:09 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-00cbf2cf-cb63-48cd-b90c-dff0d8131094 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5de23f68-c20a-4b7a-80a0-8323cc365221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:09 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-00cbf2cf-cb63-48cd-b90c-dff0d8131094 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5de23f68-c20a-4b7a-80a0-8323cc365221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:09 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-00cbf2cf-cb63-48cd-b90c-dff0d8131094 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fff62b8-0b21-46ef-a7b6-5a1a101b4991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:09 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-00cbf2cf-cb63-48cd-b90c-dff0d8131094 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fff62b8-0b21-46ef-a7b6-5a1a101b4991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fac40ea-fcda-4f80-bbb5-0ced7bebbd79', 'volume_name': 'volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:09 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-00cbf2cf-cb63-48cd-b90c-dff0d8131094 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9567eb9-5e9d-46f7-80c7-44ed082222b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:09 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-00cbf2cf-cb63-48cd-b90c-dff0d8131094 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9567eb9-5e9d-46f7-80c7-44ed082222b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:09 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-00cbf2cf-cb63-48cd-b90c-dff0d8131094 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ddce82c-c225-4c8f-9d60-11d05046a8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:09 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-00cbf2cf-cb63-48cd-b90c-dff0d8131094 tempest-CreateVolumesFromSnapshotTest-175896033 None] Volume 5fac40ea-fcda-4f80-bbb5-0ced7bebbd79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79', 'volume_size': 1} Sep 10 16:56:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-00cbf2cf-cb63-48cd-b90c-dff0d8131094 tempest-CreateVolumesFromSnapshotTest-175896033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-00cbf2cf-cb63-48cd-b90c-dff0d8131094 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:09 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-00cbf2cf-cb63-48cd-b90c-dff0d8131094 tempest-CreateVolumesFromSnapshotTest-175896033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-344468632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fac40ea-fcda-4f80-bbb5-0ced7bebbd79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a52c91bcc5c4e9f8df32a463c46fee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:09Z,use_quota=True,user_id='a61bc68977d8451baea6c4cd455c09dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:56:09 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-00cbf2cf-cb63-48cd-b90c-dff0d8131094 tempest-CreateVolumesFromSnapshotTest-175896033 None] Creating volume 5fac40ea-fcda-4f80-bbb5-0ced7bebbd79 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:56:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-00cbf2cf-cb63-48cd-b90c-dff0d8131094 tempest-CreateVolumesFromSnapshotTest-175896033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-00cbf2cf-cb63-48cd-b90c-dff0d8131094 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:09 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-00cbf2cf-cb63-48cd-b90c-dff0d8131094 tempest-CreateVolumesFromSnapshotTest-175896033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:09 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-00cbf2cf-cb63-48cd-b90c-dff0d8131094 tempest-CreateVolumesFromSnapshotTest-175896033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-00cbf2cf-cb63-48cd-b90c-dff0d8131094 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:09 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-00cbf2cf-cb63-48cd-b90c-dff0d8131094 tempest-CreateVolumesFromSnapshotTest-175896033 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:56:09 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-00cbf2cf-cb63-48cd-b90c-dff0d8131094 tempest-CreateVolumesFromSnapshotTest-175896033 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:56:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-00cbf2cf-cb63-48cd-b90c-dff0d8131094 tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:09 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79 1073741824 Sep 10 16:56:09 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:09 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-00cbf2cf-cb63-48cd-b90c-dff0d8131094 tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79 1073741824" returned: 0 in 0.441s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-00cbf2cf-cb63-48cd-b90c-dff0d8131094 tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:09 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79 Sep 10 16:56:09 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:10 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-00cbf2cf-cb63-48cd-b90c-dff0d8131094 tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79" returned: 0 in 0.277s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:10 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-00cbf2cf-cb63-48cd-b90c-dff0d8131094 tempest-CreateVolumesFromSnapshotTest-175896033 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:56:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-00cbf2cf-cb63-48cd-b90c-dff0d8131094 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:10 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-00cbf2cf-cb63-48cd-b90c-dff0d8131094 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ddce82c-c225-4c8f-9d60-11d05046a8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:10 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-00cbf2cf-cb63-48cd-b90c-dff0d8131094 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25b4bd79-b3c0-40f3-8190-042b30218915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:10 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-00cbf2cf-cb63-48cd-b90c-dff0d8131094 tempest-CreateVolumesFromSnapshotTest-175896033 None] Volume volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79 (5fac40ea-fcda-4f80-bbb5-0ced7bebbd79): created successfully Sep 10 16:56:10 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-00cbf2cf-cb63-48cd-b90c-dff0d8131094 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25b4bd79-b3c0-40f3-8190-042b30218915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:10 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-00cbf2cf-cb63-48cd-b90c-dff0d8131094 tempest-CreateVolumesFromSnapshotTest-175896033 None] Flow 'volume_create_manager' (00774e02-a96f-4934-934c-b52fb040d236) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:10 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-00cbf2cf-cb63-48cd-b90c-dff0d8131094 tempest-CreateVolumesFromSnapshotTest-175896033 None] Created volume successfully. Sep 10 16:56:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-97bf8539-43aa-43cc-be4e-7ad1aae1be0b tempest-CreateVolumesFromSnapshotTest-175896033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-97bf8539-43aa-43cc-be4e-7ad1aae1be0b tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:11 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-97bf8539-43aa-43cc-be4e-7ad1aae1be0b tempest-CreateVolumesFromSnapshotTest-175896033 None] Creating offline snapshot 7a3bd31b-1af8-44a0-baa7-b44ac4fa06f3 of volume 5fac40ea-fcda-4f80-bbb5-0ced7bebbd79 {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:56:11 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b23f07-2896-422c-8b15-5ab7564b1299]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:56:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-97bf8539-43aa-43cc-be4e-7ad1aae1be0b tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:11 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79 Sep 10 16:56:11 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:11 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-97bf8539-43aa-43cc-be4e-7ad1aae1be0b tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79" returned: 0 in 0.383s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-97bf8539-43aa-43cc-be4e-7ad1aae1be0b tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79.7a3bd31b-1af8-44a0-baa7-b44ac4fa06f3 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:11 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79.7a3bd31b-1af8-44a0-baa7-b44ac4fa06f3 1G Sep 10 16:56:11 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:12 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-97bf8539-43aa-43cc-be4e-7ad1aae1be0b tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79.7a3bd31b-1af8-44a0-baa7-b44ac4fa06f3 1G" returned: 0 in 0.449s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-97bf8539-43aa-43cc-be4e-7ad1aae1be0b tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79.7a3bd31b-1af8-44a0-baa7-b44ac4fa06f3 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:12 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79.7a3bd31b-1af8-44a0-baa7-b44ac4fa06f3 Sep 10 16:56:12 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:12 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-97bf8539-43aa-43cc-be4e-7ad1aae1be0b tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79.7a3bd31b-1af8-44a0-baa7-b44ac4fa06f3" returned: 0 in 0.316s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:12 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-97bf8539-43aa-43cc-be4e-7ad1aae1be0b tempest-CreateVolumesFromSnapshotTest-175896033 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79.7a3bd31b-1af8-44a0-baa7-b44ac4fa06f3 is being set with open permissions: ugo+rw Sep 10 16:56:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-97bf8539-43aa-43cc-be4e-7ad1aae1be0b tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79.7a3bd31b-1af8-44a0-baa7-b44ac4fa06f3 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:12 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79.7a3bd31b-1af8-44a0-baa7-b44ac4fa06f3 Sep 10 16:56:12 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:12 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-97bf8539-43aa-43cc-be4e-7ad1aae1be0b tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79.7a3bd31b-1af8-44a0-baa7-b44ac4fa06f3" returned: 0 in 0.257s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-97bf8539-43aa-43cc-be4e-7ad1aae1be0b tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:12 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79.info Sep 10 16:56:12 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:13 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-97bf8539-43aa-43cc-be4e-7ad1aae1be0b tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79.info" returned: 0 in 0.252s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:13 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-97bf8539-43aa-43cc-be4e-7ad1aae1be0b tempest-CreateVolumesFromSnapshotTest-175896033 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79.info is being set with open permissions: ugo+rw Sep 10 16:56:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-97bf8539-43aa-43cc-be4e-7ad1aae1be0b tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:13 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79.info Sep 10 16:56:13 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:13 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-97bf8539-43aa-43cc-be4e-7ad1aae1be0b tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79.info" returned: 0 in 0.250s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-97bf8539-43aa-43cc-be4e-7ad1aae1be0b tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:13 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-97bf8539-43aa-43cc-be4e-7ad1aae1be0b tempest-CreateVolumesFromSnapshotTest-175896033 None] Create snapshot completed successfully Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-af1d2992-87ab-454f-87be-e0048c543842 tempest-CreateVolumesFromSnapshotTest-175896033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-af1d2992-87ab-454f-87be-e0048c543842 tempest-CreateVolumesFromSnapshotTest-175896033 None] Flow 'volume_create_manager' (01363d98-f0ff-4ea4-ac2f-22ffb2b02455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-af1d2992-87ab-454f-87be-e0048c543842 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aee4a964-4062-4fb2-af2f-3e6dcbfb0322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-af1d2992-87ab-454f-87be-e0048c543842 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aee4a964-4062-4fb2-af2f-3e6dcbfb0322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2061929704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b3c4a53-d891-4a97-a3e7-ef74abc95b5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a52c91bcc5c4e9f8df32a463c46fee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:15Z,use_quota=True,user_id='a61bc68977d8451baea6c4cd455c09dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-af1d2992-87ab-454f-87be-e0048c543842 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd46891-e4e9-464f-9147-ba3785c71b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-af1d2992-87ab-454f-87be-e0048c543842 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd46891-e4e9-464f-9147-ba3785c71b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-af1d2992-87ab-454f-87be-e0048c543842 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8247c5d-e139-4b20-9584-c9cc690eb933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-af1d2992-87ab-454f-87be-e0048c543842 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8247c5d-e139-4b20-9584-c9cc690eb933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b3c4a53-d891-4a97-a3e7-ef74abc95b5a', 'volume_name': 'volume-5b3c4a53-d891-4a97-a3e7-ef74abc95b5a', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-af1d2992-87ab-454f-87be-e0048c543842 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc33798d-b985-4c02-97cf-79901207edab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-af1d2992-87ab-454f-87be-e0048c543842 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc33798d-b985-4c02-97cf-79901207edab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-af1d2992-87ab-454f-87be-e0048c543842 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4aec08b-af16-4c96-9c56-aa25be7e3cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:15 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-af1d2992-87ab-454f-87be-e0048c543842 tempest-CreateVolumesFromSnapshotTest-175896033 None] Volume 5b3c4a53-d891-4a97-a3e7-ef74abc95b5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b3c4a53-d891-4a97-a3e7-ef74abc95b5a', 'volume_size': 1} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-af1d2992-87ab-454f-87be-e0048c543842 tempest-CreateVolumesFromSnapshotTest-175896033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-af1d2992-87ab-454f-87be-e0048c543842 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-af1d2992-87ab-454f-87be-e0048c543842 tempest-CreateVolumesFromSnapshotTest-175896033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2061929704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b3c4a53-d891-4a97-a3e7-ef74abc95b5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a52c91bcc5c4e9f8df32a463c46fee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:15Z,use_quota=True,user_id='a61bc68977d8451baea6c4cd455c09dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-af1d2992-87ab-454f-87be-e0048c543842 tempest-CreateVolumesFromSnapshotTest-175896033 None] Creating volume 5b3c4a53-d891-4a97-a3e7-ef74abc95b5a {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-af1d2992-87ab-454f-87be-e0048c543842 tempest-CreateVolumesFromSnapshotTest-175896033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-af1d2992-87ab-454f-87be-e0048c543842 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-af1d2992-87ab-454f-87be-e0048c543842 tempest-CreateVolumesFromSnapshotTest-175896033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-af1d2992-87ab-454f-87be-e0048c543842 tempest-CreateVolumesFromSnapshotTest-175896033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-af1d2992-87ab-454f-87be-e0048c543842 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-af1d2992-87ab-454f-87be-e0048c543842 tempest-CreateVolumesFromSnapshotTest-175896033 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:56:15 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-af1d2992-87ab-454f-87be-e0048c543842 tempest-CreateVolumesFromSnapshotTest-175896033 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-af1d2992-87ab-454f-87be-e0048c543842 tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b3c4a53-d891-4a97-a3e7-ef74abc95b5a 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:15 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b3c4a53-d891-4a97-a3e7-ef74abc95b5a 1073741824 Sep 10 16:56:15 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a55857d-7cef-4491-b01f-53d170e7d884 tempest-CreateVolumesFromSnapshotTest-175896033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5a55857d-7cef-4491-b01f-53d170e7d884 tempest-CreateVolumesFromSnapshotTest-175896033 None] Flow 'volume_create_manager' (0986c377-7c5f-46c1-8cdf-57a5081780a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5a55857d-7cef-4491-b01f-53d170e7d884 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932d9b51-76c1-4428-9c54-bd2e6a3d1917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5a55857d-7cef-4491-b01f-53d170e7d884 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932d9b51-76c1-4428-9c54-bd2e6a3d1917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1439398199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc6bb0a2-98c8-4ad0-85ad-9e8c49eab966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a52c91bcc5c4e9f8df32a463c46fee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:15Z,use_quota=True,user_id='a61bc68977d8451baea6c4cd455c09dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5a55857d-7cef-4491-b01f-53d170e7d884 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dadce9a-6d8d-436a-aba1-a34bffc6f5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5a55857d-7cef-4491-b01f-53d170e7d884 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dadce9a-6d8d-436a-aba1-a34bffc6f5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5a55857d-7cef-4491-b01f-53d170e7d884 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ec52727-aa9f-4503-8ebe-d59d71e73a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5a55857d-7cef-4491-b01f-53d170e7d884 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ec52727-aa9f-4503-8ebe-d59d71e73a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc6bb0a2-98c8-4ad0-85ad-9e8c49eab966', 'volume_name': 'volume-cc6bb0a2-98c8-4ad0-85ad-9e8c49eab966', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5a55857d-7cef-4491-b01f-53d170e7d884 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca335777-b2e4-4547-b349-05db5d223bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5a55857d-7cef-4491-b01f-53d170e7d884 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca335777-b2e4-4547-b349-05db5d223bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5a55857d-7cef-4491-b01f-53d170e7d884 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08a59002-a5c6-4236-9b17-5d5f0acfb174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:15 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-5a55857d-7cef-4491-b01f-53d170e7d884 tempest-CreateVolumesFromSnapshotTest-175896033 None] Volume cc6bb0a2-98c8-4ad0-85ad-9e8c49eab966: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc6bb0a2-98c8-4ad0-85ad-9e8c49eab966', 'volume_size': 1} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5a55857d-7cef-4491-b01f-53d170e7d884 tempest-CreateVolumesFromSnapshotTest-175896033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:15 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-af1d2992-87ab-454f-87be-e0048c543842 tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b3c4a53-d891-4a97-a3e7-ef74abc95b5a 1073741824" returned: 0 in 0.539s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-af1d2992-87ab-454f-87be-e0048c543842 tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b3c4a53-d891-4a97-a3e7-ef74abc95b5a {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:15 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b3c4a53-d891-4a97-a3e7-ef74abc95b5a Sep 10 16:56:15 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6a50aad-4932-488b-a411-5d64f94a77f7 tempest-CreateVolumesFromSnapshotTest-175896033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f6a50aad-4932-488b-a411-5d64f94a77f7 tempest-CreateVolumesFromSnapshotTest-175896033 None] Flow 'volume_create_manager' (bfa7be05-e102-44db-816d-80bd59fd0ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f6a50aad-4932-488b-a411-5d64f94a77f7 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb56832f-4370-4211-a031-7503f8c65bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f6a50aad-4932-488b-a411-5d64f94a77f7 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb56832f-4370-4211-a031-7503f8c65bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1758246059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef50403c-8d95-4aa7-b82a-53fabc3daeb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a52c91bcc5c4e9f8df32a463c46fee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:16Z,use_quota=True,user_id='a61bc68977d8451baea6c4cd455c09dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f6a50aad-4932-488b-a411-5d64f94a77f7 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99df02b5-0c55-4974-86a7-59de6b41e1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f6a50aad-4932-488b-a411-5d64f94a77f7 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99df02b5-0c55-4974-86a7-59de6b41e1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f6a50aad-4932-488b-a411-5d64f94a77f7 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8ec37a5-3c58-44a6-9c91-ddf76d66ce7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f6a50aad-4932-488b-a411-5d64f94a77f7 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8ec37a5-3c58-44a6-9c91-ddf76d66ce7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef50403c-8d95-4aa7-b82a-53fabc3daeb8', 'volume_name': 'volume-ef50403c-8d95-4aa7-b82a-53fabc3daeb8', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f6a50aad-4932-488b-a411-5d64f94a77f7 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (893874ff-f3fd-4d20-b316-a1a78882be36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f6a50aad-4932-488b-a411-5d64f94a77f7 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (893874ff-f3fd-4d20-b316-a1a78882be36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f6a50aad-4932-488b-a411-5d64f94a77f7 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e19dc796-58bf-45df-aed3-ca9437aa2221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:15 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-f6a50aad-4932-488b-a411-5d64f94a77f7 tempest-CreateVolumesFromSnapshotTest-175896033 None] Volume ef50403c-8d95-4aa7-b82a-53fabc3daeb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef50403c-8d95-4aa7-b82a-53fabc3daeb8', 'volume_size': 1} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f6a50aad-4932-488b-a411-5d64f94a77f7 tempest-CreateVolumesFromSnapshotTest-175896033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:15 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-af1d2992-87ab-454f-87be-e0048c543842 tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b3c4a53-d891-4a97-a3e7-ef74abc95b5a" returned: 0 in 0.256s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-af1d2992-87ab-454f-87be-e0048c543842 tempest-CreateVolumesFromSnapshotTest-175896033 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-af1d2992-87ab-454f-87be-e0048c543842 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5a55857d-7cef-4491-b01f-53d170e7d884 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.451s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-5a55857d-7cef-4491-b01f-53d170e7d884 tempest-CreateVolumesFromSnapshotTest-175896033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1439398199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc6bb0a2-98c8-4ad0-85ad-9e8c49eab966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a52c91bcc5c4e9f8df32a463c46fee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:15Z,use_quota=True,user_id='a61bc68977d8451baea6c4cd455c09dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-5a55857d-7cef-4491-b01f-53d170e7d884 tempest-CreateVolumesFromSnapshotTest-175896033 None] Creating volume cc6bb0a2-98c8-4ad0-85ad-9e8c49eab966 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5a55857d-7cef-4491-b01f-53d170e7d884 tempest-CreateVolumesFromSnapshotTest-175896033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5a55857d-7cef-4491-b01f-53d170e7d884 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-5a55857d-7cef-4491-b01f-53d170e7d884 tempest-CreateVolumesFromSnapshotTest-175896033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-5a55857d-7cef-4491-b01f-53d170e7d884 tempest-CreateVolumesFromSnapshotTest-175896033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5a55857d-7cef-4491-b01f-53d170e7d884 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-5a55857d-7cef-4491-b01f-53d170e7d884 tempest-CreateVolumesFromSnapshotTest-175896033 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:56:16 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-5a55857d-7cef-4491-b01f-53d170e7d884 tempest-CreateVolumesFromSnapshotTest-175896033 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5a55857d-7cef-4491-b01f-53d170e7d884 tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cc6bb0a2-98c8-4ad0-85ad-9e8c49eab966 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-af1d2992-87ab-454f-87be-e0048c543842 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4aec08b-af16-4c96-9c56-aa25be7e3cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b3c4a53-d891-4a97-a3e7-ef74abc95b5a', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:16 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cc6bb0a2-98c8-4ad0-85ad-9e8c49eab966 1073741824 Sep 10 16:56:16 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-af1d2992-87ab-454f-87be-e0048c543842 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d5afe0e-be6c-4748-ac08-f3ab4fde8681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:16 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-af1d2992-87ab-454f-87be-e0048c543842 tempest-CreateVolumesFromSnapshotTest-175896033 None] Volume volume-5b3c4a53-d891-4a97-a3e7-ef74abc95b5a (5b3c4a53-d891-4a97-a3e7-ef74abc95b5a): created successfully Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-af1d2992-87ab-454f-87be-e0048c543842 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d5afe0e-be6c-4748-ac08-f3ab4fde8681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-af1d2992-87ab-454f-87be-e0048c543842 tempest-CreateVolumesFromSnapshotTest-175896033 None] Flow 'volume_create_manager' (01363d98-f0ff-4ea4-ac2f-22ffb2b02455) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:16 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-af1d2992-87ab-454f-87be-e0048c543842 tempest-CreateVolumesFromSnapshotTest-175896033 None] Created volume successfully. Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-821b846a-f4c3-4920-9bbf-ed0bfeae3b87 tempest-CreateVolumesFromSnapshotTest-175896033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-821b846a-f4c3-4920-9bbf-ed0bfeae3b87 tempest-CreateVolumesFromSnapshotTest-175896033 None] Flow 'volume_create_manager' (ee71b72f-2ef5-40ea-a668-e7399c7b11cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-821b846a-f4c3-4920-9bbf-ed0bfeae3b87 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f464f6bf-117e-46f7-99a5-fee86a5080ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-821b846a-f4c3-4920-9bbf-ed0bfeae3b87 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f464f6bf-117e-46f7-99a5-fee86a5080ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1560531586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab10688-fb3e-444d-bb4f-f1fe78b8bf13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a52c91bcc5c4e9f8df32a463c46fee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:16Z,use_quota=True,user_id='a61bc68977d8451baea6c4cd455c09dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-821b846a-f4c3-4920-9bbf-ed0bfeae3b87 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cbbe1e1-b399-4b21-a40a-324c64002951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-821b846a-f4c3-4920-9bbf-ed0bfeae3b87 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cbbe1e1-b399-4b21-a40a-324c64002951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-821b846a-f4c3-4920-9bbf-ed0bfeae3b87 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a76d1365-760f-47e3-83dd-f832d7d6398c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-821b846a-f4c3-4920-9bbf-ed0bfeae3b87 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a76d1365-760f-47e3-83dd-f832d7d6398c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ab10688-fb3e-444d-bb4f-f1fe78b8bf13', 'volume_name': 'volume-4ab10688-fb3e-444d-bb4f-f1fe78b8bf13', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-821b846a-f4c3-4920-9bbf-ed0bfeae3b87 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56cd661b-c491-48eb-b41c-dcb5e68fc746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-821b846a-f4c3-4920-9bbf-ed0bfeae3b87 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56cd661b-c491-48eb-b41c-dcb5e68fc746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-821b846a-f4c3-4920-9bbf-ed0bfeae3b87 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9224db26-f6f8-40bd-acf2-f9502474e55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:16 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-821b846a-f4c3-4920-9bbf-ed0bfeae3b87 tempest-CreateVolumesFromSnapshotTest-175896033 None] Volume 4ab10688-fb3e-444d-bb4f-f1fe78b8bf13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ab10688-fb3e-444d-bb4f-f1fe78b8bf13', 'volume_size': 1} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-821b846a-f4c3-4920-9bbf-ed0bfeae3b87 tempest-CreateVolumesFromSnapshotTest-175896033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:16 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5a55857d-7cef-4491-b01f-53d170e7d884 tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cc6bb0a2-98c8-4ad0-85ad-9e8c49eab966 1073741824" returned: 0 in 0.512s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-10f50109-612e-4445-acf5-0266fb63956b tempest-CreateVolumesFromSnapshotTest-175896033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-10f50109-612e-4445-acf5-0266fb63956b tempest-CreateVolumesFromSnapshotTest-175896033 None] Flow 'volume_create_manager' (a538e555-07d6-4d08-b7af-c3ba2b374832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-10f50109-612e-4445-acf5-0266fb63956b tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9113ad5e-4caa-4210-919a-dfe8b304a6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5a55857d-7cef-4491-b01f-53d170e7d884 tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cc6bb0a2-98c8-4ad0-85ad-9e8c49eab966 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:16 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cc6bb0a2-98c8-4ad0-85ad-9e8c49eab966 Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-10f50109-612e-4445-acf5-0266fb63956b tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9113ad5e-4caa-4210-919a-dfe8b304a6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2003403594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fded248-a700-49f5-b4ba-f59add53e454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a52c91bcc5c4e9f8df32a463c46fee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:17Z,use_quota=True,user_id='a61bc68977d8451baea6c4cd455c09dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:16 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-10f50109-612e-4445-acf5-0266fb63956b tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a3df3eb-d1f9-4426-861a-d4b8ec3a7e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-10f50109-612e-4445-acf5-0266fb63956b tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a3df3eb-d1f9-4426-861a-d4b8ec3a7e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-10f50109-612e-4445-acf5-0266fb63956b tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6efc13d1-3498-4613-a283-4fd8568ca31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-10f50109-612e-4445-acf5-0266fb63956b tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6efc13d1-3498-4613-a283-4fd8568ca31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fded248-a700-49f5-b4ba-f59add53e454', 'volume_name': 'volume-8fded248-a700-49f5-b4ba-f59add53e454', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-10f50109-612e-4445-acf5-0266fb63956b tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e476ba44-92c9-4ce4-ac2c-a9031625d094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-10f50109-612e-4445-acf5-0266fb63956b tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e476ba44-92c9-4ce4-ac2c-a9031625d094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-10f50109-612e-4445-acf5-0266fb63956b tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b92ffdad-a96a-4146-b505-82bb01abb6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:16 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-10f50109-612e-4445-acf5-0266fb63956b tempest-CreateVolumesFromSnapshotTest-175896033 None] Volume 8fded248-a700-49f5-b4ba-f59add53e454: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fded248-a700-49f5-b4ba-f59add53e454', 'volume_size': 1} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-10f50109-612e-4445-acf5-0266fb63956b tempest-CreateVolumesFromSnapshotTest-175896033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:16 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5a55857d-7cef-4491-b01f-53d170e7d884 tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cc6bb0a2-98c8-4ad0-85ad-9e8c49eab966" returned: 0 in 0.240s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-5a55857d-7cef-4491-b01f-53d170e7d884 tempest-CreateVolumesFromSnapshotTest-175896033 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5a55857d-7cef-4491-b01f-53d170e7d884 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f6a50aad-4932-488b-a411-5d64f94a77f7 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.932s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f6a50aad-4932-488b-a411-5d64f94a77f7 tempest-CreateVolumesFromSnapshotTest-175896033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1758246059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef50403c-8d95-4aa7-b82a-53fabc3daeb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a52c91bcc5c4e9f8df32a463c46fee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:16Z,use_quota=True,user_id='a61bc68977d8451baea6c4cd455c09dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-f6a50aad-4932-488b-a411-5d64f94a77f7 tempest-CreateVolumesFromSnapshotTest-175896033 None] Creating volume ef50403c-8d95-4aa7-b82a-53fabc3daeb8 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f6a50aad-4932-488b-a411-5d64f94a77f7 tempest-CreateVolumesFromSnapshotTest-175896033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f6a50aad-4932-488b-a411-5d64f94a77f7 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f6a50aad-4932-488b-a411-5d64f94a77f7 tempest-CreateVolumesFromSnapshotTest-175896033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f6a50aad-4932-488b-a411-5d64f94a77f7 tempest-CreateVolumesFromSnapshotTest-175896033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f6a50aad-4932-488b-a411-5d64f94a77f7 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f6a50aad-4932-488b-a411-5d64f94a77f7 tempest-CreateVolumesFromSnapshotTest-175896033 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:56:16 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-f6a50aad-4932-488b-a411-5d64f94a77f7 tempest-CreateVolumesFromSnapshotTest-175896033 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f6a50aad-4932-488b-a411-5d64f94a77f7 tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ef50403c-8d95-4aa7-b82a-53fabc3daeb8 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5a55857d-7cef-4491-b01f-53d170e7d884 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08a59002-a5c6-4236-9b17-5d5f0acfb174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc6bb0a2-98c8-4ad0-85ad-9e8c49eab966', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:16 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ef50403c-8d95-4aa7-b82a-53fabc3daeb8 1073741824 Sep 10 16:56:16 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5a55857d-7cef-4491-b01f-53d170e7d884 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba177605-d554-4830-80df-e2699cc2b057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:16 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-5a55857d-7cef-4491-b01f-53d170e7d884 tempest-CreateVolumesFromSnapshotTest-175896033 None] Volume volume-cc6bb0a2-98c8-4ad0-85ad-9e8c49eab966 (cc6bb0a2-98c8-4ad0-85ad-9e8c49eab966): created successfully Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5a55857d-7cef-4491-b01f-53d170e7d884 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba177605-d554-4830-80df-e2699cc2b057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5a55857d-7cef-4491-b01f-53d170e7d884 tempest-CreateVolumesFromSnapshotTest-175896033 None] Flow 'volume_create_manager' (0986c377-7c5f-46c1-8cdf-57a5081780a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:16 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-5a55857d-7cef-4491-b01f-53d170e7d884 tempest-CreateVolumesFromSnapshotTest-175896033 None] Created volume successfully. Sep 10 16:56:17 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f6a50aad-4932-488b-a411-5d64f94a77f7 tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ef50403c-8d95-4aa7-b82a-53fabc3daeb8 1073741824" returned: 0 in 0.402s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f6a50aad-4932-488b-a411-5d64f94a77f7 tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ef50403c-8d95-4aa7-b82a-53fabc3daeb8 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:17 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ef50403c-8d95-4aa7-b82a-53fabc3daeb8 Sep 10 16:56:17 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:17 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f6a50aad-4932-488b-a411-5d64f94a77f7 tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ef50403c-8d95-4aa7-b82a-53fabc3daeb8" returned: 0 in 0.253s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f6a50aad-4932-488b-a411-5d64f94a77f7 tempest-CreateVolumesFromSnapshotTest-175896033 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:56:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f6a50aad-4932-488b-a411-5d64f94a77f7 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-821b846a-f4c3-4920-9bbf-ed0bfeae3b87 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.262s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-821b846a-f4c3-4920-9bbf-ed0bfeae3b87 tempest-CreateVolumesFromSnapshotTest-175896033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1560531586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab10688-fb3e-444d-bb4f-f1fe78b8bf13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a52c91bcc5c4e9f8df32a463c46fee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:16Z,use_quota=True,user_id='a61bc68977d8451baea6c4cd455c09dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:56:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-821b846a-f4c3-4920-9bbf-ed0bfeae3b87 tempest-CreateVolumesFromSnapshotTest-175896033 None] Creating volume 4ab10688-fb3e-444d-bb4f-f1fe78b8bf13 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:56:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-821b846a-f4c3-4920-9bbf-ed0bfeae3b87 tempest-CreateVolumesFromSnapshotTest-175896033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-821b846a-f4c3-4920-9bbf-ed0bfeae3b87 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-821b846a-f4c3-4920-9bbf-ed0bfeae3b87 tempest-CreateVolumesFromSnapshotTest-175896033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-821b846a-f4c3-4920-9bbf-ed0bfeae3b87 tempest-CreateVolumesFromSnapshotTest-175896033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-821b846a-f4c3-4920-9bbf-ed0bfeae3b87 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-821b846a-f4c3-4920-9bbf-ed0bfeae3b87 tempest-CreateVolumesFromSnapshotTest-175896033 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:56:17 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-821b846a-f4c3-4920-9bbf-ed0bfeae3b87 tempest-CreateVolumesFromSnapshotTest-175896033 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:56:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-821b846a-f4c3-4920-9bbf-ed0bfeae3b87 tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4ab10688-fb3e-444d-bb4f-f1fe78b8bf13 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:17 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4ab10688-fb3e-444d-bb4f-f1fe78b8bf13 1073741824 Sep 10 16:56:17 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f6a50aad-4932-488b-a411-5d64f94a77f7 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e19dc796-58bf-45df-aed3-ca9437aa2221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef50403c-8d95-4aa7-b82a-53fabc3daeb8', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f6a50aad-4932-488b-a411-5d64f94a77f7 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a21f87c-bf11-4d02-ad28-c15b2f7af56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:17 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-f6a50aad-4932-488b-a411-5d64f94a77f7 tempest-CreateVolumesFromSnapshotTest-175896033 None] Volume volume-ef50403c-8d95-4aa7-b82a-53fabc3daeb8 (ef50403c-8d95-4aa7-b82a-53fabc3daeb8): created successfully Sep 10 16:56:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f6a50aad-4932-488b-a411-5d64f94a77f7 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a21f87c-bf11-4d02-ad28-c15b2f7af56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:17 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f6a50aad-4932-488b-a411-5d64f94a77f7 tempest-CreateVolumesFromSnapshotTest-175896033 None] Flow 'volume_create_manager' (bfa7be05-e102-44db-816d-80bd59fd0ec5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:17 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-f6a50aad-4932-488b-a411-5d64f94a77f7 tempest-CreateVolumesFromSnapshotTest-175896033 None] Created volume successfully. Sep 10 16:56:17 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-821b846a-f4c3-4920-9bbf-ed0bfeae3b87 tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4ab10688-fb3e-444d-bb4f-f1fe78b8bf13 1073741824" returned: 0 in 0.410s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-821b846a-f4c3-4920-9bbf-ed0bfeae3b87 tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4ab10688-fb3e-444d-bb4f-f1fe78b8bf13 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:18 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4ab10688-fb3e-444d-bb4f-f1fe78b8bf13 Sep 10 16:56:18 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:18 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-821b846a-f4c3-4920-9bbf-ed0bfeae3b87 tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4ab10688-fb3e-444d-bb4f-f1fe78b8bf13" returned: 0 in 0.231s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:18 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-821b846a-f4c3-4920-9bbf-ed0bfeae3b87 tempest-CreateVolumesFromSnapshotTest-175896033 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:56:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-821b846a-f4c3-4920-9bbf-ed0bfeae3b87 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-10f50109-612e-4445-acf5-0266fb63956b tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.564s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:18 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-10f50109-612e-4445-acf5-0266fb63956b tempest-CreateVolumesFromSnapshotTest-175896033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2003403594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fded248-a700-49f5-b4ba-f59add53e454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a52c91bcc5c4e9f8df32a463c46fee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:17Z,use_quota=True,user_id='a61bc68977d8451baea6c4cd455c09dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:56:18 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-10f50109-612e-4445-acf5-0266fb63956b tempest-CreateVolumesFromSnapshotTest-175896033 None] Creating volume 8fded248-a700-49f5-b4ba-f59add53e454 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:56:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-10f50109-612e-4445-acf5-0266fb63956b tempest-CreateVolumesFromSnapshotTest-175896033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-10f50109-612e-4445-acf5-0266fb63956b tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:18 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-10f50109-612e-4445-acf5-0266fb63956b tempest-CreateVolumesFromSnapshotTest-175896033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:18 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-10f50109-612e-4445-acf5-0266fb63956b tempest-CreateVolumesFromSnapshotTest-175896033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-10f50109-612e-4445-acf5-0266fb63956b tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:18 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-10f50109-612e-4445-acf5-0266fb63956b tempest-CreateVolumesFromSnapshotTest-175896033 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:56:18 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-10f50109-612e-4445-acf5-0266fb63956b tempest-CreateVolumesFromSnapshotTest-175896033 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:56:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-10f50109-612e-4445-acf5-0266fb63956b tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8fded248-a700-49f5-b4ba-f59add53e454 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-821b846a-f4c3-4920-9bbf-ed0bfeae3b87 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9224db26-f6f8-40bd-acf2-f9502474e55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ab10688-fb3e-444d-bb4f-f1fe78b8bf13', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:18 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8fded248-a700-49f5-b4ba-f59add53e454 1073741824 Sep 10 16:56:18 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-821b846a-f4c3-4920-9bbf-ed0bfeae3b87 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e29cb0-557f-4865-9dcf-c1bd7ea4abb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:18 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-821b846a-f4c3-4920-9bbf-ed0bfeae3b87 tempest-CreateVolumesFromSnapshotTest-175896033 None] Volume volume-4ab10688-fb3e-444d-bb4f-f1fe78b8bf13 (4ab10688-fb3e-444d-bb4f-f1fe78b8bf13): created successfully Sep 10 16:56:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-821b846a-f4c3-4920-9bbf-ed0bfeae3b87 tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e29cb0-557f-4865-9dcf-c1bd7ea4abb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-821b846a-f4c3-4920-9bbf-ed0bfeae3b87 tempest-CreateVolumesFromSnapshotTest-175896033 None] Flow 'volume_create_manager' (ee71b72f-2ef5-40ea-a668-e7399c7b11cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:18 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-821b846a-f4c3-4920-9bbf-ed0bfeae3b87 tempest-CreateVolumesFromSnapshotTest-175896033 None] Created volume successfully. Sep 10 16:56:18 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-10f50109-612e-4445-acf5-0266fb63956b tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8fded248-a700-49f5-b4ba-f59add53e454 1073741824" returned: 0 in 0.402s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-10f50109-612e-4445-acf5-0266fb63956b tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8fded248-a700-49f5-b4ba-f59add53e454 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:18 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8fded248-a700-49f5-b4ba-f59add53e454 Sep 10 16:56:18 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:18 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-10f50109-612e-4445-acf5-0266fb63956b tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8fded248-a700-49f5-b4ba-f59add53e454" returned: 0 in 0.273s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:18 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-10f50109-612e-4445-acf5-0266fb63956b tempest-CreateVolumesFromSnapshotTest-175896033 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:56:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-10f50109-612e-4445-acf5-0266fb63956b tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-10f50109-612e-4445-acf5-0266fb63956b tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b92ffdad-a96a-4146-b505-82bb01abb6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fded248-a700-49f5-b4ba-f59add53e454', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-10f50109-612e-4445-acf5-0266fb63956b tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc968027-04db-4a02-964f-674631011e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:18 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-10f50109-612e-4445-acf5-0266fb63956b tempest-CreateVolumesFromSnapshotTest-175896033 None] Volume volume-8fded248-a700-49f5-b4ba-f59add53e454 (8fded248-a700-49f5-b4ba-f59add53e454): created successfully Sep 10 16:56:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-10f50109-612e-4445-acf5-0266fb63956b tempest-CreateVolumesFromSnapshotTest-175896033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc968027-04db-4a02-964f-674631011e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:18 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-10f50109-612e-4445-acf5-0266fb63956b tempest-CreateVolumesFromSnapshotTest-175896033 None] Flow 'volume_create_manager' (a538e555-07d6-4d08-b7af-c3ba2b374832) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:18 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-10f50109-612e-4445-acf5-0266fb63956b tempest-CreateVolumesFromSnapshotTest-175896033 None] Created volume successfully. Sep 10 16:56:19 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-fd360603-cc5e-4f38-b6e4-4c250b24f357 tempest-CreateVolumesFromSnapshotTest-175896033 None] Acquiring lock "cinder-8fded248-a700-49f5-b4ba-f59add53e454-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:19 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-fd360603-cc5e-4f38-b6e4-4c250b24f357 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "cinder-8fded248-a700-49f5-b4ba-f59add53e454-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:20 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-fd360603-cc5e-4f38-b6e4-4c250b24f357 tempest-CreateVolumesFromSnapshotTest-175896033 None] Acquiring lock "cinder-quobyte-8fded248-a700-49f5-b4ba-f59add53e454" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:20 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-fd360603-cc5e-4f38-b6e4-4c250b24f357 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "cinder-quobyte-8fded248-a700-49f5-b4ba-f59add53e454" acquired by "delete_volume" :: waited 0.019s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:20 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8936fbcd-c98f-4ab1-a4aa-7abd97187def]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:56:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fd360603-cc5e-4f38-b6e4-4c250b24f357 tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8fded248-a700-49f5-b4ba-f59add53e454 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:20 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8fded248-a700-49f5-b4ba-f59add53e454 Sep 10 16:56:20 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:20 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fd360603-cc5e-4f38-b6e4-4c250b24f357 tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8fded248-a700-49f5-b4ba-f59add53e454" returned: 0 in 0.359s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fd360603-cc5e-4f38-b6e4-4c250b24f357 tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8fded248-a700-49f5-b4ba-f59add53e454 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:20 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8fded248-a700-49f5-b4ba-f59add53e454 Sep 10 16:56:20 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:20 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fd360603-cc5e-4f38-b6e4-4c250b24f357 tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8fded248-a700-49f5-b4ba-f59add53e454" returned: 0 in 0.248s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:20 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-fd360603-cc5e-4f38-b6e4-4c250b24f357 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "cinder-quobyte-8fded248-a700-49f5-b4ba-f59add53e454" released by "delete_volume" :: held 0.648s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:56:20 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-fd360603-cc5e-4f38-b6e4-4c250b24f357 tempest-CreateVolumesFromSnapshotTest-175896033 None] Created reservations ['75d53776-6694-4be0-9077-5dbbe626fba2', 'd1cde496-b6f2-4302-b527-0bedbc48aa2c', 'bc1d573f-5576-4589-bd39-a896656b47bb', 'f00d04f6-768a-4724-ae59-3e045c81cbeb'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:56:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-fd360603-cc5e-4f38-b6e4-4c250b24f357 tempest-CreateVolumesFromSnapshotTest-175896033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-fd360603-cc5e-4f38-b6e4-4c250b24f357 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:20 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-fd360603-cc5e-4f38-b6e4-4c250b24f357 tempest-CreateVolumesFromSnapshotTest-175896033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:20 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-fd360603-cc5e-4f38-b6e4-4c250b24f357 tempest-CreateVolumesFromSnapshotTest-175896033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-fd360603-cc5e-4f38-b6e4-4c250b24f357 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fd360603-cc5e-4f38-b6e4-4c250b24f357 tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:20 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:56:20 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:21 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fd360603-cc5e-4f38-b6e4-4c250b24f357 tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.253s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:21 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-fd360603-cc5e-4f38-b6e4-4c250b24f357 tempest-CreateVolumesFromSnapshotTest-175896033 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:56:21 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-fd360603-cc5e-4f38-b6e4-4c250b24f357 tempest-CreateVolumesFromSnapshotTest-175896033 None] Deleted volume successfully. Sep 10 16:56:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-fd360603-cc5e-4f38-b6e4-4c250b24f357 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "cinder-8fded248-a700-49f5-b4ba-f59add53e454-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:56:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-25e02e46-a3a9-415a-baff-7ea20f45daf2 tempest-CreateVolumesFromSnapshotTest-175896033 None] Acquiring lock "cinder-4ab10688-fb3e-444d-bb4f-f1fe78b8bf13-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-25e02e46-a3a9-415a-baff-7ea20f45daf2 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "cinder-4ab10688-fb3e-444d-bb4f-f1fe78b8bf13-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-25e02e46-a3a9-415a-baff-7ea20f45daf2 tempest-CreateVolumesFromSnapshotTest-175896033 None] Acquiring lock "cinder-quobyte-4ab10688-fb3e-444d-bb4f-f1fe78b8bf13" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-25e02e46-a3a9-415a-baff-7ea20f45daf2 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "cinder-quobyte-4ab10688-fb3e-444d-bb4f-f1fe78b8bf13" acquired by "delete_volume" :: waited 0.014s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:21 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5caf8d61-dd5b-4916-a350-c60b571ee381]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:56:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-25e02e46-a3a9-415a-baff-7ea20f45daf2 tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4ab10688-fb3e-444d-bb4f-f1fe78b8bf13 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:21 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4ab10688-fb3e-444d-bb4f-f1fe78b8bf13 Sep 10 16:56:21 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:21 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-25e02e46-a3a9-415a-baff-7ea20f45daf2 tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4ab10688-fb3e-444d-bb4f-f1fe78b8bf13" returned: 0 in 0.365s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-25e02e46-a3a9-415a-baff-7ea20f45daf2 tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4ab10688-fb3e-444d-bb4f-f1fe78b8bf13 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:21 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4ab10688-fb3e-444d-bb4f-f1fe78b8bf13 Sep 10 16:56:21 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:21 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-25e02e46-a3a9-415a-baff-7ea20f45daf2 tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4ab10688-fb3e-444d-bb4f-f1fe78b8bf13" returned: 0 in 0.251s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-25e02e46-a3a9-415a-baff-7ea20f45daf2 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "cinder-quobyte-4ab10688-fb3e-444d-bb4f-f1fe78b8bf13" released by "delete_volume" :: held 0.657s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:56:21 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-25e02e46-a3a9-415a-baff-7ea20f45daf2 tempest-CreateVolumesFromSnapshotTest-175896033 None] Created reservations ['770237b4-dc03-43e9-9c98-26f1f5e3dd5b', 'f6185e74-afac-4aaa-bf04-f285bba9faae', '9554e3dc-0d14-471e-88dd-fef04326a959', '07e0990f-d35f-4643-ac50-184eee612762'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:56:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-25e02e46-a3a9-415a-baff-7ea20f45daf2 tempest-CreateVolumesFromSnapshotTest-175896033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-25e02e46-a3a9-415a-baff-7ea20f45daf2 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:21 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-25e02e46-a3a9-415a-baff-7ea20f45daf2 tempest-CreateVolumesFromSnapshotTest-175896033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:21 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-25e02e46-a3a9-415a-baff-7ea20f45daf2 tempest-CreateVolumesFromSnapshotTest-175896033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-25e02e46-a3a9-415a-baff-7ea20f45daf2 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-25e02e46-a3a9-415a-baff-7ea20f45daf2 tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:21 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:56:21 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:22 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-25e02e46-a3a9-415a-baff-7ea20f45daf2 tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.251s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:22 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-25e02e46-a3a9-415a-baff-7ea20f45daf2 tempest-CreateVolumesFromSnapshotTest-175896033 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:56:22 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-25e02e46-a3a9-415a-baff-7ea20f45daf2 tempest-CreateVolumesFromSnapshotTest-175896033 None] Deleted volume successfully. Sep 10 16:56:22 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-25e02e46-a3a9-415a-baff-7ea20f45daf2 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "cinder-4ab10688-fb3e-444d-bb4f-f1fe78b8bf13-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:56:22 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f4297db0-070b-426e-bbc7-904ca95779fc tempest-CreateVolumesFromSnapshotTest-175896033 None] Acquiring lock "cinder-ef50403c-8d95-4aa7-b82a-53fabc3daeb8-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:22 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f4297db0-070b-426e-bbc7-904ca95779fc tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "cinder-ef50403c-8d95-4aa7-b82a-53fabc3daeb8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:22 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f4297db0-070b-426e-bbc7-904ca95779fc tempest-CreateVolumesFromSnapshotTest-175896033 None] Acquiring lock "cinder-quobyte-ef50403c-8d95-4aa7-b82a-53fabc3daeb8" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:22 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f4297db0-070b-426e-bbc7-904ca95779fc tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "cinder-quobyte-ef50403c-8d95-4aa7-b82a-53fabc3daeb8" acquired by "delete_volume" :: waited 0.015s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:22 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[01555a44-ab0a-4641-96ca-e4274d538ae8]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:56:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f4297db0-070b-426e-bbc7-904ca95779fc tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ef50403c-8d95-4aa7-b82a-53fabc3daeb8 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:22 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ef50403c-8d95-4aa7-b82a-53fabc3daeb8 Sep 10 16:56:22 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:22 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f4297db0-070b-426e-bbc7-904ca95779fc tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ef50403c-8d95-4aa7-b82a-53fabc3daeb8" returned: 0 in 0.365s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f4297db0-070b-426e-bbc7-904ca95779fc tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ef50403c-8d95-4aa7-b82a-53fabc3daeb8 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:22 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ef50403c-8d95-4aa7-b82a-53fabc3daeb8 Sep 10 16:56:22 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:23 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f4297db0-070b-426e-bbc7-904ca95779fc tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ef50403c-8d95-4aa7-b82a-53fabc3daeb8" returned: 0 in 0.251s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:23 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f4297db0-070b-426e-bbc7-904ca95779fc tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "cinder-quobyte-ef50403c-8d95-4aa7-b82a-53fabc3daeb8" released by "delete_volume" :: held 0.671s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:56:23 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-f4297db0-070b-426e-bbc7-904ca95779fc tempest-CreateVolumesFromSnapshotTest-175896033 None] Created reservations ['71028872-9a5d-4333-a167-cf9d6ea1d13a', '11a108f6-ae88-4489-ae45-20b61d02854b', 'ceb52fa2-2b1e-4a02-ac03-e952e47abf37', '29c70ebc-906a-499b-b459-c97db68cba74'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:56:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f4297db0-070b-426e-bbc7-904ca95779fc tempest-CreateVolumesFromSnapshotTest-175896033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f4297db0-070b-426e-bbc7-904ca95779fc tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:23 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f4297db0-070b-426e-bbc7-904ca95779fc tempest-CreateVolumesFromSnapshotTest-175896033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:23 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f4297db0-070b-426e-bbc7-904ca95779fc tempest-CreateVolumesFromSnapshotTest-175896033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f4297db0-070b-426e-bbc7-904ca95779fc tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f4297db0-070b-426e-bbc7-904ca95779fc tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:23 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:56:23 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:23 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f4297db0-070b-426e-bbc7-904ca95779fc tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.247s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:23 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-f4297db0-070b-426e-bbc7-904ca95779fc tempest-CreateVolumesFromSnapshotTest-175896033 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:56:23 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-f4297db0-070b-426e-bbc7-904ca95779fc tempest-CreateVolumesFromSnapshotTest-175896033 None] Deleted volume successfully. Sep 10 16:56:23 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f4297db0-070b-426e-bbc7-904ca95779fc tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "cinder-ef50403c-8d95-4aa7-b82a-53fabc3daeb8-delete_volume" released by "delete_volume" :: held 1.129s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:56:23 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-05a98034-384d-4e59-915d-08d5b37f77e8 tempest-CreateVolumesFromSnapshotTest-175896033 None] Acquiring lock "cinder-cc6bb0a2-98c8-4ad0-85ad-9e8c49eab966-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:23 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-05a98034-384d-4e59-915d-08d5b37f77e8 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "cinder-cc6bb0a2-98c8-4ad0-85ad-9e8c49eab966-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:23 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-05a98034-384d-4e59-915d-08d5b37f77e8 tempest-CreateVolumesFromSnapshotTest-175896033 None] Acquiring lock "cinder-quobyte-cc6bb0a2-98c8-4ad0-85ad-9e8c49eab966" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:23 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-05a98034-384d-4e59-915d-08d5b37f77e8 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "cinder-quobyte-cc6bb0a2-98c8-4ad0-85ad-9e8c49eab966" acquired by "delete_volume" :: waited 0.016s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:23 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[993c8c8a-edf3-4d11-86a3-1a20225625eb]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:56:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-05a98034-384d-4e59-915d-08d5b37f77e8 tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cc6bb0a2-98c8-4ad0-85ad-9e8c49eab966 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:23 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cc6bb0a2-98c8-4ad0-85ad-9e8c49eab966 Sep 10 16:56:23 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:23 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-05a98034-384d-4e59-915d-08d5b37f77e8 tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cc6bb0a2-98c8-4ad0-85ad-9e8c49eab966" returned: 0 in 0.352s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-05a98034-384d-4e59-915d-08d5b37f77e8 tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cc6bb0a2-98c8-4ad0-85ad-9e8c49eab966 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:24 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cc6bb0a2-98c8-4ad0-85ad-9e8c49eab966 Sep 10 16:56:24 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:24 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-05a98034-384d-4e59-915d-08d5b37f77e8 tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cc6bb0a2-98c8-4ad0-85ad-9e8c49eab966" returned: 0 in 0.240s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:24 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-05a98034-384d-4e59-915d-08d5b37f77e8 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "cinder-quobyte-cc6bb0a2-98c8-4ad0-85ad-9e8c49eab966" released by "delete_volume" :: held 0.634s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:56:24 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-05a98034-384d-4e59-915d-08d5b37f77e8 tempest-CreateVolumesFromSnapshotTest-175896033 None] Created reservations ['972aa560-05b8-4d4d-9729-cd29fae6cccb', 'eed08b6d-f213-429a-bc05-aa4aa3cc387a', '0e48269f-3239-4ae5-ada7-dcfb7dea36d1', '5dcd0096-4edf-4241-abc0-e0891122038b'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:56:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-05a98034-384d-4e59-915d-08d5b37f77e8 tempest-CreateVolumesFromSnapshotTest-175896033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-05a98034-384d-4e59-915d-08d5b37f77e8 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:24 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-05a98034-384d-4e59-915d-08d5b37f77e8 tempest-CreateVolumesFromSnapshotTest-175896033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:24 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-05a98034-384d-4e59-915d-08d5b37f77e8 tempest-CreateVolumesFromSnapshotTest-175896033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-05a98034-384d-4e59-915d-08d5b37f77e8 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-05a98034-384d-4e59-915d-08d5b37f77e8 tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:24 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:56:24 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:24 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-05a98034-384d-4e59-915d-08d5b37f77e8 tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.261s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:24 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-05a98034-384d-4e59-915d-08d5b37f77e8 tempest-CreateVolumesFromSnapshotTest-175896033 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:56:24 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-05a98034-384d-4e59-915d-08d5b37f77e8 tempest-CreateVolumesFromSnapshotTest-175896033 None] Deleted volume successfully. Sep 10 16:56:24 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-05a98034-384d-4e59-915d-08d5b37f77e8 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "cinder-cc6bb0a2-98c8-4ad0-85ad-9e8c49eab966-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:56:24 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9ae2eee5-589c-40f7-b384-e876861e3a9a tempest-CreateVolumesFromSnapshotTest-175896033 None] Acquiring lock "cinder-5b3c4a53-d891-4a97-a3e7-ef74abc95b5a-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:24 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9ae2eee5-589c-40f7-b384-e876861e3a9a tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "cinder-5b3c4a53-d891-4a97-a3e7-ef74abc95b5a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:24 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9ae2eee5-589c-40f7-b384-e876861e3a9a tempest-CreateVolumesFromSnapshotTest-175896033 None] Acquiring lock "cinder-quobyte-5b3c4a53-d891-4a97-a3e7-ef74abc95b5a" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:24 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9ae2eee5-589c-40f7-b384-e876861e3a9a tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "cinder-quobyte-5b3c4a53-d891-4a97-a3e7-ef74abc95b5a" acquired by "delete_volume" :: waited 0.015s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:24 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f915e440-494d-4224-b39e-2194d3f8c8e0]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:56:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9ae2eee5-589c-40f7-b384-e876861e3a9a tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b3c4a53-d891-4a97-a3e7-ef74abc95b5a {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:24 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b3c4a53-d891-4a97-a3e7-ef74abc95b5a Sep 10 16:56:24 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:25 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9ae2eee5-589c-40f7-b384-e876861e3a9a tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b3c4a53-d891-4a97-a3e7-ef74abc95b5a" returned: 0 in 0.363s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9ae2eee5-589c-40f7-b384-e876861e3a9a tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b3c4a53-d891-4a97-a3e7-ef74abc95b5a {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:25 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b3c4a53-d891-4a97-a3e7-ef74abc95b5a Sep 10 16:56:25 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:25 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9ae2eee5-589c-40f7-b384-e876861e3a9a tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5b3c4a53-d891-4a97-a3e7-ef74abc95b5a" returned: 0 in 0.284s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9ae2eee5-589c-40f7-b384-e876861e3a9a tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "cinder-quobyte-5b3c4a53-d891-4a97-a3e7-ef74abc95b5a" released by "delete_volume" :: held 0.694s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-9ae2eee5-589c-40f7-b384-e876861e3a9a tempest-CreateVolumesFromSnapshotTest-175896033 None] Created reservations ['f1ac1d93-f093-4570-b9f8-755138a56e92', '9e9fb1a0-13ba-403f-a05f-9ecfd4310599', '3dde2b96-572f-4747-b9b2-b6146f968eb9', '29c2589f-1941-4eae-b9ba-0a2986dc732d'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2a0e7b5-b0ee-4379-a7e4-941d84a2a00a tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f2a0e7b5-b0ee-4379-a7e4-941d84a2a00a tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Flow 'volume_create_manager' (4bdf87ec-4b15-4665-a84e-00fa1f2be845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f2a0e7b5-b0ee-4379-a7e4-941d84a2a00a tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79068166-eed3-4c19-b22d-ef78f805d136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9ae2eee5-589c-40f7-b384-e876861e3a9a tempest-CreateVolumesFromSnapshotTest-175896033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9ae2eee5-589c-40f7-b384-e876861e3a9a tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9ae2eee5-589c-40f7-b384-e876861e3a9a tempest-CreateVolumesFromSnapshotTest-175896033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9ae2eee5-589c-40f7-b384-e876861e3a9a tempest-CreateVolumesFromSnapshotTest-175896033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9ae2eee5-589c-40f7-b384-e876861e3a9a tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9ae2eee5-589c-40f7-b384-e876861e3a9a tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f2a0e7b5-b0ee-4379-a7e4-941d84a2a00a tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79068166-eed3-4c19-b22d-ef78f805d136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1870985436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca528870-0496-4335-baa3-ee9cd44f56d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6f189e892442eb8379bec22cd8a73e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:26Z,use_quota=True,user_id='8b8bff77293b443699047c4be986652d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:25 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:56:25 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f2a0e7b5-b0ee-4379-a7e4-941d84a2a00a tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a50c19e0-b36d-45f0-88fe-b99db3519a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f2a0e7b5-b0ee-4379-a7e4-941d84a2a00a tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a50c19e0-b36d-45f0-88fe-b99db3519a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f2a0e7b5-b0ee-4379-a7e4-941d84a2a00a tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (017ad231-914e-4308-8545-1cadb757e758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f2a0e7b5-b0ee-4379-a7e4-941d84a2a00a tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (017ad231-914e-4308-8545-1cadb757e758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca528870-0496-4335-baa3-ee9cd44f56d2', 'volume_name': 'volume-ca528870-0496-4335-baa3-ee9cd44f56d2', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f2a0e7b5-b0ee-4379-a7e4-941d84a2a00a tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afaec203-789c-4be0-a7ba-ecf4ea2d2f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f2a0e7b5-b0ee-4379-a7e4-941d84a2a00a tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afaec203-789c-4be0-a7ba-ecf4ea2d2f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f2a0e7b5-b0ee-4379-a7e4-941d84a2a00a tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1387e356-c48f-4366-ba9c-e672a6c00a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:25 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-f2a0e7b5-b0ee-4379-a7e4-941d84a2a00a tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Volume ca528870-0496-4335-baa3-ee9cd44f56d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca528870-0496-4335-baa3-ee9cd44f56d2', 'volume_size': 1} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f2a0e7b5-b0ee-4379-a7e4-941d84a2a00a tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f2a0e7b5-b0ee-4379-a7e4-941d84a2a00a tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f2a0e7b5-b0ee-4379-a7e4-941d84a2a00a tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1870985436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca528870-0496-4335-baa3-ee9cd44f56d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6f189e892442eb8379bec22cd8a73e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:26Z,use_quota=True,user_id='8b8bff77293b443699047c4be986652d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-f2a0e7b5-b0ee-4379-a7e4-941d84a2a00a tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Creating volume ca528870-0496-4335-baa3-ee9cd44f56d2 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f2a0e7b5-b0ee-4379-a7e4-941d84a2a00a tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f2a0e7b5-b0ee-4379-a7e4-941d84a2a00a tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f2a0e7b5-b0ee-4379-a7e4-941d84a2a00a tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f2a0e7b5-b0ee-4379-a7e4-941d84a2a00a tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f2a0e7b5-b0ee-4379-a7e4-941d84a2a00a tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f2a0e7b5-b0ee-4379-a7e4-941d84a2a00a tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:56:25 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-f2a0e7b5-b0ee-4379-a7e4-941d84a2a00a tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f2a0e7b5-b0ee-4379-a7e4-941d84a2a00a tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ca528870-0496-4335-baa3-ee9cd44f56d2 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:25 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ca528870-0496-4335-baa3-ee9cd44f56d2 1073741824 Sep 10 16:56:25 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-342fa4af-e6c5-4136-bdc0-cf80a5da5edf tempest-CreateVolumesFromSnapshotTest-175896033 None] Acquiring lock "cinder-7a3bd31b-1af8-44a0-baa7-b44ac4fa06f3-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-342fa4af-e6c5-4136-bdc0-cf80a5da5edf tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "cinder-7a3bd31b-1af8-44a0-baa7-b44ac4fa06f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-342fa4af-e6c5-4136-bdc0-cf80a5da5edf tempest-CreateVolumesFromSnapshotTest-175896033 None] Acquiring lock "cinder-quobyte-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-342fa4af-e6c5-4136-bdc0-cf80a5da5edf tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "cinder-quobyte-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-342fa4af-e6c5-4136-bdc0-cf80a5da5edf tempest-CreateVolumesFromSnapshotTest-175896033 None] Acquiring lock "cinder-quobyte-7a3bd31b-1af8-44a0-baa7-b44ac4fa06f3" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:25 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9ae2eee5-589c-40f7-b384-e876861e3a9a tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.272s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-9ae2eee5-589c-40f7-b384-e876861e3a9a tempest-CreateVolumesFromSnapshotTest-175896033 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:56:25 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-9ae2eee5-589c-40f7-b384-e876861e3a9a tempest-CreateVolumesFromSnapshotTest-175896033 None] Deleted volume successfully. Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-342fa4af-e6c5-4136-bdc0-cf80a5da5edf tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "cinder-quobyte-7a3bd31b-1af8-44a0-baa7-b44ac4fa06f3" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-342fa4af-e6c5-4136-bdc0-cf80a5da5edf tempest-CreateVolumesFromSnapshotTest-175896033 None] Deleting offline snapshot 7a3bd31b-1af8-44a0-baa7-b44ac4fa06f3 of volume 5fac40ea-fcda-4f80-bbb5-0ced7bebbd79 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-342fa4af-e6c5-4136-bdc0-cf80a5da5edf tempest-CreateVolumesFromSnapshotTest-175896033 None] snapshot_file for this snap is: volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79.7a3bd31b-1af8-44a0-baa7-b44ac4fa06f3 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9ae2eee5-589c-40f7-b384-e876861e3a9a tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "cinder-5b3c4a53-d891-4a97-a3e7-ef74abc95b5a-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[956a4169-74d4-4b3d-9d92-64f12bf8ce79]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:56:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-342fa4af-e6c5-4136-bdc0-cf80a5da5edf tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79.7a3bd31b-1af8-44a0-baa7-b44ac4fa06f3 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:26 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79.7a3bd31b-1af8-44a0-baa7-b44ac4fa06f3 Sep 10 16:56:26 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:26 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f2a0e7b5-b0ee-4379-a7e4-941d84a2a00a tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ca528870-0496-4335-baa3-ee9cd44f56d2 1073741824" returned: 0 in 0.444s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f2a0e7b5-b0ee-4379-a7e4-941d84a2a00a tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ca528870-0496-4335-baa3-ee9cd44f56d2 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:26 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ca528870-0496-4335-baa3-ee9cd44f56d2 Sep 10 16:56:26 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:26 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-342fa4af-e6c5-4136-bdc0-cf80a5da5edf tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79.7a3bd31b-1af8-44a0-baa7-b44ac4fa06f3" returned: 0 in 0.379s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-342fa4af-e6c5-4136-bdc0-cf80a5da5edf tempest-CreateVolumesFromSnapshotTest-175896033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:56:26 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9470fce-af24-43b9-ba97-f5798f7339b7]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:56:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-342fa4af-e6c5-4136-bdc0-cf80a5da5edf tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:26 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f2a0e7b5-b0ee-4379-a7e4-941d84a2a00a tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ca528870-0496-4335-baa3-ee9cd44f56d2" returned: 0 in 0.265s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f2a0e7b5-b0ee-4379-a7e4-941d84a2a00a tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:56:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f2a0e7b5-b0ee-4379-a7e4-941d84a2a00a tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f2a0e7b5-b0ee-4379-a7e4-941d84a2a00a tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1387e356-c48f-4366-ba9c-e672a6c00a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca528870-0496-4335-baa3-ee9cd44f56d2', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f2a0e7b5-b0ee-4379-a7e4-941d84a2a00a tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (593b0d7b-9c13-4c75-908b-59e7e3664119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:26 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79 Sep 10 16:56:26 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:26 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-f2a0e7b5-b0ee-4379-a7e4-941d84a2a00a tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Volume volume-ca528870-0496-4335-baa3-ee9cd44f56d2 (ca528870-0496-4335-baa3-ee9cd44f56d2): created successfully Sep 10 16:56:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f2a0e7b5-b0ee-4379-a7e4-941d84a2a00a tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (593b0d7b-9c13-4c75-908b-59e7e3664119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f2a0e7b5-b0ee-4379-a7e4-941d84a2a00a tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Flow 'volume_create_manager' (4bdf87ec-4b15-4665-a84e-00fa1f2be845) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:26 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-f2a0e7b5-b0ee-4379-a7e4-941d84a2a00a tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Created volume successfully. Sep 10 16:56:26 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-342fa4af-e6c5-4136-bdc0-cf80a5da5edf tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79" returned: 0 in 0.365s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-342fa4af-e6c5-4136-bdc0-cf80a5da5edf tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79.7a3bd31b-1af8-44a0-baa7-b44ac4fa06f3 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:26 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79.7a3bd31b-1af8-44a0-baa7-b44ac4fa06f3 Sep 10 16:56:26 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:27 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-342fa4af-e6c5-4136-bdc0-cf80a5da5edf tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79.7a3bd31b-1af8-44a0-baa7-b44ac4fa06f3" returned: 0 in 0.329s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-342fa4af-e6c5-4136-bdc0-cf80a5da5edf tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79.7a3bd31b-1af8-44a0-baa7-b44ac4fa06f3 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:27 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79.7a3bd31b-1af8-44a0-baa7-b44ac4fa06f3 Sep 10 16:56:27 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:27 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-342fa4af-e6c5-4136-bdc0-cf80a5da5edf tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79.7a3bd31b-1af8-44a0-baa7-b44ac4fa06f3" returned: 0 in 0.249s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:27 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-342fa4af-e6c5-4136-bdc0-cf80a5da5edf tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "cinder-quobyte-7a3bd31b-1af8-44a0-baa7-b44ac4fa06f3" released by "_delete_snapshot" :: held 1.420s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:56:27 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-342fa4af-e6c5-4136-bdc0-cf80a5da5edf tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "cinder-quobyte-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79" released by "delete_snapshot" :: held 1.452s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:56:27 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-342fa4af-e6c5-4136-bdc0-cf80a5da5edf tempest-CreateVolumesFromSnapshotTest-175896033 None] Created reservations ['0f21a104-503b-4b69-b613-8af9b779ef13', '5f4f0771-8d82-40bf-90bc-9999b2b5b8eb', 'f1235cd5-1f24-4763-989e-88f6452e8395', 'b6ecac87-b290-4c82-b64e-17feae2c373b'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:56:27 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-342fa4af-e6c5-4136-bdc0-cf80a5da5edf tempest-CreateVolumesFromSnapshotTest-175896033 None] Delete snapshot completed successfully. Sep 10 16:56:27 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-342fa4af-e6c5-4136-bdc0-cf80a5da5edf tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "cinder-7a3bd31b-1af8-44a0-baa7-b44ac4fa06f3-delete_snapshot" released by "delete_snapshot" :: held 1.584s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:56:28 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-cf0f774e-0baa-44e2-8644-279cf51128c2 tempest-CreateVolumesFromSnapshotTest-175896033 None] Acquiring lock "cinder-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:28 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-cf0f774e-0baa-44e2-8644-279cf51128c2 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "cinder-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:28 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-cf0f774e-0baa-44e2-8644-279cf51128c2 tempest-CreateVolumesFromSnapshotTest-175896033 None] Acquiring lock "cinder-quobyte-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:28 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-cf0f774e-0baa-44e2-8644-279cf51128c2 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "cinder-quobyte-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79" acquired by "delete_volume" :: waited 0.032s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:28 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[def1799d-4604-4faf-8e4e-1eef310ca709]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:56:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cf0f774e-0baa-44e2-8644-279cf51128c2 tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:28 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79 Sep 10 16:56:28 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-ef4c8704-82fe-4eb5-ba78-05aec49abcc1 req-294e6b73-843f-493c-99b1-d574dd418d96 tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-ef4c8704-82fe-4eb5-ba78-05aec49abcc1 req-294e6b73-843f-493c-99b1-d574dd418d96 tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [req-ef4c8704-82fe-4eb5-ba78-05aec49abcc1 req-294e6b73-843f-493c-99b1-d574dd418d96 tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-ef4c8704-82fe-4eb5-ba78-05aec49abcc1 req-294e6b73-843f-493c-99b1-d574dd418d96 tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8', 'name': 'volume-ca528870-0496-4335-baa3-ee9cd44f56d2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c12d5998-3598-42a3-94bd-83394c81dd49', 'enforce_multipath': True} {{(pid=88189) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 16:56:28 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cf0f774e-0baa-44e2-8644-279cf51128c2 tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79" returned: 0 in 0.374s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cf0f774e-0baa-44e2-8644-279cf51128c2 tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:28 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79 Sep 10 16:56:28 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:28 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-ef4c8704-82fe-4eb5-ba78-05aec49abcc1 req-294e6b73-843f-493c-99b1-d574dd418d96 tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] attachment_update completed successfully. Sep 10 16:56:28 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cf0f774e-0baa-44e2-8644-279cf51128c2 tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79" returned: 0 in 0.275s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:28 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-cf0f774e-0baa-44e2-8644-279cf51128c2 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "cinder-quobyte-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79" released by "delete_volume" :: held 0.730s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:56:28 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-cf0f774e-0baa-44e2-8644-279cf51128c2 tempest-CreateVolumesFromSnapshotTest-175896033 None] Created reservations ['0a3a88e3-6b56-4bc3-b718-d5d0d0720903', 'e3ce72d9-8a1e-4c1d-9207-2d7b339483a3', 'df34ab50-2a03-4f6e-94d2-ee1ca668ff77', '435ec654-7b6f-4968-8286-56e0bf382fd6'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:56:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-cf0f774e-0baa-44e2-8644-279cf51128c2 tempest-CreateVolumesFromSnapshotTest-175896033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-cf0f774e-0baa-44e2-8644-279cf51128c2 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:28 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-cf0f774e-0baa-44e2-8644-279cf51128c2 tempest-CreateVolumesFromSnapshotTest-175896033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:28 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-cf0f774e-0baa-44e2-8644-279cf51128c2 tempest-CreateVolumesFromSnapshotTest-175896033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-cf0f774e-0baa-44e2-8644-279cf51128c2 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cf0f774e-0baa-44e2-8644-279cf51128c2 tempest-CreateVolumesFromSnapshotTest-175896033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:28 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:56:28 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:29 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cf0f774e-0baa-44e2-8644-279cf51128c2 tempest-CreateVolumesFromSnapshotTest-175896033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.350s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:29 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-cf0f774e-0baa-44e2-8644-279cf51128c2 tempest-CreateVolumesFromSnapshotTest-175896033 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:56:29 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-cf0f774e-0baa-44e2-8644-279cf51128c2 tempest-CreateVolumesFromSnapshotTest-175896033 None] Deleted volume successfully. Sep 10 16:56:29 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-cf0f774e-0baa-44e2-8644-279cf51128c2 tempest-CreateVolumesFromSnapshotTest-175896033 None] Lock "cinder-5fac40ea-fcda-4f80-bbb5-0ced7bebbd79-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:56:31 devstack cinder-volume[88189]: INFO cinder.volume.manager [req-934b8cd0-cde9-44b1-8f7b-4f9b3e897d80 req-f4cd33d1-e016-4451-bd5f-3380ff30a120 tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Terminate volume connection completed successfully. Sep 10 16:56:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [req-934b8cd0-cde9-44b1-8f7b-4f9b3e897d80 req-f4cd33d1-e016-4451-bd5f-3380ff30a120 tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Deleting attachment c12d5998-3598-42a3-94bd-83394c81dd49. {{(pid=88189) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 16:56:32 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc0c7bc5-0d8a-4634-930b-017ef66a02d0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:56:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bc0c7bc5-0d8a-4634-930b-017ef66a02d0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Flow 'volume_create_manager' (5a013ce7-db4c-45a0-9640-f0db640aab6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bc0c7bc5-0d8a-4634-930b-017ef66a02d0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d6ff21d-e7dd-456b-a8b6-19ea75992bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bc0c7bc5-0d8a-4634-930b-017ef66a02d0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d6ff21d-e7dd-456b-a8b6-19ea75992bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1014465327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=601b8824-376e-4a21-b039-38e0add53b22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac6ea6f74c1f4cce9805d129e80fa9c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:32Z,use_quota=True,user_id='3db2c618f57f4d879246bcf2ed4d1d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bc0c7bc5-0d8a-4634-930b-017ef66a02d0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5a476a4-7720-42d6-8208-32b183c25f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bc0c7bc5-0d8a-4634-930b-017ef66a02d0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5a476a4-7720-42d6-8208-32b183c25f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bc0c7bc5-0d8a-4634-930b-017ef66a02d0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e15fd080-d139-433a-9634-bcf6e958c55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bc0c7bc5-0d8a-4634-930b-017ef66a02d0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e15fd080-d139-433a-9634-bcf6e958c55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '601b8824-376e-4a21-b039-38e0add53b22', 'volume_name': 'volume-601b8824-376e-4a21-b039-38e0add53b22', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bc0c7bc5-0d8a-4634-930b-017ef66a02d0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (503c4dc4-f5cb-45f2-9783-c7591cb1cfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bc0c7bc5-0d8a-4634-930b-017ef66a02d0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (503c4dc4-f5cb-45f2-9783-c7591cb1cfec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:32 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bc0c7bc5-0d8a-4634-930b-017ef66a02d0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae0aaa98-604b-4fe5-af2f-d9f425d06b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:32 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-bc0c7bc5-0d8a-4634-930b-017ef66a02d0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Volume 601b8824-376e-4a21-b039-38e0add53b22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-601b8824-376e-4a21-b039-38e0add53b22', 'volume_size': 1} Sep 10 16:56:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-bc0c7bc5-0d8a-4634-930b-017ef66a02d0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-bc0c7bc5-0d8a-4634-930b-017ef66a02d0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-bc0c7bc5-0d8a-4634-930b-017ef66a02d0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1014465327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=601b8824-376e-4a21-b039-38e0add53b22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac6ea6f74c1f4cce9805d129e80fa9c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:32Z,use_quota=True,user_id='3db2c618f57f4d879246bcf2ed4d1d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:56:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-bc0c7bc5-0d8a-4634-930b-017ef66a02d0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Creating volume 601b8824-376e-4a21-b039-38e0add53b22 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:56:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-bc0c7bc5-0d8a-4634-930b-017ef66a02d0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-bc0c7bc5-0d8a-4634-930b-017ef66a02d0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-bc0c7bc5-0d8a-4634-930b-017ef66a02d0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-bc0c7bc5-0d8a-4634-930b-017ef66a02d0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-bc0c7bc5-0d8a-4634-930b-017ef66a02d0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-bc0c7bc5-0d8a-4634-930b-017ef66a02d0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:56:32 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-bc0c7bc5-0d8a-4634-930b-017ef66a02d0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:56:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bc0c7bc5-0d8a-4634-930b-017ef66a02d0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-601b8824-376e-4a21-b039-38e0add53b22 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:32 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-601b8824-376e-4a21-b039-38e0add53b22 1073741824 Sep 10 16:56:32 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:32 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2bc62c8b-4ae7-45a1-afb8-193d5c35f1e2 tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Acquiring lock "cinder-ca528870-0496-4335-baa3-ee9cd44f56d2-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:32 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2bc62c8b-4ae7-45a1-afb8-193d5c35f1e2 tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Lock "cinder-ca528870-0496-4335-baa3-ee9cd44f56d2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:32 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:32 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2bc62c8b-4ae7-45a1-afb8-193d5c35f1e2 tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Acquiring lock "cinder-quobyte-ca528870-0496-4335-baa3-ee9cd44f56d2" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bc0c7bc5-0d8a-4634-930b-017ef66a02d0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-601b8824-376e-4a21-b039-38e0add53b22 1073741824" returned: 0 in 0.445s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:32 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2bc62c8b-4ae7-45a1-afb8-193d5c35f1e2 tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Lock "cinder-quobyte-ca528870-0496-4335-baa3-ee9cd44f56d2" acquired by "delete_volume" :: waited 0.024s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:32 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[14dd8410-d5ca-435d-8779-7aa04b6de216]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:56:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2bc62c8b-4ae7-45a1-afb8-193d5c35f1e2 tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ca528870-0496-4335-baa3-ee9cd44f56d2 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bc0c7bc5-0d8a-4634-930b-017ef66a02d0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-601b8824-376e-4a21-b039-38e0add53b22 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:32 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-601b8824-376e-4a21-b039-38e0add53b22 Sep 10 16:56:32 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:32 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ca528870-0496-4335-baa3-ee9cd44f56d2 Sep 10 16:56:32 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:32 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bc0c7bc5-0d8a-4634-930b-017ef66a02d0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-601b8824-376e-4a21-b039-38e0add53b22" returned: 0 in 0.245s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-bc0c7bc5-0d8a-4634-930b-017ef66a02d0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-bc0c7bc5-0d8a-4634-930b-017ef66a02d0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bc0c7bc5-0d8a-4634-930b-017ef66a02d0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae0aaa98-604b-4fe5-af2f-d9f425d06b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-601b8824-376e-4a21-b039-38e0add53b22', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bc0c7bc5-0d8a-4634-930b-017ef66a02d0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (981987e8-bb5c-4001-90a1-a6601ac683b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:33 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-bc0c7bc5-0d8a-4634-930b-017ef66a02d0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Volume volume-601b8824-376e-4a21-b039-38e0add53b22 (601b8824-376e-4a21-b039-38e0add53b22): created successfully Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bc0c7bc5-0d8a-4634-930b-017ef66a02d0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (981987e8-bb5c-4001-90a1-a6601ac683b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bc0c7bc5-0d8a-4634-930b-017ef66a02d0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Flow 'volume_create_manager' (5a013ce7-db4c-45a0-9640-f0db640aab6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:33 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-bc0c7bc5-0d8a-4634-930b-017ef66a02d0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Created volume successfully. Sep 10 16:56:33 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2bc62c8b-4ae7-45a1-afb8-193d5c35f1e2 tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ca528870-0496-4335-baa3-ee9cd44f56d2" returned: 0 in 0.384s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2bc62c8b-4ae7-45a1-afb8-193d5c35f1e2 tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ca528870-0496-4335-baa3-ee9cd44f56d2 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:33 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ca528870-0496-4335-baa3-ee9cd44f56d2 Sep 10 16:56:33 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:33 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2bc62c8b-4ae7-45a1-afb8-193d5c35f1e2 tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ca528870-0496-4335-baa3-ee9cd44f56d2" returned: 0 in 0.255s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2bc62c8b-4ae7-45a1-afb8-193d5c35f1e2 tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Lock "cinder-quobyte-ca528870-0496-4335-baa3-ee9cd44f56d2" released by "delete_volume" :: held 0.681s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-2bc62c8b-4ae7-45a1-afb8-193d5c35f1e2 tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Created reservations ['4953e1d4-bb4e-41e3-86ac-90a0e518ffd5', '156e0ab3-8858-4b38-ad81-be3afe15fa42', '5a23fc58-eda4-4bf6-8c45-a09c303827f9', 'ac9cac4c-e3ea-4e4b-932c-692bfefe34ee'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2bc62c8b-4ae7-45a1-afb8-193d5c35f1e2 tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2bc62c8b-4ae7-45a1-afb8-193d5c35f1e2 tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-2bc62c8b-4ae7-45a1-afb8-193d5c35f1e2 tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-2bc62c8b-4ae7-45a1-afb8-193d5c35f1e2 tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2bc62c8b-4ae7-45a1-afb8-193d5c35f1e2 tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2bc62c8b-4ae7-45a1-afb8-193d5c35f1e2 tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:33 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:56:33 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-08b1b0e6-0caa-4006-8932-b054b6e0ee8d tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-08b1b0e6-0caa-4006-8932-b054b6e0ee8d tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Flow 'volume_create_manager' (2a61e522-5d7b-4340-8ee5-f76f68f7e7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-08b1b0e6-0caa-4006-8932-b054b6e0ee8d tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c93e54ee-68da-421a-b769-2d0de7cdc533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-08b1b0e6-0caa-4006-8932-b054b6e0ee8d tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c93e54ee-68da-421a-b769-2d0de7cdc533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2103481677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc0a5e4d-a12f-428c-b97f-ef637a070134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac6ea6f74c1f4cce9805d129e80fa9c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:34Z,use_quota=True,user_id='3db2c618f57f4d879246bcf2ed4d1d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-08b1b0e6-0caa-4006-8932-b054b6e0ee8d tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (512e72b0-7211-4bbf-a2e7-16ec41406f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-08b1b0e6-0caa-4006-8932-b054b6e0ee8d tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (512e72b0-7211-4bbf-a2e7-16ec41406f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-08b1b0e6-0caa-4006-8932-b054b6e0ee8d tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2459bdcb-848c-4b43-9899-0ad1110c3f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-08b1b0e6-0caa-4006-8932-b054b6e0ee8d tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2459bdcb-848c-4b43-9899-0ad1110c3f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc0a5e4d-a12f-428c-b97f-ef637a070134', 'volume_name': 'volume-bc0a5e4d-a12f-428c-b97f-ef637a070134', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-08b1b0e6-0caa-4006-8932-b054b6e0ee8d tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b1dca7-f991-4496-9c9b-03ea3bb41ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-08b1b0e6-0caa-4006-8932-b054b6e0ee8d tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b1dca7-f991-4496-9c9b-03ea3bb41ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-08b1b0e6-0caa-4006-8932-b054b6e0ee8d tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2df9cf4b-d4e4-4d25-8508-6ef804328046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:33 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-08b1b0e6-0caa-4006-8932-b054b6e0ee8d tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Volume bc0a5e4d-a12f-428c-b97f-ef637a070134: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc0a5e4d-a12f-428c-b97f-ef637a070134', 'volume_size': 1} Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-08b1b0e6-0caa-4006-8932-b054b6e0ee8d tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-08b1b0e6-0caa-4006-8932-b054b6e0ee8d tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-08b1b0e6-0caa-4006-8932-b054b6e0ee8d tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2103481677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc0a5e4d-a12f-428c-b97f-ef637a070134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac6ea6f74c1f4cce9805d129e80fa9c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:34Z,use_quota=True,user_id='3db2c618f57f4d879246bcf2ed4d1d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-08b1b0e6-0caa-4006-8932-b054b6e0ee8d tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Creating volume bc0a5e4d-a12f-428c-b97f-ef637a070134 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-08b1b0e6-0caa-4006-8932-b054b6e0ee8d tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-08b1b0e6-0caa-4006-8932-b054b6e0ee8d tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-08b1b0e6-0caa-4006-8932-b054b6e0ee8d tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-08b1b0e6-0caa-4006-8932-b054b6e0ee8d tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-08b1b0e6-0caa-4006-8932-b054b6e0ee8d tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-08b1b0e6-0caa-4006-8932-b054b6e0ee8d tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:56:33 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-08b1b0e6-0caa-4006-8932-b054b6e0ee8d tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-08b1b0e6-0caa-4006-8932-b054b6e0ee8d tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bc0a5e4d-a12f-428c-b97f-ef637a070134 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:33 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bc0a5e4d-a12f-428c-b97f-ef637a070134 1073741824 Sep 10 16:56:33 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:33 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2bc62c8b-4ae7-45a1-afb8-193d5c35f1e2 tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.313s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-2bc62c8b-4ae7-45a1-afb8-193d5c35f1e2 tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:56:33 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-2bc62c8b-4ae7-45a1-afb8-193d5c35f1e2 tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Deleted volume successfully. Sep 10 16:56:33 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2bc62c8b-4ae7-45a1-afb8-193d5c35f1e2 tempest-TestServerVolumeAttachScenarioOldVersion-1903150261 None] Lock "cinder-ca528870-0496-4335-baa3-ee9cd44f56d2-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:56:34 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ea59a68-b40f-401b-9336-bb036bb93073 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:56:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7ea59a68-b40f-401b-9336-bb036bb93073 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Flow 'volume_create_manager' (3efddb78-8e99-42e2-b0ce-911f0d92cc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7ea59a68-b40f-401b-9336-bb036bb93073 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8a511d1-28df-4149-859f-c172ecf2ee38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7ea59a68-b40f-401b-9336-bb036bb93073 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8a511d1-28df-4149-859f-c172ecf2ee38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1184906849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb0caf89-99e6-4771-9d27-f9f8fa177b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac6ea6f74c1f4cce9805d129e80fa9c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:34Z,use_quota=True,user_id='3db2c618f57f4d879246bcf2ed4d1d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7ea59a68-b40f-401b-9336-bb036bb93073 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f96f633-4995-4318-b3c1-6988d5d23686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7ea59a68-b40f-401b-9336-bb036bb93073 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f96f633-4995-4318-b3c1-6988d5d23686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7ea59a68-b40f-401b-9336-bb036bb93073 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c22a2f64-6277-494c-b773-35e20e54a0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7ea59a68-b40f-401b-9336-bb036bb93073 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c22a2f64-6277-494c-b773-35e20e54a0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb0caf89-99e6-4771-9d27-f9f8fa177b08', 'volume_name': 'volume-bb0caf89-99e6-4771-9d27-f9f8fa177b08', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7ea59a68-b40f-401b-9336-bb036bb93073 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ca06a7b-140d-4598-b5a9-7d56c1682b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7ea59a68-b40f-401b-9336-bb036bb93073 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ca06a7b-140d-4598-b5a9-7d56c1682b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7ea59a68-b40f-401b-9336-bb036bb93073 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e788fa41-e837-4032-9e4d-1b565a0df0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:34 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-7ea59a68-b40f-401b-9336-bb036bb93073 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Volume bb0caf89-99e6-4771-9d27-f9f8fa177b08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb0caf89-99e6-4771-9d27-f9f8fa177b08', 'volume_size': 1} Sep 10 16:56:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7ea59a68-b40f-401b-9336-bb036bb93073 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:34 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-08b1b0e6-0caa-4006-8932-b054b6e0ee8d tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bc0a5e4d-a12f-428c-b97f-ef637a070134 1073741824" returned: 0 in 0.830s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-08b1b0e6-0caa-4006-8932-b054b6e0ee8d tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bc0a5e4d-a12f-428c-b97f-ef637a070134 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:34 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bc0a5e4d-a12f-428c-b97f-ef637a070134 Sep 10 16:56:34 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:34 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ad99896-5859-46b2-9ff7-b652e73fa7f0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:56:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7ad99896-5859-46b2-9ff7-b652e73fa7f0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Flow 'volume_create_manager' (4ec2a9b5-2c51-4db6-8c38-c17d0bbac09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7ad99896-5859-46b2-9ff7-b652e73fa7f0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c998b387-759e-45bb-a814-2e9cce21e32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7ad99896-5859-46b2-9ff7-b652e73fa7f0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c998b387-759e-45bb-a814-2e9cce21e32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-625763867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73250e95-4915-4937-a40c-833bbbb3a2f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac6ea6f74c1f4cce9805d129e80fa9c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:35Z,use_quota=True,user_id='3db2c618f57f4d879246bcf2ed4d1d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7ad99896-5859-46b2-9ff7-b652e73fa7f0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeea393a-178e-4ba6-87a1-02e561364d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7ad99896-5859-46b2-9ff7-b652e73fa7f0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeea393a-178e-4ba6-87a1-02e561364d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7ad99896-5859-46b2-9ff7-b652e73fa7f0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a45cb106-29f4-45b5-b989-3fe567295860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7ad99896-5859-46b2-9ff7-b652e73fa7f0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a45cb106-29f4-45b5-b989-3fe567295860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73250e95-4915-4937-a40c-833bbbb3a2f6', 'volume_name': 'volume-73250e95-4915-4937-a40c-833bbbb3a2f6', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7ad99896-5859-46b2-9ff7-b652e73fa7f0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7338f71-152a-410c-a874-ed9cd4688cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:34 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7ad99896-5859-46b2-9ff7-b652e73fa7f0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7338f71-152a-410c-a874-ed9cd4688cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7ad99896-5859-46b2-9ff7-b652e73fa7f0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (109cc1f9-852d-44ea-9903-706918bc5135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:35 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-7ad99896-5859-46b2-9ff7-b652e73fa7f0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Volume 73250e95-4915-4937-a40c-833bbbb3a2f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73250e95-4915-4937-a40c-833bbbb3a2f6', 'volume_size': 1} Sep 10 16:56:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7ad99896-5859-46b2-9ff7-b652e73fa7f0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:35 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-08b1b0e6-0caa-4006-8932-b054b6e0ee8d tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bc0a5e4d-a12f-428c-b97f-ef637a070134" returned: 0 in 0.411s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:35 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-08b1b0e6-0caa-4006-8932-b054b6e0ee8d tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:56:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-08b1b0e6-0caa-4006-8932-b054b6e0ee8d tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7ea59a68-b40f-401b-9336-bb036bb93073 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.771s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:35 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7ea59a68-b40f-401b-9336-bb036bb93073 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1184906849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb0caf89-99e6-4771-9d27-f9f8fa177b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac6ea6f74c1f4cce9805d129e80fa9c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:34Z,use_quota=True,user_id='3db2c618f57f4d879246bcf2ed4d1d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:56:35 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-7ea59a68-b40f-401b-9336-bb036bb93073 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Creating volume bb0caf89-99e6-4771-9d27-f9f8fa177b08 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:56:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7ea59a68-b40f-401b-9336-bb036bb93073 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7ea59a68-b40f-401b-9336-bb036bb93073 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:35 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7ea59a68-b40f-401b-9336-bb036bb93073 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:35 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7ea59a68-b40f-401b-9336-bb036bb93073 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7ea59a68-b40f-401b-9336-bb036bb93073 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:35 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7ea59a68-b40f-401b-9336-bb036bb93073 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:56:35 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-7ea59a68-b40f-401b-9336-bb036bb93073 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:56:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7ea59a68-b40f-401b-9336-bb036bb93073 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bb0caf89-99e6-4771-9d27-f9f8fa177b08 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-08b1b0e6-0caa-4006-8932-b054b6e0ee8d tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2df9cf4b-d4e4-4d25-8508-6ef804328046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc0a5e4d-a12f-428c-b97f-ef637a070134', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:35 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bb0caf89-99e6-4771-9d27-f9f8fa177b08 1073741824 Sep 10 16:56:35 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-08b1b0e6-0caa-4006-8932-b054b6e0ee8d tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1b70fbe-6c30-4101-aa0e-16d1c487908b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:35 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-08b1b0e6-0caa-4006-8932-b054b6e0ee8d tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Volume volume-bc0a5e4d-a12f-428c-b97f-ef637a070134 (bc0a5e4d-a12f-428c-b97f-ef637a070134): created successfully Sep 10 16:56:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-08b1b0e6-0caa-4006-8932-b054b6e0ee8d tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1b70fbe-6c30-4101-aa0e-16d1c487908b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-08b1b0e6-0caa-4006-8932-b054b6e0ee8d tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Flow 'volume_create_manager' (2a61e522-5d7b-4340-8ee5-f76f68f7e7e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:35 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-08b1b0e6-0caa-4006-8932-b054b6e0ee8d tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Created volume successfully. Sep 10 16:56:35 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7752361-7374-4feb-9568-247689e36167 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:56:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d7752361-7374-4feb-9568-247689e36167 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Flow 'volume_create_manager' (c31b9682-8549-4ac9-a528-a253dbad36bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d7752361-7374-4feb-9568-247689e36167 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64f73a61-7dbb-4b60-88e6-a8fed810135c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d7752361-7374-4feb-9568-247689e36167 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64f73a61-7dbb-4b60-88e6-a8fed810135c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1538031340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e55e8029-f548-4f38-b110-c2bcfb6f4666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac6ea6f74c1f4cce9805d129e80fa9c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:35Z,use_quota=True,user_id='3db2c618f57f4d879246bcf2ed4d1d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d7752361-7374-4feb-9568-247689e36167 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1600723a-3f2b-4194-9e46-78cb5b907667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d7752361-7374-4feb-9568-247689e36167 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1600723a-3f2b-4194-9e46-78cb5b907667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d7752361-7374-4feb-9568-247689e36167 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac6dd31f-9317-4e22-bcb3-e9a73d8a6aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d7752361-7374-4feb-9568-247689e36167 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac6dd31f-9317-4e22-bcb3-e9a73d8a6aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e55e8029-f548-4f38-b110-c2bcfb6f4666', 'volume_name': 'volume-e55e8029-f548-4f38-b110-c2bcfb6f4666', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d7752361-7374-4feb-9568-247689e36167 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4b55da5-31ac-4c39-af9e-d7baf21d6da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d7752361-7374-4feb-9568-247689e36167 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4b55da5-31ac-4c39-af9e-d7baf21d6da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:35 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d7752361-7374-4feb-9568-247689e36167 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13168844-9b18-403c-b247-0e1538499835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:35 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-d7752361-7374-4feb-9568-247689e36167 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Volume e55e8029-f548-4f38-b110-c2bcfb6f4666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e55e8029-f548-4f38-b110-c2bcfb6f4666', 'volume_size': 1} Sep 10 16:56:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d7752361-7374-4feb-9568-247689e36167 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:35 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7ea59a68-b40f-401b-9336-bb036bb93073 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bb0caf89-99e6-4771-9d27-f9f8fa177b08 1073741824" returned: 0 in 0.683s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7ea59a68-b40f-401b-9336-bb036bb93073 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bb0caf89-99e6-4771-9d27-f9f8fa177b08 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:35 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bb0caf89-99e6-4771-9d27-f9f8fa177b08 Sep 10 16:56:35 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:35 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1c98a61-8e84-4566-bf61-92edb2e767f5 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:56:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b1c98a61-8e84-4566-bf61-92edb2e767f5 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Flow 'volume_create_manager' (6a423ca7-f609-4d5c-a259-67fa4f209886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b1c98a61-8e84-4566-bf61-92edb2e767f5 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (406bf843-992a-4455-85af-fc4169b8aa3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b1c98a61-8e84-4566-bf61-92edb2e767f5 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (406bf843-992a-4455-85af-fc4169b8aa3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-556296012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e275116-99d2-4266-8348-96928f31f5de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac6ea6f74c1f4cce9805d129e80fa9c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:36Z,use_quota=True,user_id='3db2c618f57f4d879246bcf2ed4d1d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b1c98a61-8e84-4566-bf61-92edb2e767f5 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d430cf46-a4d3-415f-8077-f5ed24889504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b1c98a61-8e84-4566-bf61-92edb2e767f5 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d430cf46-a4d3-415f-8077-f5ed24889504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b1c98a61-8e84-4566-bf61-92edb2e767f5 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9565bf9-57f3-4df1-9011-79c1e01b6aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b1c98a61-8e84-4566-bf61-92edb2e767f5 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9565bf9-57f3-4df1-9011-79c1e01b6aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e275116-99d2-4266-8348-96928f31f5de', 'volume_name': 'volume-1e275116-99d2-4266-8348-96928f31f5de', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b1c98a61-8e84-4566-bf61-92edb2e767f5 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f38a12-c6cb-45e6-abd4-92928674482e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b1c98a61-8e84-4566-bf61-92edb2e767f5 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f38a12-c6cb-45e6-abd4-92928674482e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b1c98a61-8e84-4566-bf61-92edb2e767f5 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8684c7d-6ec1-4e20-9237-d61fb5326d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:36 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-b1c98a61-8e84-4566-bf61-92edb2e767f5 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Volume 1e275116-99d2-4266-8348-96928f31f5de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e275116-99d2-4266-8348-96928f31f5de', 'volume_size': 1} Sep 10 16:56:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b1c98a61-8e84-4566-bf61-92edb2e767f5 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:36 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7ea59a68-b40f-401b-9336-bb036bb93073 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bb0caf89-99e6-4771-9d27-f9f8fa177b08" returned: 0 in 0.304s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:36 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7ea59a68-b40f-401b-9336-bb036bb93073 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:56:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7ea59a68-b40f-401b-9336-bb036bb93073 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7ad99896-5859-46b2-9ff7-b652e73fa7f0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.147s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:36 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7ad99896-5859-46b2-9ff7-b652e73fa7f0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-625763867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73250e95-4915-4937-a40c-833bbbb3a2f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac6ea6f74c1f4cce9805d129e80fa9c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:35Z,use_quota=True,user_id='3db2c618f57f4d879246bcf2ed4d1d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:56:36 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-7ad99896-5859-46b2-9ff7-b652e73fa7f0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Creating volume 73250e95-4915-4937-a40c-833bbbb3a2f6 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:56:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7ad99896-5859-46b2-9ff7-b652e73fa7f0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7ad99896-5859-46b2-9ff7-b652e73fa7f0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:36 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7ad99896-5859-46b2-9ff7-b652e73fa7f0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:36 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7ad99896-5859-46b2-9ff7-b652e73fa7f0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7ad99896-5859-46b2-9ff7-b652e73fa7f0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:36 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7ad99896-5859-46b2-9ff7-b652e73fa7f0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:56:36 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-7ad99896-5859-46b2-9ff7-b652e73fa7f0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:56:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7ad99896-5859-46b2-9ff7-b652e73fa7f0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-73250e95-4915-4937-a40c-833bbbb3a2f6 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7ea59a68-b40f-401b-9336-bb036bb93073 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e788fa41-e837-4032-9e4d-1b565a0df0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb0caf89-99e6-4771-9d27-f9f8fa177b08', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7ea59a68-b40f-401b-9336-bb036bb93073 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ad545c6-cb73-4f6c-9211-442618c8ef3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:36 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-73250e95-4915-4937-a40c-833bbbb3a2f6 1073741824 Sep 10 16:56:36 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:36 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-7ea59a68-b40f-401b-9336-bb036bb93073 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Volume volume-bb0caf89-99e6-4771-9d27-f9f8fa177b08 (bb0caf89-99e6-4771-9d27-f9f8fa177b08): created successfully Sep 10 16:56:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7ea59a68-b40f-401b-9336-bb036bb93073 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ad545c6-cb73-4f6c-9211-442618c8ef3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:36 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7ea59a68-b40f-401b-9336-bb036bb93073 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Flow 'volume_create_manager' (3efddb78-8e99-42e2-b0ce-911f0d92cc78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:36 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-7ea59a68-b40f-401b-9336-bb036bb93073 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Created volume successfully. Sep 10 16:56:36 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7ad99896-5859-46b2-9ff7-b652e73fa7f0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-73250e95-4915-4937-a40c-833bbbb3a2f6 1073741824" returned: 0 in 0.492s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7ad99896-5859-46b2-9ff7-b652e73fa7f0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-73250e95-4915-4937-a40c-833bbbb3a2f6 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:36 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-73250e95-4915-4937-a40c-833bbbb3a2f6 Sep 10 16:56:36 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:36 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7ad99896-5859-46b2-9ff7-b652e73fa7f0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-73250e95-4915-4937-a40c-833bbbb3a2f6" returned: 0 in 0.302s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:36 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7ad99896-5859-46b2-9ff7-b652e73fa7f0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:56:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7ad99896-5859-46b2-9ff7-b652e73fa7f0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d7752361-7374-4feb-9568-247689e36167 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.467s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:37 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d7752361-7374-4feb-9568-247689e36167 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1538031340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e55e8029-f548-4f38-b110-c2bcfb6f4666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac6ea6f74c1f4cce9805d129e80fa9c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:35Z,use_quota=True,user_id='3db2c618f57f4d879246bcf2ed4d1d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:56:37 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-d7752361-7374-4feb-9568-247689e36167 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Creating volume e55e8029-f548-4f38-b110-c2bcfb6f4666 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:56:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d7752361-7374-4feb-9568-247689e36167 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d7752361-7374-4feb-9568-247689e36167 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:37 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d7752361-7374-4feb-9568-247689e36167 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:37 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d7752361-7374-4feb-9568-247689e36167 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d7752361-7374-4feb-9568-247689e36167 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:37 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d7752361-7374-4feb-9568-247689e36167 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:56:37 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-d7752361-7374-4feb-9568-247689e36167 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:56:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d7752361-7374-4feb-9568-247689e36167 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e55e8029-f548-4f38-b110-c2bcfb6f4666 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:37 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7ad99896-5859-46b2-9ff7-b652e73fa7f0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (109cc1f9-852d-44ea-9903-706918bc5135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73250e95-4915-4937-a40c-833bbbb3a2f6', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:37 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e55e8029-f548-4f38-b110-c2bcfb6f4666 1073741824 Sep 10 16:56:37 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:37 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7ad99896-5859-46b2-9ff7-b652e73fa7f0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ac609c4-2967-4ba0-80db-35dad482ab0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:37 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-7ad99896-5859-46b2-9ff7-b652e73fa7f0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Volume volume-73250e95-4915-4937-a40c-833bbbb3a2f6 (73250e95-4915-4937-a40c-833bbbb3a2f6): created successfully Sep 10 16:56:37 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7ad99896-5859-46b2-9ff7-b652e73fa7f0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ac609c4-2967-4ba0-80db-35dad482ab0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:37 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7ad99896-5859-46b2-9ff7-b652e73fa7f0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Flow 'volume_create_manager' (4ec2a9b5-2c51-4db6-8c38-c17d0bbac09a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:37 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-7ad99896-5859-46b2-9ff7-b652e73fa7f0 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Created volume successfully. Sep 10 16:56:37 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d7752361-7374-4feb-9568-247689e36167 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e55e8029-f548-4f38-b110-c2bcfb6f4666 1073741824" returned: 0 in 0.491s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d7752361-7374-4feb-9568-247689e36167 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e55e8029-f548-4f38-b110-c2bcfb6f4666 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:37 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e55e8029-f548-4f38-b110-c2bcfb6f4666 Sep 10 16:56:37 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:37 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d7752361-7374-4feb-9568-247689e36167 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e55e8029-f548-4f38-b110-c2bcfb6f4666" returned: 0 in 0.251s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:37 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d7752361-7374-4feb-9568-247689e36167 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:56:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d7752361-7374-4feb-9568-247689e36167 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b1c98a61-8e84-4566-bf61-92edb2e767f5 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.691s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:37 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b1c98a61-8e84-4566-bf61-92edb2e767f5 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-556296012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e275116-99d2-4266-8348-96928f31f5de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac6ea6f74c1f4cce9805d129e80fa9c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:36Z,use_quota=True,user_id='3db2c618f57f4d879246bcf2ed4d1d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:56:37 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-b1c98a61-8e84-4566-bf61-92edb2e767f5 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Creating volume 1e275116-99d2-4266-8348-96928f31f5de {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:56:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b1c98a61-8e84-4566-bf61-92edb2e767f5 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b1c98a61-8e84-4566-bf61-92edb2e767f5 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:37 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b1c98a61-8e84-4566-bf61-92edb2e767f5 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:37 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b1c98a61-8e84-4566-bf61-92edb2e767f5 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b1c98a61-8e84-4566-bf61-92edb2e767f5 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:37 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b1c98a61-8e84-4566-bf61-92edb2e767f5 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:56:37 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-b1c98a61-8e84-4566-bf61-92edb2e767f5 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:56:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b1c98a61-8e84-4566-bf61-92edb2e767f5 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1e275116-99d2-4266-8348-96928f31f5de 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:37 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d7752361-7374-4feb-9568-247689e36167 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13168844-9b18-403c-b247-0e1538499835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e55e8029-f548-4f38-b110-c2bcfb6f4666', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:37 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d7752361-7374-4feb-9568-247689e36167 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c79304d-665a-44e9-881c-5a4551efd8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:37 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1e275116-99d2-4266-8348-96928f31f5de 1073741824 Sep 10 16:56:37 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:37 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-d7752361-7374-4feb-9568-247689e36167 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Volume volume-e55e8029-f548-4f38-b110-c2bcfb6f4666 (e55e8029-f548-4f38-b110-c2bcfb6f4666): created successfully Sep 10 16:56:37 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d7752361-7374-4feb-9568-247689e36167 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c79304d-665a-44e9-881c-5a4551efd8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:37 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d7752361-7374-4feb-9568-247689e36167 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Flow 'volume_create_manager' (c31b9682-8549-4ac9-a528-a253dbad36bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:37 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-d7752361-7374-4feb-9568-247689e36167 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Created volume successfully. Sep 10 16:56:38 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b1c98a61-8e84-4566-bf61-92edb2e767f5 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1e275116-99d2-4266-8348-96928f31f5de 1073741824" returned: 0 in 0.496s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b1c98a61-8e84-4566-bf61-92edb2e767f5 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1e275116-99d2-4266-8348-96928f31f5de {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:38 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1e275116-99d2-4266-8348-96928f31f5de Sep 10 16:56:38 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:38 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b1c98a61-8e84-4566-bf61-92edb2e767f5 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1e275116-99d2-4266-8348-96928f31f5de" returned: 0 in 0.266s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:38 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b1c98a61-8e84-4566-bf61-92edb2e767f5 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:56:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b1c98a61-8e84-4566-bf61-92edb2e767f5 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:38 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b1c98a61-8e84-4566-bf61-92edb2e767f5 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8684c7d-6ec1-4e20-9237-d61fb5326d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e275116-99d2-4266-8348-96928f31f5de', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:38 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b1c98a61-8e84-4566-bf61-92edb2e767f5 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03feb620-565d-4ac6-90c9-4771cc227568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:38 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-b1c98a61-8e84-4566-bf61-92edb2e767f5 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Volume volume-1e275116-99d2-4266-8348-96928f31f5de (1e275116-99d2-4266-8348-96928f31f5de): created successfully Sep 10 16:56:38 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b1c98a61-8e84-4566-bf61-92edb2e767f5 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03feb620-565d-4ac6-90c9-4771cc227568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:38 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b1c98a61-8e84-4566-bf61-92edb2e767f5 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Flow 'volume_create_manager' (6a423ca7-f609-4d5c-a259-67fa4f209886) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:38 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-b1c98a61-8e84-4566-bf61-92edb2e767f5 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Created volume successfully. Sep 10 16:56:39 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-91d4d3f3-71fa-47e1-921a-32f6c48ae8f7 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Acquiring lock "cinder-1e275116-99d2-4266-8348-96928f31f5de-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:39 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-91d4d3f3-71fa-47e1-921a-32f6c48ae8f7 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "cinder-1e275116-99d2-4266-8348-96928f31f5de-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:39 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-91d4d3f3-71fa-47e1-921a-32f6c48ae8f7 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Acquiring lock "cinder-quobyte-1e275116-99d2-4266-8348-96928f31f5de" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:39 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-91d4d3f3-71fa-47e1-921a-32f6c48ae8f7 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "cinder-quobyte-1e275116-99d2-4266-8348-96928f31f5de" acquired by "delete_volume" :: waited 0.016s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:39 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f141a27d-16b8-449e-8b30-3cc33267adc1]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:56:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-91d4d3f3-71fa-47e1-921a-32f6c48ae8f7 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1e275116-99d2-4266-8348-96928f31f5de {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:39 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1e275116-99d2-4266-8348-96928f31f5de Sep 10 16:56:39 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:39 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-91d4d3f3-71fa-47e1-921a-32f6c48ae8f7 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1e275116-99d2-4266-8348-96928f31f5de" returned: 0 in 0.359s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-91d4d3f3-71fa-47e1-921a-32f6c48ae8f7 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1e275116-99d2-4266-8348-96928f31f5de {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:39 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1e275116-99d2-4266-8348-96928f31f5de Sep 10 16:56:39 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:40 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-91d4d3f3-71fa-47e1-921a-32f6c48ae8f7 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-1e275116-99d2-4266-8348-96928f31f5de" returned: 0 in 0.258s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:40 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-91d4d3f3-71fa-47e1-921a-32f6c48ae8f7 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "cinder-quobyte-1e275116-99d2-4266-8348-96928f31f5de" released by "delete_volume" :: held 0.661s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:56:40 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-91d4d3f3-71fa-47e1-921a-32f6c48ae8f7 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Created reservations ['bc2473e3-9e87-4cdb-9de5-82f9713a1698', 'f4e9f7ad-fb20-45ad-9039-b176b25073cd', '4ca7529b-a0b1-4449-99ac-dd18e6affb66', 'a24e3a8c-2a13-416e-874b-7095d42ccd42'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:56:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-91d4d3f3-71fa-47e1-921a-32f6c48ae8f7 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-91d4d3f3-71fa-47e1-921a-32f6c48ae8f7 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:40 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-91d4d3f3-71fa-47e1-921a-32f6c48ae8f7 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:40 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-91d4d3f3-71fa-47e1-921a-32f6c48ae8f7 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-91d4d3f3-71fa-47e1-921a-32f6c48ae8f7 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-91d4d3f3-71fa-47e1-921a-32f6c48ae8f7 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:40 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:56:40 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:40 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-91d4d3f3-71fa-47e1-921a-32f6c48ae8f7 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.262s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:40 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-91d4d3f3-71fa-47e1-921a-32f6c48ae8f7 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:56:40 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-91d4d3f3-71fa-47e1-921a-32f6c48ae8f7 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Deleted volume successfully. Sep 10 16:56:40 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-de4b2d60-eed0-4bce-a14b-9641dd6a42a1 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Acquiring lock "cinder-e55e8029-f548-4f38-b110-c2bcfb6f4666-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:40 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-91d4d3f3-71fa-47e1-921a-32f6c48ae8f7 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "cinder-1e275116-99d2-4266-8348-96928f31f5de-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:56:40 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-de4b2d60-eed0-4bce-a14b-9641dd6a42a1 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "cinder-e55e8029-f548-4f38-b110-c2bcfb6f4666-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:40 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-de4b2d60-eed0-4bce-a14b-9641dd6a42a1 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Acquiring lock "cinder-quobyte-e55e8029-f548-4f38-b110-c2bcfb6f4666" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:40 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-de4b2d60-eed0-4bce-a14b-9641dd6a42a1 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "cinder-quobyte-e55e8029-f548-4f38-b110-c2bcfb6f4666" acquired by "delete_volume" :: waited 0.019s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:40 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c99fee2-ea19-45eb-b0b2-65b88bbe48c2]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:56:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-de4b2d60-eed0-4bce-a14b-9641dd6a42a1 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e55e8029-f548-4f38-b110-c2bcfb6f4666 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:40 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e55e8029-f548-4f38-b110-c2bcfb6f4666 Sep 10 16:56:40 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:41 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-de4b2d60-eed0-4bce-a14b-9641dd6a42a1 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e55e8029-f548-4f38-b110-c2bcfb6f4666" returned: 0 in 0.356s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-de4b2d60-eed0-4bce-a14b-9641dd6a42a1 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e55e8029-f548-4f38-b110-c2bcfb6f4666 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:41 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e55e8029-f548-4f38-b110-c2bcfb6f4666 Sep 10 16:56:41 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:41 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-de4b2d60-eed0-4bce-a14b-9641dd6a42a1 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e55e8029-f548-4f38-b110-c2bcfb6f4666" returned: 0 in 0.299s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:41 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-de4b2d60-eed0-4bce-a14b-9641dd6a42a1 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "cinder-quobyte-e55e8029-f548-4f38-b110-c2bcfb6f4666" released by "delete_volume" :: held 0.696s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:56:41 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-de4b2d60-eed0-4bce-a14b-9641dd6a42a1 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Created reservations ['765cb3ce-f9ea-4e7c-a05a-c4fc5881d3d9', '031cb7c6-a8a7-4495-b4f7-742bc3104984', '87581519-5144-4814-af80-40c1d8262ab6', '6230246e-72b2-42b8-ba7f-42ca5f62d737'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:56:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-de4b2d60-eed0-4bce-a14b-9641dd6a42a1 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-de4b2d60-eed0-4bce-a14b-9641dd6a42a1 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:41 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-de4b2d60-eed0-4bce-a14b-9641dd6a42a1 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:41 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-de4b2d60-eed0-4bce-a14b-9641dd6a42a1 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-de4b2d60-eed0-4bce-a14b-9641dd6a42a1 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-de4b2d60-eed0-4bce-a14b-9641dd6a42a1 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:41 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:56:41 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:41 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-269ed4ee-bcd9-4fed-88b5-e117e4ec2d95 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Acquiring lock "cinder-73250e95-4915-4937-a40c-833bbbb3a2f6-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:41 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-269ed4ee-bcd9-4fed-88b5-e117e4ec2d95 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "cinder-73250e95-4915-4937-a40c-833bbbb3a2f6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:41 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-de4b2d60-eed0-4bce-a14b-9641dd6a42a1 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.288s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:41 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-de4b2d60-eed0-4bce-a14b-9641dd6a42a1 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:56:41 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-de4b2d60-eed0-4bce-a14b-9641dd6a42a1 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Deleted volume successfully. Sep 10 16:56:41 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-de4b2d60-eed0-4bce-a14b-9641dd6a42a1 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "cinder-e55e8029-f548-4f38-b110-c2bcfb6f4666-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:56:41 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-269ed4ee-bcd9-4fed-88b5-e117e4ec2d95 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Acquiring lock "cinder-quobyte-73250e95-4915-4937-a40c-833bbbb3a2f6" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:41 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-269ed4ee-bcd9-4fed-88b5-e117e4ec2d95 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "cinder-quobyte-73250e95-4915-4937-a40c-833bbbb3a2f6" acquired by "delete_volume" :: waited 0.015s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:41 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d637d1c7-e961-4cd7-85dd-544bd92f54d9]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:56:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-269ed4ee-bcd9-4fed-88b5-e117e4ec2d95 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-73250e95-4915-4937-a40c-833bbbb3a2f6 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:42 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-73250e95-4915-4937-a40c-833bbbb3a2f6 Sep 10 16:56:42 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:42 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-269ed4ee-bcd9-4fed-88b5-e117e4ec2d95 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-73250e95-4915-4937-a40c-833bbbb3a2f6" returned: 0 in 0.437s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-269ed4ee-bcd9-4fed-88b5-e117e4ec2d95 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-73250e95-4915-4937-a40c-833bbbb3a2f6 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:42 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-73250e95-4915-4937-a40c-833bbbb3a2f6 Sep 10 16:56:42 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:42 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-269ed4ee-bcd9-4fed-88b5-e117e4ec2d95 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-73250e95-4915-4937-a40c-833bbbb3a2f6" returned: 0 in 0.257s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:42 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-269ed4ee-bcd9-4fed-88b5-e117e4ec2d95 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "cinder-quobyte-73250e95-4915-4937-a40c-833bbbb3a2f6" released by "delete_volume" :: held 0.733s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:56:42 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-269ed4ee-bcd9-4fed-88b5-e117e4ec2d95 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Created reservations ['a227b56f-fa91-4e59-b593-5a96c7bf9c11', '976c341e-b424-4f57-bdf2-1cb37017a3c6', '73c83f6e-1bff-42f2-bdba-914767178593', '291638de-0778-474e-be7e-85b8d3d43482'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:56:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-269ed4ee-bcd9-4fed-88b5-e117e4ec2d95 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-269ed4ee-bcd9-4fed-88b5-e117e4ec2d95 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:42 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-269ed4ee-bcd9-4fed-88b5-e117e4ec2d95 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:42 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-269ed4ee-bcd9-4fed-88b5-e117e4ec2d95 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-269ed4ee-bcd9-4fed-88b5-e117e4ec2d95 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-269ed4ee-bcd9-4fed-88b5-e117e4ec2d95 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:42 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:56:42 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:42 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-0ca96837-6177-4d39-a29a-7f18f4ec5c32 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Acquiring lock "cinder-bb0caf89-99e6-4771-9d27-f9f8fa177b08-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:43 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:43 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-0ca96837-6177-4d39-a29a-7f18f4ec5c32 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "cinder-bb0caf89-99e6-4771-9d27-f9f8fa177b08-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-269ed4ee-bcd9-4fed-88b5-e117e4ec2d95 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.281s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:43 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-269ed4ee-bcd9-4fed-88b5-e117e4ec2d95 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:56:43 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-269ed4ee-bcd9-4fed-88b5-e117e4ec2d95 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Deleted volume successfully. Sep 10 16:56:43 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-269ed4ee-bcd9-4fed-88b5-e117e4ec2d95 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "cinder-73250e95-4915-4937-a40c-833bbbb3a2f6-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:56:43 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-0ca96837-6177-4d39-a29a-7f18f4ec5c32 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Acquiring lock "cinder-quobyte-bb0caf89-99e6-4771-9d27-f9f8fa177b08" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:43 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-0ca96837-6177-4d39-a29a-7f18f4ec5c32 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "cinder-quobyte-bb0caf89-99e6-4771-9d27-f9f8fa177b08" acquired by "delete_volume" :: waited 0.016s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:43 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5def1e18-127d-4f01-b553-55cdfe9dde67]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:56:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0ca96837-6177-4d39-a29a-7f18f4ec5c32 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bb0caf89-99e6-4771-9d27-f9f8fa177b08 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:43 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bb0caf89-99e6-4771-9d27-f9f8fa177b08 Sep 10 16:56:43 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:43 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0ca96837-6177-4d39-a29a-7f18f4ec5c32 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bb0caf89-99e6-4771-9d27-f9f8fa177b08" returned: 0 in 0.374s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0ca96837-6177-4d39-a29a-7f18f4ec5c32 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bb0caf89-99e6-4771-9d27-f9f8fa177b08 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:43 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bb0caf89-99e6-4771-9d27-f9f8fa177b08 Sep 10 16:56:43 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:43 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0ca96837-6177-4d39-a29a-7f18f4ec5c32 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bb0caf89-99e6-4771-9d27-f9f8fa177b08" returned: 0 in 0.266s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:43 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-0ca96837-6177-4d39-a29a-7f18f4ec5c32 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "cinder-quobyte-bb0caf89-99e6-4771-9d27-f9f8fa177b08" released by "delete_volume" :: held 0.687s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:56:43 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-0ca96837-6177-4d39-a29a-7f18f4ec5c32 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Created reservations ['5246aa67-5a49-4b7a-b85d-e5928e640cf6', '35c442d5-94cc-4288-b919-d84b5cd6593f', 'c149c3e9-e796-4d12-92ac-d67848cad72a', '3bc69ecb-0969-44cf-8269-1415e9d84d31'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:56:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0ca96837-6177-4d39-a29a-7f18f4ec5c32 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0ca96837-6177-4d39-a29a-7f18f4ec5c32 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:43 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0ca96837-6177-4d39-a29a-7f18f4ec5c32 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:43 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0ca96837-6177-4d39-a29a-7f18f4ec5c32 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0ca96837-6177-4d39-a29a-7f18f4ec5c32 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0ca96837-6177-4d39-a29a-7f18f4ec5c32 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:43 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:56:43 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:44 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:44 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-3caa1756-575f-4748-b7c8-97a5e24304c4 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Acquiring lock "cinder-bc0a5e4d-a12f-428c-b97f-ef637a070134-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0ca96837-6177-4d39-a29a-7f18f4ec5c32 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.267s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:44 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-0ca96837-6177-4d39-a29a-7f18f4ec5c32 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:56:44 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-0ca96837-6177-4d39-a29a-7f18f4ec5c32 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Deleted volume successfully. Sep 10 16:56:44 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-3caa1756-575f-4748-b7c8-97a5e24304c4 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "cinder-bc0a5e4d-a12f-428c-b97f-ef637a070134-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:44 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-0ca96837-6177-4d39-a29a-7f18f4ec5c32 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "cinder-bb0caf89-99e6-4771-9d27-f9f8fa177b08-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:56:44 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-3caa1756-575f-4748-b7c8-97a5e24304c4 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Acquiring lock "cinder-quobyte-bc0a5e4d-a12f-428c-b97f-ef637a070134" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:44 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-3caa1756-575f-4748-b7c8-97a5e24304c4 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "cinder-quobyte-bc0a5e4d-a12f-428c-b97f-ef637a070134" acquired by "delete_volume" :: waited 0.016s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:44 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fe34c2-02d0-49d2-b300-ee789afe30b6]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:56:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3caa1756-575f-4748-b7c8-97a5e24304c4 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bc0a5e4d-a12f-428c-b97f-ef637a070134 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:44 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bc0a5e4d-a12f-428c-b97f-ef637a070134 Sep 10 16:56:44 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:44 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3caa1756-575f-4748-b7c8-97a5e24304c4 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bc0a5e4d-a12f-428c-b97f-ef637a070134" returned: 0 in 0.384s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3caa1756-575f-4748-b7c8-97a5e24304c4 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bc0a5e4d-a12f-428c-b97f-ef637a070134 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:44 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bc0a5e4d-a12f-428c-b97f-ef637a070134 Sep 10 16:56:44 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:44 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3caa1756-575f-4748-b7c8-97a5e24304c4 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bc0a5e4d-a12f-428c-b97f-ef637a070134" returned: 0 in 0.276s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:44 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-3caa1756-575f-4748-b7c8-97a5e24304c4 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "cinder-quobyte-bc0a5e4d-a12f-428c-b97f-ef637a070134" released by "delete_volume" :: held 0.700s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:56:45 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-3caa1756-575f-4748-b7c8-97a5e24304c4 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Created reservations ['b25ea242-34f8-421b-8837-690b30ca94d8', '68c3e1dc-52ab-4f57-8035-f727d733e3b7', 'df1a9820-fdcc-4bfe-b3f7-ff642321ebb4', '3bcfda7f-2b87-487e-a623-a4d77a6ec98f'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:56:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3caa1756-575f-4748-b7c8-97a5e24304c4 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3caa1756-575f-4748-b7c8-97a5e24304c4 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:45 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3caa1756-575f-4748-b7c8-97a5e24304c4 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:45 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3caa1756-575f-4748-b7c8-97a5e24304c4 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3caa1756-575f-4748-b7c8-97a5e24304c4 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3caa1756-575f-4748-b7c8-97a5e24304c4 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:45 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:56:45 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:45 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-67c656c2-1804-48da-965a-5221b024fc17 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Acquiring lock "cinder-601b8824-376e-4a21-b039-38e0add53b22-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:45 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3caa1756-575f-4748-b7c8-97a5e24304c4 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.268s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:45 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-3caa1756-575f-4748-b7c8-97a5e24304c4 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:56:45 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-67c656c2-1804-48da-965a-5221b024fc17 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "cinder-601b8824-376e-4a21-b039-38e0add53b22-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:45 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-3caa1756-575f-4748-b7c8-97a5e24304c4 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Deleted volume successfully. Sep 10 16:56:45 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-3caa1756-575f-4748-b7c8-97a5e24304c4 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "cinder-bc0a5e4d-a12f-428c-b97f-ef637a070134-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:56:45 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-67c656c2-1804-48da-965a-5221b024fc17 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Acquiring lock "cinder-quobyte-601b8824-376e-4a21-b039-38e0add53b22" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:45 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-67c656c2-1804-48da-965a-5221b024fc17 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "cinder-quobyte-601b8824-376e-4a21-b039-38e0add53b22" acquired by "delete_volume" :: waited 0.018s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:45 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c724122-5431-482f-8097-b65dc40cec7f]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:56:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-67c656c2-1804-48da-965a-5221b024fc17 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-601b8824-376e-4a21-b039-38e0add53b22 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:45 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-601b8824-376e-4a21-b039-38e0add53b22 Sep 10 16:56:45 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:45 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-67c656c2-1804-48da-965a-5221b024fc17 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-601b8824-376e-4a21-b039-38e0add53b22" returned: 0 in 0.403s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-67c656c2-1804-48da-965a-5221b024fc17 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-601b8824-376e-4a21-b039-38e0add53b22 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:45 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-601b8824-376e-4a21-b039-38e0add53b22 Sep 10 16:56:45 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:46 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-67c656c2-1804-48da-965a-5221b024fc17 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-601b8824-376e-4a21-b039-38e0add53b22" returned: 0 in 0.279s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:46 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-67c656c2-1804-48da-965a-5221b024fc17 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "cinder-quobyte-601b8824-376e-4a21-b039-38e0add53b22" released by "delete_volume" :: held 0.730s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:56:46 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-67c656c2-1804-48da-965a-5221b024fc17 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Created reservations ['3b8f8799-22fd-4e69-8b43-4b39045a74ed', 'c5148a98-e9e9-4a1a-8de1-e73e8acd1932', 'f1c4fe08-9b01-4a71-bbdf-58e94361b11b', '6e5549e0-c230-44a4-b30e-83679613c2d3'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:56:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-67c656c2-1804-48da-965a-5221b024fc17 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-67c656c2-1804-48da-965a-5221b024fc17 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:46 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-67c656c2-1804-48da-965a-5221b024fc17 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:46 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-67c656c2-1804-48da-965a-5221b024fc17 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-67c656c2-1804-48da-965a-5221b024fc17 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-67c656c2-1804-48da-965a-5221b024fc17 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:46 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:56:46 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:46 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-67c656c2-1804-48da-965a-5221b024fc17 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.330s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:46 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-67c656c2-1804-48da-965a-5221b024fc17 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:56:46 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-67c656c2-1804-48da-965a-5221b024fc17 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Deleted volume successfully. Sep 10 16:56:46 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-67c656c2-1804-48da-965a-5221b024fc17 tempest-CreateVolumesFromSourceVolumeTest-1581823122 None] Lock "cinder-601b8824-376e-4a21-b039-38e0add53b22-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:56:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:56:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:49 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:56:49 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:49 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.274s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:49 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:56:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager._thread_info {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:56:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread count: 28 {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 16:56:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread info: [<_MainThread(MainThread, started 125792070905984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5c68502-51fe-4a10-898f-76ef184a42f5 tempest-VolumeDependencyTests-1579706968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b5c68502-51fe-4a10-898f-76ef184a42f5 tempest-VolumeDependencyTests-1579706968 None] Flow 'volume_create_manager' (13f6b3b5-0fd8-4fa8-94c4-6eb4fea108bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b5c68502-51fe-4a10-898f-76ef184a42f5 tempest-VolumeDependencyTests-1579706968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc08322-205c-405b-a028-6b1372e375fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b5c68502-51fe-4a10-898f-76ef184a42f5 tempest-VolumeDependencyTests-1579706968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc08322-205c-405b-a028-6b1372e375fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1388927126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49d1e027-22fa-4b1e-8e99-6bca76140109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce47b60560cd4c329ace9b9a6297d010',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:50Z,use_quota=True,user_id='586290eb517f4103b8d4270164dc3d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b5c68502-51fe-4a10-898f-76ef184a42f5 tempest-VolumeDependencyTests-1579706968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff3d1000-67e7-418f-8d5a-cf5ad278a1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b5c68502-51fe-4a10-898f-76ef184a42f5 tempest-VolumeDependencyTests-1579706968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff3d1000-67e7-418f-8d5a-cf5ad278a1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b5c68502-51fe-4a10-898f-76ef184a42f5 tempest-VolumeDependencyTests-1579706968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0e4f57-c5f0-462c-b62f-97d4db78f938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b5c68502-51fe-4a10-898f-76ef184a42f5 tempest-VolumeDependencyTests-1579706968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0e4f57-c5f0-462c-b62f-97d4db78f938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49d1e027-22fa-4b1e-8e99-6bca76140109', 'volume_name': 'volume-49d1e027-22fa-4b1e-8e99-6bca76140109', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b5c68502-51fe-4a10-898f-76ef184a42f5 tempest-VolumeDependencyTests-1579706968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03e74719-c88e-42a5-b6c3-3446ca119ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b5c68502-51fe-4a10-898f-76ef184a42f5 tempest-VolumeDependencyTests-1579706968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03e74719-c88e-42a5-b6c3-3446ca119ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b5c68502-51fe-4a10-898f-76ef184a42f5 tempest-VolumeDependencyTests-1579706968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b86dc3-77bd-42a9-8935-c90a700ea98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:50 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-b5c68502-51fe-4a10-898f-76ef184a42f5 tempest-VolumeDependencyTests-1579706968 None] Volume 49d1e027-22fa-4b1e-8e99-6bca76140109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49d1e027-22fa-4b1e-8e99-6bca76140109', 'volume_size': 1} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b5c68502-51fe-4a10-898f-76ef184a42f5 tempest-VolumeDependencyTests-1579706968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b5c68502-51fe-4a10-898f-76ef184a42f5 tempest-VolumeDependencyTests-1579706968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b5c68502-51fe-4a10-898f-76ef184a42f5 tempest-VolumeDependencyTests-1579706968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1388927126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49d1e027-22fa-4b1e-8e99-6bca76140109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce47b60560cd4c329ace9b9a6297d010',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:50Z,use_quota=True,user_id='586290eb517f4103b8d4270164dc3d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-b5c68502-51fe-4a10-898f-76ef184a42f5 tempest-VolumeDependencyTests-1579706968 None] Creating volume 49d1e027-22fa-4b1e-8e99-6bca76140109 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b5c68502-51fe-4a10-898f-76ef184a42f5 tempest-VolumeDependencyTests-1579706968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b5c68502-51fe-4a10-898f-76ef184a42f5 tempest-VolumeDependencyTests-1579706968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b5c68502-51fe-4a10-898f-76ef184a42f5 tempest-VolumeDependencyTests-1579706968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b5c68502-51fe-4a10-898f-76ef184a42f5 tempest-VolumeDependencyTests-1579706968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b5c68502-51fe-4a10-898f-76ef184a42f5 tempest-VolumeDependencyTests-1579706968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b5c68502-51fe-4a10-898f-76ef184a42f5 tempest-VolumeDependencyTests-1579706968 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:56:50 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-b5c68502-51fe-4a10-898f-76ef184a42f5 tempest-VolumeDependencyTests-1579706968 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b5c68502-51fe-4a10-898f-76ef184a42f5 tempest-VolumeDependencyTests-1579706968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:50 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109 1073741824 Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-af9c3a55-b536-48ec-a393-73d6fed73d75 tempest-CreateVolumesFromImageTest-1720852944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:56:50 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-af9c3a55-b536-48ec-a393-73d6fed73d75 tempest-CreateVolumesFromImageTest-1720852944 None] Flow 'volume_create_manager' (a000695f-a0b8-4faa-87a7-a669e411f05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-af9c3a55-b536-48ec-a393-73d6fed73d75 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16f073e2-97be-4738-ba22-b86c6ec6c417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-af9c3a55-b536-48ec-a393-73d6fed73d75 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16f073e2-97be-4738-ba22-b86c6ec6c417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-869207678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e16792e-e0bd-444a-92c7-b6d30541fae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba014bc6460f4cbe814f627d20da61eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:50Z,use_quota=True,user_id='ffc1add571f443cdb6b3483d2c12596e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-af9c3a55-b536-48ec-a393-73d6fed73d75 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b50505a-90e0-4aba-9109-4aabade49de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-af9c3a55-b536-48ec-a393-73d6fed73d75 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b50505a-90e0-4aba-9109-4aabade49de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-af9c3a55-b536-48ec-a393-73d6fed73d75 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9265b0f-4912-48bb-aaff-da61d935a229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-af9c3a55-b536-48ec-a393-73d6fed73d75 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9265b0f-4912-48bb-aaff-da61d935a229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e16792e-e0bd-444a-92c7-b6d30541fae6', 'volume_name': 'volume-3e16792e-e0bd-444a-92c7-b6d30541fae6', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-af9c3a55-b536-48ec-a393-73d6fed73d75 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (444465aa-16ab-4748-9414-2612584dbfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-af9c3a55-b536-48ec-a393-73d6fed73d75 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (444465aa-16ab-4748-9414-2612584dbfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-af9c3a55-b536-48ec-a393-73d6fed73d75 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0115ab44-efdd-4715-8213-b4492bd9ffce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:50 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-af9c3a55-b536-48ec-a393-73d6fed73d75 tempest-CreateVolumesFromImageTest-1720852944 None] Volume 3e16792e-e0bd-444a-92c7-b6d30541fae6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e16792e-e0bd-444a-92c7-b6d30541fae6', 'volume_size': 1} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-af9c3a55-b536-48ec-a393-73d6fed73d75 tempest-CreateVolumesFromImageTest-1720852944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-28da574d-c23c-4cec-abdd-956b949a10d8 tempest-CreateVolumesFromImageTest-1720852944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-28da574d-c23c-4cec-abdd-956b949a10d8 tempest-CreateVolumesFromImageTest-1720852944 None] Flow 'volume_create_manager' (2e54f2b4-59e8-41d1-b80a-23d289dcd7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-28da574d-c23c-4cec-abdd-956b949a10d8 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (271f490b-355d-4c7c-acf7-94d516c9c1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-28da574d-c23c-4cec-abdd-956b949a10d8 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (271f490b-355d-4c7c-acf7-94d516c9c1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-464140417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae4df3ea-c979-43fe-b46b-e9a20372a484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba014bc6460f4cbe814f627d20da61eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:50Z,use_quota=True,user_id='ffc1add571f443cdb6b3483d2c12596e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-28da574d-c23c-4cec-abdd-956b949a10d8 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77cd9506-8b44-4f53-8ae9-04c0127eb0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-28da574d-c23c-4cec-abdd-956b949a10d8 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77cd9506-8b44-4f53-8ae9-04c0127eb0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-28da574d-c23c-4cec-abdd-956b949a10d8 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27506908-df36-4814-bfbf-4bded1e36264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-28da574d-c23c-4cec-abdd-956b949a10d8 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27506908-df36-4814-bfbf-4bded1e36264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae4df3ea-c979-43fe-b46b-e9a20372a484', 'volume_name': 'volume-ae4df3ea-c979-43fe-b46b-e9a20372a484', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-28da574d-c23c-4cec-abdd-956b949a10d8 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (523ba7ca-657b-44af-ad57-eb5bc3eaa3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-28da574d-c23c-4cec-abdd-956b949a10d8 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (523ba7ca-657b-44af-ad57-eb5bc3eaa3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-28da574d-c23c-4cec-abdd-956b949a10d8 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cac7400-5460-40fd-9285-3f9aafcb22f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:50 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-28da574d-c23c-4cec-abdd-956b949a10d8 tempest-CreateVolumesFromImageTest-1720852944 None] Volume ae4df3ea-c979-43fe-b46b-e9a20372a484: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae4df3ea-c979-43fe-b46b-e9a20372a484', 'volume_size': 1} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-28da574d-c23c-4cec-abdd-956b949a10d8 tempest-CreateVolumesFromImageTest-1720852944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-0263e8e7-ba3b-4626-9dc4-5a19f99c3dc8 tempest-CreateVolumesFromImageTest-1720852944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0263e8e7-ba3b-4626-9dc4-5a19f99c3dc8 tempest-CreateVolumesFromImageTest-1720852944 None] Flow 'volume_create_manager' (c65504a2-c5fb-4095-99fc-76a83b4c955a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0263e8e7-ba3b-4626-9dc4-5a19f99c3dc8 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1497088c-4539-445d-b799-022a1cfccb1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0263e8e7-ba3b-4626-9dc4-5a19f99c3dc8 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1497088c-4539-445d-b799-022a1cfccb1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-327857029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f842ad-ec90-4a93-9602-b2cb6772b09e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba014bc6460f4cbe814f627d20da61eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:51Z,use_quota=True,user_id='ffc1add571f443cdb6b3483d2c12596e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0263e8e7-ba3b-4626-9dc4-5a19f99c3dc8 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (283acbcc-49fd-40a2-b096-08b1288428cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0263e8e7-ba3b-4626-9dc4-5a19f99c3dc8 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (283acbcc-49fd-40a2-b096-08b1288428cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0263e8e7-ba3b-4626-9dc4-5a19f99c3dc8 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85f85015-cf1f-40ab-8280-80a79a31ad21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0263e8e7-ba3b-4626-9dc4-5a19f99c3dc8 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85f85015-cf1f-40ab-8280-80a79a31ad21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87f842ad-ec90-4a93-9602-b2cb6772b09e', 'volume_name': 'volume-87f842ad-ec90-4a93-9602-b2cb6772b09e', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0263e8e7-ba3b-4626-9dc4-5a19f99c3dc8 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313a6188-ac24-4a6c-a6da-19ad3a7c6ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0263e8e7-ba3b-4626-9dc4-5a19f99c3dc8 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313a6188-ac24-4a6c-a6da-19ad3a7c6ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0263e8e7-ba3b-4626-9dc4-5a19f99c3dc8 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc55ae2-0e6e-44ab-bbae-b7a8433e4a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:50 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-0263e8e7-ba3b-4626-9dc4-5a19f99c3dc8 tempest-CreateVolumesFromImageTest-1720852944 None] Volume 87f842ad-ec90-4a93-9602-b2cb6772b09e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87f842ad-ec90-4a93-9602-b2cb6772b09e', 'volume_size': 1} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0263e8e7-ba3b-4626-9dc4-5a19f99c3dc8 tempest-CreateVolumesFromImageTest-1720852944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:50 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b5c68502-51fe-4a10-898f-76ef184a42f5 tempest-VolumeDependencyTests-1579706968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109 1073741824" returned: 0 in 0.525s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b5c68502-51fe-4a10-898f-76ef184a42f5 tempest-VolumeDependencyTests-1579706968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:50 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109 Sep 10 16:56:50 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eacf0cb-a7f2-4e98-b3da-493d5c02a2d0 tempest-CreateVolumesFromImageTest-1720852944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0eacf0cb-a7f2-4e98-b3da-493d5c02a2d0 tempest-CreateVolumesFromImageTest-1720852944 None] Flow 'volume_create_manager' (8057ded6-018f-44ef-80d5-86fbce05ea29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0eacf0cb-a7f2-4e98-b3da-493d5c02a2d0 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5086ac2c-5eb9-4778-98be-705f5e4dcc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:51 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0eacf0cb-a7f2-4e98-b3da-493d5c02a2d0 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5086ac2c-5eb9-4778-98be-705f5e4dcc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1720519946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d381d8da-8ab2-45f9-a6b1-a449f0224d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba014bc6460f4cbe814f627d20da61eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:51Z,use_quota=True,user_id='ffc1add571f443cdb6b3483d2c12596e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0eacf0cb-a7f2-4e98-b3da-493d5c02a2d0 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5777ad40-ea8f-4791-8756-13df0edda87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0eacf0cb-a7f2-4e98-b3da-493d5c02a2d0 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5777ad40-ea8f-4791-8756-13df0edda87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0eacf0cb-a7f2-4e98-b3da-493d5c02a2d0 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3265c6d-0f9d-4d42-aa01-4cb653c443a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0eacf0cb-a7f2-4e98-b3da-493d5c02a2d0 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3265c6d-0f9d-4d42-aa01-4cb653c443a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd381d8da-8ab2-45f9-a6b1-a449f0224d40', 'volume_name': 'volume-d381d8da-8ab2-45f9-a6b1-a449f0224d40', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0eacf0cb-a7f2-4e98-b3da-493d5c02a2d0 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c1392f8-f3c1-4d03-8d42-4f6a15dfa97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0eacf0cb-a7f2-4e98-b3da-493d5c02a2d0 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c1392f8-f3c1-4d03-8d42-4f6a15dfa97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0eacf0cb-a7f2-4e98-b3da-493d5c02a2d0 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810c8666-1e2d-4c74-b429-9de674df6bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:51 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-0eacf0cb-a7f2-4e98-b3da-493d5c02a2d0 tempest-CreateVolumesFromImageTest-1720852944 None] Volume d381d8da-8ab2-45f9-a6b1-a449f0224d40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d381d8da-8ab2-45f9-a6b1-a449f0224d40', 'volume_size': 1} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0eacf0cb-a7f2-4e98-b3da-493d5c02a2d0 tempest-CreateVolumesFromImageTest-1720852944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b5c68502-51fe-4a10-898f-76ef184a42f5 tempest-VolumeDependencyTests-1579706968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109" returned: 0 in 0.327s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b5c68502-51fe-4a10-898f-76ef184a42f5 tempest-VolumeDependencyTests-1579706968 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b5c68502-51fe-4a10-898f-76ef184a42f5 tempest-VolumeDependencyTests-1579706968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-af9c3a55-b536-48ec-a393-73d6fed73d75 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.750s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-af9c3a55-b536-48ec-a393-73d6fed73d75 tempest-CreateVolumesFromImageTest-1720852944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-869207678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e16792e-e0bd-444a-92c7-b6d30541fae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba014bc6460f4cbe814f627d20da61eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:50Z,use_quota=True,user_id='ffc1add571f443cdb6b3483d2c12596e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-af9c3a55-b536-48ec-a393-73d6fed73d75 tempest-CreateVolumesFromImageTest-1720852944 None] Creating volume 3e16792e-e0bd-444a-92c7-b6d30541fae6 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-af9c3a55-b536-48ec-a393-73d6fed73d75 tempest-CreateVolumesFromImageTest-1720852944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-af9c3a55-b536-48ec-a393-73d6fed73d75 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-af9c3a55-b536-48ec-a393-73d6fed73d75 tempest-CreateVolumesFromImageTest-1720852944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-af9c3a55-b536-48ec-a393-73d6fed73d75 tempest-CreateVolumesFromImageTest-1720852944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-af9c3a55-b536-48ec-a393-73d6fed73d75 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-af9c3a55-b536-48ec-a393-73d6fed73d75 tempest-CreateVolumesFromImageTest-1720852944 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:56:51 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-af9c3a55-b536-48ec-a393-73d6fed73d75 tempest-CreateVolumesFromImageTest-1720852944 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-af9c3a55-b536-48ec-a393-73d6fed73d75 tempest-CreateVolumesFromImageTest-1720852944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3e16792e-e0bd-444a-92c7-b6d30541fae6 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b5c68502-51fe-4a10-898f-76ef184a42f5 tempest-VolumeDependencyTests-1579706968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b86dc3-77bd-42a9-8935-c90a700ea98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49d1e027-22fa-4b1e-8e99-6bca76140109', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b5c68502-51fe-4a10-898f-76ef184a42f5 tempest-VolumeDependencyTests-1579706968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e782a2c7-63cd-4a15-9417-d725ae435690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:51 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3e16792e-e0bd-444a-92c7-b6d30541fae6 1073741824 Sep 10 16:56:51 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:51 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-b5c68502-51fe-4a10-898f-76ef184a42f5 tempest-VolumeDependencyTests-1579706968 None] Volume volume-49d1e027-22fa-4b1e-8e99-6bca76140109 (49d1e027-22fa-4b1e-8e99-6bca76140109): created successfully Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b5c68502-51fe-4a10-898f-76ef184a42f5 tempest-VolumeDependencyTests-1579706968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e782a2c7-63cd-4a15-9417-d725ae435690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b5c68502-51fe-4a10-898f-76ef184a42f5 tempest-VolumeDependencyTests-1579706968 None] Flow 'volume_create_manager' (13f6b3b5-0fd8-4fa8-94c4-6eb4fea108bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:51 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-b5c68502-51fe-4a10-898f-76ef184a42f5 tempest-VolumeDependencyTests-1579706968 None] Created volume successfully. Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-d296e9cb-a288-403c-8cd8-7eb337dcf9e6 tempest-CreateVolumesFromImageTest-1720852944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d296e9cb-a288-403c-8cd8-7eb337dcf9e6 tempest-CreateVolumesFromImageTest-1720852944 None] Flow 'volume_create_manager' (2bb072c8-b051-4464-91c3-2f02d9995482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d296e9cb-a288-403c-8cd8-7eb337dcf9e6 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab9a308-b6df-4ab1-bd46-6b1fcb59db09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d296e9cb-a288-403c-8cd8-7eb337dcf9e6 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab9a308-b6df-4ab1-bd46-6b1fcb59db09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1050549453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=675d3223-5caf-49e9-847f-1a0f791ed299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba014bc6460f4cbe814f627d20da61eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:51Z,use_quota=True,user_id='ffc1add571f443cdb6b3483d2c12596e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d296e9cb-a288-403c-8cd8-7eb337dcf9e6 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c464ef6-7889-4fd4-9b66-cb85103cb2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d296e9cb-a288-403c-8cd8-7eb337dcf9e6 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c464ef6-7889-4fd4-9b66-cb85103cb2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d296e9cb-a288-403c-8cd8-7eb337dcf9e6 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76a91d9e-3c31-4fe5-8108-9310a1fde2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d296e9cb-a288-403c-8cd8-7eb337dcf9e6 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76a91d9e-3c31-4fe5-8108-9310a1fde2fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '675d3223-5caf-49e9-847f-1a0f791ed299', 'volume_name': 'volume-675d3223-5caf-49e9-847f-1a0f791ed299', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d296e9cb-a288-403c-8cd8-7eb337dcf9e6 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b744e87-db7f-4b3f-aa16-bf99a9f8645e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d296e9cb-a288-403c-8cd8-7eb337dcf9e6 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b744e87-db7f-4b3f-aa16-bf99a9f8645e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d296e9cb-a288-403c-8cd8-7eb337dcf9e6 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b8d5fdd-4e9b-4b1b-a97d-32ac1ed2240a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:51 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-d296e9cb-a288-403c-8cd8-7eb337dcf9e6 tempest-CreateVolumesFromImageTest-1720852944 None] Volume 675d3223-5caf-49e9-847f-1a0f791ed299: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-675d3223-5caf-49e9-847f-1a0f791ed299', 'volume_size': 1} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d296e9cb-a288-403c-8cd8-7eb337dcf9e6 tempest-CreateVolumesFromImageTest-1720852944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:51 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-af9c3a55-b536-48ec-a393-73d6fed73d75 tempest-CreateVolumesFromImageTest-1720852944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3e16792e-e0bd-444a-92c7-b6d30541fae6 1073741824" returned: 0 in 0.424s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-af9c3a55-b536-48ec-a393-73d6fed73d75 tempest-CreateVolumesFromImageTest-1720852944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3e16792e-e0bd-444a-92c7-b6d30541fae6 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:51 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3e16792e-e0bd-444a-92c7-b6d30541fae6 Sep 10 16:56:51 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:51 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-af9c3a55-b536-48ec-a393-73d6fed73d75 tempest-CreateVolumesFromImageTest-1720852944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3e16792e-e0bd-444a-92c7-b6d30541fae6" returned: 0 in 0.237s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-af9c3a55-b536-48ec-a393-73d6fed73d75 tempest-CreateVolumesFromImageTest-1720852944 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-af9c3a55-b536-48ec-a393-73d6fed73d75 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-28da574d-c23c-4cec-abdd-956b949a10d8 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.317s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-28da574d-c23c-4cec-abdd-956b949a10d8 tempest-CreateVolumesFromImageTest-1720852944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-464140417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae4df3ea-c979-43fe-b46b-e9a20372a484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba014bc6460f4cbe814f627d20da61eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:50Z,use_quota=True,user_id='ffc1add571f443cdb6b3483d2c12596e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-28da574d-c23c-4cec-abdd-956b949a10d8 tempest-CreateVolumesFromImageTest-1720852944 None] Creating volume ae4df3ea-c979-43fe-b46b-e9a20372a484 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-28da574d-c23c-4cec-abdd-956b949a10d8 tempest-CreateVolumesFromImageTest-1720852944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-28da574d-c23c-4cec-abdd-956b949a10d8 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-28da574d-c23c-4cec-abdd-956b949a10d8 tempest-CreateVolumesFromImageTest-1720852944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-28da574d-c23c-4cec-abdd-956b949a10d8 tempest-CreateVolumesFromImageTest-1720852944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-28da574d-c23c-4cec-abdd-956b949a10d8 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-28da574d-c23c-4cec-abdd-956b949a10d8 tempest-CreateVolumesFromImageTest-1720852944 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:56:51 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-28da574d-c23c-4cec-abdd-956b949a10d8 tempest-CreateVolumesFromImageTest-1720852944 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-28da574d-c23c-4cec-abdd-956b949a10d8 tempest-CreateVolumesFromImageTest-1720852944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ae4df3ea-c979-43fe-b46b-e9a20372a484 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-af9c3a55-b536-48ec-a393-73d6fed73d75 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0115ab44-efdd-4715-8213-b4492bd9ffce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e16792e-e0bd-444a-92c7-b6d30541fae6', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-af9c3a55-b536-48ec-a393-73d6fed73d75 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (200976fb-c8dd-4da7-a743-dcade268f1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:52 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ae4df3ea-c979-43fe-b46b-e9a20372a484 1073741824 Sep 10 16:56:52 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:52 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-af9c3a55-b536-48ec-a393-73d6fed73d75 tempest-CreateVolumesFromImageTest-1720852944 None] Volume volume-3e16792e-e0bd-444a-92c7-b6d30541fae6 (3e16792e-e0bd-444a-92c7-b6d30541fae6): created successfully Sep 10 16:56:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-af9c3a55-b536-48ec-a393-73d6fed73d75 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (200976fb-c8dd-4da7-a743-dcade268f1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-af9c3a55-b536-48ec-a393-73d6fed73d75 tempest-CreateVolumesFromImageTest-1720852944 None] Flow 'volume_create_manager' (a000695f-a0b8-4faa-87a7-a669e411f05b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:52 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-af9c3a55-b536-48ec-a393-73d6fed73d75 tempest-CreateVolumesFromImageTest-1720852944 None] Created volume successfully. Sep 10 16:56:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-64fddd62-3273-452c-bd9c-58e1deb241db tempest-VolumeDependencyTests-1579706968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:52 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-28da574d-c23c-4cec-abdd-956b949a10d8 tempest-CreateVolumesFromImageTest-1720852944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ae4df3ea-c979-43fe-b46b-e9a20372a484 1073741824" returned: 0 in 0.469s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-28da574d-c23c-4cec-abdd-956b949a10d8 tempest-CreateVolumesFromImageTest-1720852944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ae4df3ea-c979-43fe-b46b-e9a20372a484 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:52 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ae4df3ea-c979-43fe-b46b-e9a20372a484 Sep 10 16:56:52 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:52 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-28da574d-c23c-4cec-abdd-956b949a10d8 tempest-CreateVolumesFromImageTest-1720852944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ae4df3ea-c979-43fe-b46b-e9a20372a484" returned: 0 in 0.265s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:52 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-28da574d-c23c-4cec-abdd-956b949a10d8 tempest-CreateVolumesFromImageTest-1720852944 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:56:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-28da574d-c23c-4cec-abdd-956b949a10d8 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0263e8e7-ba3b-4626-9dc4-5a19f99c3dc8 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.888s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:52 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0263e8e7-ba3b-4626-9dc4-5a19f99c3dc8 tempest-CreateVolumesFromImageTest-1720852944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-327857029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f842ad-ec90-4a93-9602-b2cb6772b09e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba014bc6460f4cbe814f627d20da61eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:51Z,use_quota=True,user_id='ffc1add571f443cdb6b3483d2c12596e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:56:52 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-0263e8e7-ba3b-4626-9dc4-5a19f99c3dc8 tempest-CreateVolumesFromImageTest-1720852944 None] Creating volume 87f842ad-ec90-4a93-9602-b2cb6772b09e {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:56:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0263e8e7-ba3b-4626-9dc4-5a19f99c3dc8 tempest-CreateVolumesFromImageTest-1720852944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0263e8e7-ba3b-4626-9dc4-5a19f99c3dc8 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:52 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0263e8e7-ba3b-4626-9dc4-5a19f99c3dc8 tempest-CreateVolumesFromImageTest-1720852944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:52 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0263e8e7-ba3b-4626-9dc4-5a19f99c3dc8 tempest-CreateVolumesFromImageTest-1720852944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0263e8e7-ba3b-4626-9dc4-5a19f99c3dc8 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:52 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0263e8e7-ba3b-4626-9dc4-5a19f99c3dc8 tempest-CreateVolumesFromImageTest-1720852944 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:56:52 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-0263e8e7-ba3b-4626-9dc4-5a19f99c3dc8 tempest-CreateVolumesFromImageTest-1720852944 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:56:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0263e8e7-ba3b-4626-9dc4-5a19f99c3dc8 tempest-CreateVolumesFromImageTest-1720852944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-87f842ad-ec90-4a93-9602-b2cb6772b09e 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:52 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-87f842ad-ec90-4a93-9602-b2cb6772b09e 1073741824 Sep 10 16:56:52 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-28da574d-c23c-4cec-abdd-956b949a10d8 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cac7400-5460-40fd-9285-3f9aafcb22f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae4df3ea-c979-43fe-b46b-e9a20372a484', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-28da574d-c23c-4cec-abdd-956b949a10d8 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdedf995-8b1c-4b47-84ea-c4b877ed6281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:52 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-28da574d-c23c-4cec-abdd-956b949a10d8 tempest-CreateVolumesFromImageTest-1720852944 None] Volume volume-ae4df3ea-c979-43fe-b46b-e9a20372a484 (ae4df3ea-c979-43fe-b46b-e9a20372a484): created successfully Sep 10 16:56:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-28da574d-c23c-4cec-abdd-956b949a10d8 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdedf995-8b1c-4b47-84ea-c4b877ed6281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-28da574d-c23c-4cec-abdd-956b949a10d8 tempest-CreateVolumesFromImageTest-1720852944 None] Flow 'volume_create_manager' (2e54f2b4-59e8-41d1-b80a-23d289dcd7cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:52 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-28da574d-c23c-4cec-abdd-956b949a10d8 tempest-CreateVolumesFromImageTest-1720852944 None] Created volume successfully. Sep 10 16:56:53 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0263e8e7-ba3b-4626-9dc4-5a19f99c3dc8 tempest-CreateVolumesFromImageTest-1720852944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-87f842ad-ec90-4a93-9602-b2cb6772b09e 1073741824" returned: 0 in 0.406s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0263e8e7-ba3b-4626-9dc4-5a19f99c3dc8 tempest-CreateVolumesFromImageTest-1720852944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-87f842ad-ec90-4a93-9602-b2cb6772b09e {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:53 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-87f842ad-ec90-4a93-9602-b2cb6772b09e Sep 10 16:56:53 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:53 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0263e8e7-ba3b-4626-9dc4-5a19f99c3dc8 tempest-CreateVolumesFromImageTest-1720852944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-87f842ad-ec90-4a93-9602-b2cb6772b09e" returned: 0 in 0.264s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:53 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0263e8e7-ba3b-4626-9dc4-5a19f99c3dc8 tempest-CreateVolumesFromImageTest-1720852944 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:56:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0263e8e7-ba3b-4626-9dc4-5a19f99c3dc8 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0eacf0cb-a7f2-4e98-b3da-493d5c02a2d0 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.208s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:53 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0eacf0cb-a7f2-4e98-b3da-493d5c02a2d0 tempest-CreateVolumesFromImageTest-1720852944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1720519946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d381d8da-8ab2-45f9-a6b1-a449f0224d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba014bc6460f4cbe814f627d20da61eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:51Z,use_quota=True,user_id='ffc1add571f443cdb6b3483d2c12596e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:56:53 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-0eacf0cb-a7f2-4e98-b3da-493d5c02a2d0 tempest-CreateVolumesFromImageTest-1720852944 None] Creating volume d381d8da-8ab2-45f9-a6b1-a449f0224d40 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:56:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0eacf0cb-a7f2-4e98-b3da-493d5c02a2d0 tempest-CreateVolumesFromImageTest-1720852944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0eacf0cb-a7f2-4e98-b3da-493d5c02a2d0 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:53 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0eacf0cb-a7f2-4e98-b3da-493d5c02a2d0 tempest-CreateVolumesFromImageTest-1720852944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:53 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0eacf0cb-a7f2-4e98-b3da-493d5c02a2d0 tempest-CreateVolumesFromImageTest-1720852944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0eacf0cb-a7f2-4e98-b3da-493d5c02a2d0 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:53 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0eacf0cb-a7f2-4e98-b3da-493d5c02a2d0 tempest-CreateVolumesFromImageTest-1720852944 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:56:53 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-0eacf0cb-a7f2-4e98-b3da-493d5c02a2d0 tempest-CreateVolumesFromImageTest-1720852944 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:56:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0eacf0cb-a7f2-4e98-b3da-493d5c02a2d0 tempest-CreateVolumesFromImageTest-1720852944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d381d8da-8ab2-45f9-a6b1-a449f0224d40 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0263e8e7-ba3b-4626-9dc4-5a19f99c3dc8 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc55ae2-0e6e-44ab-bbae-b7a8433e4a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87f842ad-ec90-4a93-9602-b2cb6772b09e', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:53 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d381d8da-8ab2-45f9-a6b1-a449f0224d40 1073741824 Sep 10 16:56:53 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0263e8e7-ba3b-4626-9dc4-5a19f99c3dc8 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41cdb3ba-fc5d-4f96-82b8-e782d1efee3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:53 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-0263e8e7-ba3b-4626-9dc4-5a19f99c3dc8 tempest-CreateVolumesFromImageTest-1720852944 None] Volume volume-87f842ad-ec90-4a93-9602-b2cb6772b09e (87f842ad-ec90-4a93-9602-b2cb6772b09e): created successfully Sep 10 16:56:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0263e8e7-ba3b-4626-9dc4-5a19f99c3dc8 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41cdb3ba-fc5d-4f96-82b8-e782d1efee3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0263e8e7-ba3b-4626-9dc4-5a19f99c3dc8 tempest-CreateVolumesFromImageTest-1720852944 None] Flow 'volume_create_manager' (c65504a2-c5fb-4095-99fc-76a83b4c955a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:53 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-0263e8e7-ba3b-4626-9dc4-5a19f99c3dc8 tempest-CreateVolumesFromImageTest-1720852944 None] Created volume successfully. Sep 10 16:56:53 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0eacf0cb-a7f2-4e98-b3da-493d5c02a2d0 tempest-CreateVolumesFromImageTest-1720852944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d381d8da-8ab2-45f9-a6b1-a449f0224d40 1073741824" returned: 0 in 0.416s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0eacf0cb-a7f2-4e98-b3da-493d5c02a2d0 tempest-CreateVolumesFromImageTest-1720852944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d381d8da-8ab2-45f9-a6b1-a449f0224d40 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:53 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d381d8da-8ab2-45f9-a6b1-a449f0224d40 Sep 10 16:56:53 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:54 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0eacf0cb-a7f2-4e98-b3da-493d5c02a2d0 tempest-CreateVolumesFromImageTest-1720852944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d381d8da-8ab2-45f9-a6b1-a449f0224d40" returned: 0 in 0.240s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:54 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-0eacf0cb-a7f2-4e98-b3da-493d5c02a2d0 tempest-CreateVolumesFromImageTest-1720852944 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:56:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0eacf0cb-a7f2-4e98-b3da-493d5c02a2d0 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d296e9cb-a288-403c-8cd8-7eb337dcf9e6 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.551s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:54 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d296e9cb-a288-403c-8cd8-7eb337dcf9e6 tempest-CreateVolumesFromImageTest-1720852944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1050549453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=675d3223-5caf-49e9-847f-1a0f791ed299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba014bc6460f4cbe814f627d20da61eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:51Z,use_quota=True,user_id='ffc1add571f443cdb6b3483d2c12596e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:56:54 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-d296e9cb-a288-403c-8cd8-7eb337dcf9e6 tempest-CreateVolumesFromImageTest-1720852944 None] Creating volume 675d3223-5caf-49e9-847f-1a0f791ed299 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:56:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d296e9cb-a288-403c-8cd8-7eb337dcf9e6 tempest-CreateVolumesFromImageTest-1720852944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d296e9cb-a288-403c-8cd8-7eb337dcf9e6 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:54 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d296e9cb-a288-403c-8cd8-7eb337dcf9e6 tempest-CreateVolumesFromImageTest-1720852944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:54 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d296e9cb-a288-403c-8cd8-7eb337dcf9e6 tempest-CreateVolumesFromImageTest-1720852944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d296e9cb-a288-403c-8cd8-7eb337dcf9e6 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:54 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d296e9cb-a288-403c-8cd8-7eb337dcf9e6 tempest-CreateVolumesFromImageTest-1720852944 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:56:54 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-d296e9cb-a288-403c-8cd8-7eb337dcf9e6 tempest-CreateVolumesFromImageTest-1720852944 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:56:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d296e9cb-a288-403c-8cd8-7eb337dcf9e6 tempest-CreateVolumesFromImageTest-1720852944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-675d3223-5caf-49e9-847f-1a0f791ed299 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:54 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0eacf0cb-a7f2-4e98-b3da-493d5c02a2d0 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810c8666-1e2d-4c74-b429-9de674df6bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d381d8da-8ab2-45f9-a6b1-a449f0224d40', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:54 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-675d3223-5caf-49e9-847f-1a0f791ed299 1073741824 Sep 10 16:56:54 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:54 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0eacf0cb-a7f2-4e98-b3da-493d5c02a2d0 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bd2d3ce-d999-4ac7-9a29-5ca0fc20ba37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:54 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-0eacf0cb-a7f2-4e98-b3da-493d5c02a2d0 tempest-CreateVolumesFromImageTest-1720852944 None] Volume volume-d381d8da-8ab2-45f9-a6b1-a449f0224d40 (d381d8da-8ab2-45f9-a6b1-a449f0224d40): created successfully Sep 10 16:56:54 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0eacf0cb-a7f2-4e98-b3da-493d5c02a2d0 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bd2d3ce-d999-4ac7-9a29-5ca0fc20ba37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:54 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-0eacf0cb-a7f2-4e98-b3da-493d5c02a2d0 tempest-CreateVolumesFromImageTest-1720852944 None] Flow 'volume_create_manager' (8057ded6-018f-44ef-80d5-86fbce05ea29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:54 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-0eacf0cb-a7f2-4e98-b3da-493d5c02a2d0 tempest-CreateVolumesFromImageTest-1720852944 None] Created volume successfully. Sep 10 16:56:54 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d296e9cb-a288-403c-8cd8-7eb337dcf9e6 tempest-CreateVolumesFromImageTest-1720852944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-675d3223-5caf-49e9-847f-1a0f791ed299 1073741824" returned: 0 in 0.422s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d296e9cb-a288-403c-8cd8-7eb337dcf9e6 tempest-CreateVolumesFromImageTest-1720852944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-675d3223-5caf-49e9-847f-1a0f791ed299 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:54 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-675d3223-5caf-49e9-847f-1a0f791ed299 Sep 10 16:56:54 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:54 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d296e9cb-a288-403c-8cd8-7eb337dcf9e6 tempest-CreateVolumesFromImageTest-1720852944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-675d3223-5caf-49e9-847f-1a0f791ed299" returned: 0 in 0.244s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:54 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d296e9cb-a288-403c-8cd8-7eb337dcf9e6 tempest-CreateVolumesFromImageTest-1720852944 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:56:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d296e9cb-a288-403c-8cd8-7eb337dcf9e6 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-64fddd62-3273-452c-bd9c-58e1deb241db tempest-VolumeDependencyTests-1579706968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.616s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:54 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d296e9cb-a288-403c-8cd8-7eb337dcf9e6 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b8d5fdd-4e9b-4b1b-a97d-32ac1ed2240a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-675d3223-5caf-49e9-847f-1a0f791ed299', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:54 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d296e9cb-a288-403c-8cd8-7eb337dcf9e6 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86716329-377f-4837-a0c6-bf8338cc5cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:54 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-64fddd62-3273-452c-bd9c-58e1deb241db tempest-VolumeDependencyTests-1579706968 None] Creating offline snapshot 3555c650-f9d8-4bcd-b47a-d07d47c9acf3 of volume 49d1e027-22fa-4b1e-8e99-6bca76140109 {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:56:54 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-d296e9cb-a288-403c-8cd8-7eb337dcf9e6 tempest-CreateVolumesFromImageTest-1720852944 None] Volume volume-675d3223-5caf-49e9-847f-1a0f791ed299 (675d3223-5caf-49e9-847f-1a0f791ed299): created successfully Sep 10 16:56:54 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d296e9cb-a288-403c-8cd8-7eb337dcf9e6 tempest-CreateVolumesFromImageTest-1720852944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86716329-377f-4837-a0c6-bf8338cc5cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:54 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d296e9cb-a288-403c-8cd8-7eb337dcf9e6 tempest-CreateVolumesFromImageTest-1720852944 None] Flow 'volume_create_manager' (2bb072c8-b051-4464-91c3-2f02d9995482) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:54 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[35878c76-82e6-4255-8f47-70182a072f9c]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:56:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-64fddd62-3273-452c-bd9c-58e1deb241db tempest-VolumeDependencyTests-1579706968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:54 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-d296e9cb-a288-403c-8cd8-7eb337dcf9e6 tempest-CreateVolumesFromImageTest-1720852944 None] Created volume successfully. Sep 10 16:56:55 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109 Sep 10 16:56:55 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:55 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-64fddd62-3273-452c-bd9c-58e1deb241db tempest-VolumeDependencyTests-1579706968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109" returned: 0 in 0.364s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-64fddd62-3273-452c-bd9c-58e1deb241db tempest-VolumeDependencyTests-1579706968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109.3555c650-f9d8-4bcd-b47a-d07d47c9acf3 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:55 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109.3555c650-f9d8-4bcd-b47a-d07d47c9acf3 1G Sep 10 16:56:55 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:55 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-64fddd62-3273-452c-bd9c-58e1deb241db tempest-VolumeDependencyTests-1579706968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109.3555c650-f9d8-4bcd-b47a-d07d47c9acf3 1G" returned: 0 in 0.379s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-64fddd62-3273-452c-bd9c-58e1deb241db tempest-VolumeDependencyTests-1579706968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49d1e027-22fa-4b1e-8e99-6bca76140109 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109.3555c650-f9d8-4bcd-b47a-d07d47c9acf3 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:55 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49d1e027-22fa-4b1e-8e99-6bca76140109 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109.3555c650-f9d8-4bcd-b47a-d07d47c9acf3 Sep 10 16:56:55 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:55 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6cbd8915-99f1-40d9-9501-d40e8b94b3da tempest-CreateVolumesFromImageTest-1720852944 None] Acquiring lock "cinder-675d3223-5caf-49e9-847f-1a0f791ed299-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:55 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-64fddd62-3273-452c-bd9c-58e1deb241db tempest-VolumeDependencyTests-1579706968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49d1e027-22fa-4b1e-8e99-6bca76140109 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109.3555c650-f9d8-4bcd-b47a-d07d47c9acf3" returned: 0 in 0.302s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:55 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-64fddd62-3273-452c-bd9c-58e1deb241db tempest-VolumeDependencyTests-1579706968 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109.3555c650-f9d8-4bcd-b47a-d07d47c9acf3 is being set with open permissions: ugo+rw Sep 10 16:56:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-64fddd62-3273-452c-bd9c-58e1deb241db tempest-VolumeDependencyTests-1579706968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109.3555c650-f9d8-4bcd-b47a-d07d47c9acf3 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:55 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6cbd8915-99f1-40d9-9501-d40e8b94b3da tempest-CreateVolumesFromImageTest-1720852944 None] Lock "cinder-675d3223-5caf-49e9-847f-1a0f791ed299-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:56 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109.3555c650-f9d8-4bcd-b47a-d07d47c9acf3 Sep 10 16:56:56 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:56 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6cbd8915-99f1-40d9-9501-d40e8b94b3da tempest-CreateVolumesFromImageTest-1720852944 None] Acquiring lock "cinder-quobyte-675d3223-5caf-49e9-847f-1a0f791ed299" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:56 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6cbd8915-99f1-40d9-9501-d40e8b94b3da tempest-CreateVolumesFromImageTest-1720852944 None] Lock "cinder-quobyte-675d3223-5caf-49e9-847f-1a0f791ed299" acquired by "delete_volume" :: waited 0.019s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:56 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[54402aed-270e-432d-9bd3-b7fbfaaf6ccf]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:56:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6cbd8915-99f1-40d9-9501-d40e8b94b3da tempest-CreateVolumesFromImageTest-1720852944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-675d3223-5caf-49e9-847f-1a0f791ed299 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:56 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-675d3223-5caf-49e9-847f-1a0f791ed299 Sep 10 16:56:56 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:56 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-64fddd62-3273-452c-bd9c-58e1deb241db tempest-VolumeDependencyTests-1579706968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109.3555c650-f9d8-4bcd-b47a-d07d47c9acf3" returned: 0 in 0.260s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-64fddd62-3273-452c-bd9c-58e1deb241db tempest-VolumeDependencyTests-1579706968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:56 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109.info Sep 10 16:56:56 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:56 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6cbd8915-99f1-40d9-9501-d40e8b94b3da tempest-CreateVolumesFromImageTest-1720852944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-675d3223-5caf-49e9-847f-1a0f791ed299" returned: 0 in 0.363s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6cbd8915-99f1-40d9-9501-d40e8b94b3da tempest-CreateVolumesFromImageTest-1720852944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-675d3223-5caf-49e9-847f-1a0f791ed299 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:56 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-675d3223-5caf-49e9-847f-1a0f791ed299 Sep 10 16:56:56 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:56 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-64fddd62-3273-452c-bd9c-58e1deb241db tempest-VolumeDependencyTests-1579706968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109.info" returned: 0 in 0.268s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:56 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-64fddd62-3273-452c-bd9c-58e1deb241db tempest-VolumeDependencyTests-1579706968 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109.info is being set with open permissions: ugo+rw Sep 10 16:56:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-64fddd62-3273-452c-bd9c-58e1deb241db tempest-VolumeDependencyTests-1579706968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:56 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109.info Sep 10 16:56:56 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:56 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6cbd8915-99f1-40d9-9501-d40e8b94b3da tempest-CreateVolumesFromImageTest-1720852944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-675d3223-5caf-49e9-847f-1a0f791ed299" returned: 0 in 0.261s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:56 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6cbd8915-99f1-40d9-9501-d40e8b94b3da tempest-CreateVolumesFromImageTest-1720852944 None] Lock "cinder-quobyte-675d3223-5caf-49e9-847f-1a0f791ed299" released by "delete_volume" :: held 0.666s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:56:56 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-6cbd8915-99f1-40d9-9501-d40e8b94b3da tempest-CreateVolumesFromImageTest-1720852944 None] Created reservations ['f1927254-1800-47e3-8f5e-d821287d879e', 'c5079641-fcf6-49a8-8c09-738cb700cade', 'ad323aa4-35a4-4eba-b6fc-985adc3460b8', '21455773-2c40-42c1-bb11-b2b5ac78ab3d'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:56:56 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-64fddd62-3273-452c-bd9c-58e1deb241db tempest-VolumeDependencyTests-1579706968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109.info" returned: 0 in 0.249s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-64fddd62-3273-452c-bd9c-58e1deb241db tempest-VolumeDependencyTests-1579706968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.947s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:56 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-64fddd62-3273-452c-bd9c-58e1deb241db tempest-VolumeDependencyTests-1579706968 None] Create snapshot completed successfully Sep 10 16:56:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6cbd8915-99f1-40d9-9501-d40e8b94b3da tempest-CreateVolumesFromImageTest-1720852944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6cbd8915-99f1-40d9-9501-d40e8b94b3da tempest-CreateVolumesFromImageTest-1720852944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:56 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6cbd8915-99f1-40d9-9501-d40e8b94b3da tempest-CreateVolumesFromImageTest-1720852944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:56 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6cbd8915-99f1-40d9-9501-d40e8b94b3da tempest-CreateVolumesFromImageTest-1720852944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6cbd8915-99f1-40d9-9501-d40e8b94b3da tempest-CreateVolumesFromImageTest-1720852944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6cbd8915-99f1-40d9-9501-d40e8b94b3da tempest-CreateVolumesFromImageTest-1720852944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:56 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:56:56 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:57 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6cbd8915-99f1-40d9-9501-d40e8b94b3da tempest-CreateVolumesFromImageTest-1720852944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.252s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:57 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-6cbd8915-99f1-40d9-9501-d40e8b94b3da tempest-CreateVolumesFromImageTest-1720852944 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:56:57 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-69882b6b-aafc-4d63-bc17-cb5286ded4c8 tempest-CreateVolumesFromImageTest-1720852944 None] Acquiring lock "cinder-d381d8da-8ab2-45f9-a6b1-a449f0224d40-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:57 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-6cbd8915-99f1-40d9-9501-d40e8b94b3da tempest-CreateVolumesFromImageTest-1720852944 None] Deleted volume successfully. Sep 10 16:56:57 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-69882b6b-aafc-4d63-bc17-cb5286ded4c8 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "cinder-d381d8da-8ab2-45f9-a6b1-a449f0224d40-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:57 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6cbd8915-99f1-40d9-9501-d40e8b94b3da tempest-CreateVolumesFromImageTest-1720852944 None] Lock "cinder-675d3223-5caf-49e9-847f-1a0f791ed299-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:56:57 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-69882b6b-aafc-4d63-bc17-cb5286ded4c8 tempest-CreateVolumesFromImageTest-1720852944 None] Acquiring lock "cinder-quobyte-d381d8da-8ab2-45f9-a6b1-a449f0224d40" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:57 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-69882b6b-aafc-4d63-bc17-cb5286ded4c8 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "cinder-quobyte-d381d8da-8ab2-45f9-a6b1-a449f0224d40" acquired by "delete_volume" :: waited 0.014s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:57 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7171ae10-00a7-433f-8b3e-1859ec9e05b8]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:56:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-69882b6b-aafc-4d63-bc17-cb5286ded4c8 tempest-CreateVolumesFromImageTest-1720852944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d381d8da-8ab2-45f9-a6b1-a449f0224d40 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:57 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d381d8da-8ab2-45f9-a6b1-a449f0224d40 Sep 10 16:56:57 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:57 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-69882b6b-aafc-4d63-bc17-cb5286ded4c8 tempest-CreateVolumesFromImageTest-1720852944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d381d8da-8ab2-45f9-a6b1-a449f0224d40" returned: 0 in 0.379s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-69882b6b-aafc-4d63-bc17-cb5286ded4c8 tempest-CreateVolumesFromImageTest-1720852944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d381d8da-8ab2-45f9-a6b1-a449f0224d40 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:57 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d381d8da-8ab2-45f9-a6b1-a449f0224d40 Sep 10 16:56:57 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:57 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-69882b6b-aafc-4d63-bc17-cb5286ded4c8 tempest-CreateVolumesFromImageTest-1720852944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d381d8da-8ab2-45f9-a6b1-a449f0224d40" returned: 0 in 0.279s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:57 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-69882b6b-aafc-4d63-bc17-cb5286ded4c8 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "cinder-quobyte-d381d8da-8ab2-45f9-a6b1-a449f0224d40" released by "delete_volume" :: held 0.698s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:56:57 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-69882b6b-aafc-4d63-bc17-cb5286ded4c8 tempest-CreateVolumesFromImageTest-1720852944 None] Created reservations ['b6771eba-c8f6-4e1d-94a5-2f255dc62a5a', 'e491f84e-1310-4788-9991-582672a66c32', '27102c4b-ddef-4188-9ef0-d3f029d049e5', '465070f1-cadd-4d6c-bc5c-6c36f5c85d8c'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:56:57 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Flow 'volume_create_manager' (4faa054c-153c-4cf7-877e-d3a00e159fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bded8222-8974-4d64-9e23-0499fa22ba38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bded8222-8974-4d64-9e23-0499fa22ba38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2006296190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce47b60560cd4c329ace9b9a6297d010',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3555c650-f9d8-4bcd-b47a-d07d47c9acf3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:56:58Z,use_quota=True,user_id='586290eb517f4103b8d4270164dc3d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4417ecfc-14d0-434b-b867-e9a0cb234968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4417ecfc-14d0-434b-b867-e9a0cb234968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d791b264-270a-4fda-9669-489401f23f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d791b264-270a-4fda-9669-489401f23f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e', 'volume_name': 'volume-a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e', 'volume_size': 1, 'snapshot_id': '3555c650-f9d8-4bcd-b47a-d07d47c9acf3'}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (215cea35-fa1d-4e4e-b815-3471f8e87898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (215cea35-fa1d-4e4e-b815-3471f8e87898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9606fae3-8c29-4d25-bdf4-24c04f360e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:56:58 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Volume a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e', 'volume_size': 1, 'snapshot_id': '3555c650-f9d8-4bcd-b47a-d07d47c9acf3'} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Acquiring lock "cinder-quobyte-3555c650-f9d8-4bcd-b47a-d07d47c9acf3-a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e" by "_create_volume_from_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Lock "cinder-quobyte-3555c650-f9d8-4bcd-b47a-d07d47c9acf3-a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Creating volume a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e from snapshot 3555c650-f9d8-4bcd-b47a-d07d47c9acf3 {{(pid=88189) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Acquiring lock "cinder-quobyte-a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e" by "_copy_volume_from_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-69882b6b-aafc-4d63-bc17-cb5286ded4c8 tempest-CreateVolumesFromImageTest-1720852944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-69882b6b-aafc-4d63-bc17-cb5286ded4c8 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-69882b6b-aafc-4d63-bc17-cb5286ded4c8 tempest-CreateVolumesFromImageTest-1720852944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-69882b6b-aafc-4d63-bc17-cb5286ded4c8 tempest-CreateVolumesFromImageTest-1720852944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-69882b6b-aafc-4d63-bc17-cb5286ded4c8 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-69882b6b-aafc-4d63-bc17-cb5286ded4c8 tempest-CreateVolumesFromImageTest-1720852944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Lock "cinder-quobyte-a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] snapshot: 3555c650-f9d8-4bcd-b47a-d07d47c9acf3, volume: a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e, {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 16:56:58 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:56:58 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ed05c3-372a-4371-ac7c-7d5f79b5e60d]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109.3555c650-f9d8-4bcd-b47a-d07d47c9acf3 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-26b0a1a6-754d-4919-8d41-07b5ef713e41 tempest-CreateVolumesFromImageTest-1720852944 None] Acquiring lock "cinder-87f842ad-ec90-4a93-9602-b2cb6772b09e-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-26b0a1a6-754d-4919-8d41-07b5ef713e41 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "cinder-87f842ad-ec90-4a93-9602-b2cb6772b09e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:58 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109.3555c650-f9d8-4bcd-b47a-d07d47c9acf3 Sep 10 16:56:58 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-26b0a1a6-754d-4919-8d41-07b5ef713e41 tempest-CreateVolumesFromImageTest-1720852944 None] Acquiring lock "cinder-quobyte-87f842ad-ec90-4a93-9602-b2cb6772b09e" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-26b0a1a6-754d-4919-8d41-07b5ef713e41 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "cinder-quobyte-87f842ad-ec90-4a93-9602-b2cb6772b09e" acquired by "delete_volume" :: waited 0.022s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:58 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-69882b6b-aafc-4d63-bc17-cb5286ded4c8 tempest-CreateVolumesFromImageTest-1720852944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.315s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-69882b6b-aafc-4d63-bc17-cb5286ded4c8 tempest-CreateVolumesFromImageTest-1720852944 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca60913-194e-402c-984f-b89461e9cb71]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-26b0a1a6-754d-4919-8d41-07b5ef713e41 tempest-CreateVolumesFromImageTest-1720852944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-87f842ad-ec90-4a93-9602-b2cb6772b09e {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:58 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-69882b6b-aafc-4d63-bc17-cb5286ded4c8 tempest-CreateVolumesFromImageTest-1720852944 None] Deleted volume successfully. Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-69882b6b-aafc-4d63-bc17-cb5286ded4c8 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "cinder-d381d8da-8ab2-45f9-a6b1-a449f0224d40-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:56:58 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-87f842ad-ec90-4a93-9602-b2cb6772b09e Sep 10 16:56:58 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:58 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109.3555c650-f9d8-4bcd-b47a-d07d47c9acf3" returned: 0 in 0.459s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49d1e027-22fa-4b1e-8e99-6bca76140109(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abcd5cd-b852-4917-a80d-d58500cf49ab]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:58 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109 Sep 10 16:56:58 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:58 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-26b0a1a6-754d-4919-8d41-07b5ef713e41 tempest-CreateVolumesFromImageTest-1720852944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-87f842ad-ec90-4a93-9602-b2cb6772b09e" returned: 0 in 0.392s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-26b0a1a6-754d-4919-8d41-07b5ef713e41 tempest-CreateVolumesFromImageTest-1720852944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-87f842ad-ec90-4a93-9602-b2cb6772b09e {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:58 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-87f842ad-ec90-4a93-9602-b2cb6772b09e Sep 10 16:56:58 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:59 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109" returned: 0 in 0.370s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:59 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] will copy from snapshot at /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109 {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 16:56:59 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Creating direct copy from snapshot {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 16:56:59 devstack cinder-volume[88189]: DEBUG cinder.utils [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Path /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e not found in is_blk_device check {{(pid=88189) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 16:56:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:59 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e Sep 10 16:56:59 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:59 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-26b0a1a6-754d-4919-8d41-07b5ef713e41 tempest-CreateVolumesFromImageTest-1720852944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-87f842ad-ec90-4a93-9602-b2cb6772b09e" returned: 0 in 0.256s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:59 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-26b0a1a6-754d-4919-8d41-07b5ef713e41 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "cinder-quobyte-87f842ad-ec90-4a93-9602-b2cb6772b09e" released by "delete_volume" :: held 0.700s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:56:59 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-26b0a1a6-754d-4919-8d41-07b5ef713e41 tempest-CreateVolumesFromImageTest-1720852944 None] Created reservations ['df57b9ff-382b-4a79-a726-22185b3da059', '505773e9-6738-4b17-83bd-173a8753d29b', '5ba75d95-95ac-4409-8f3b-7b39090ee1a4', '509129f8-544d-4c11-9d3f-cb5008d603eb'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:56:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-26b0a1a6-754d-4919-8d41-07b5ef713e41 tempest-CreateVolumesFromImageTest-1720852944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:56:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-26b0a1a6-754d-4919-8d41-07b5ef713e41 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:56:59 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-26b0a1a6-754d-4919-8d41-07b5ef713e41 tempest-CreateVolumesFromImageTest-1720852944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:56:59 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-26b0a1a6-754d-4919-8d41-07b5ef713e41 tempest-CreateVolumesFromImageTest-1720852944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:56:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-26b0a1a6-754d-4919-8d41-07b5ef713e41 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:56:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-26b0a1a6-754d-4919-8d41-07b5ef713e41 tempest-CreateVolumesFromImageTest-1720852944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:59 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:56:59 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:56:59 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Sep 10 16:56:59 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-cb803cea-465b-4718-9952-ca778e7f9057 tempest-CreateVolumesFromImageTest-1720852944 None] Acquiring lock "cinder-ae4df3ea-c979-43fe-b46b-e9a20372a484-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-26b0a1a6-754d-4919-8d41-07b5ef713e41 tempest-CreateVolumesFromImageTest-1720852944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.289s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:56:59 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-26b0a1a6-754d-4919-8d41-07b5ef713e41 tempest-CreateVolumesFromImageTest-1720852944 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:56:59 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-26b0a1a6-754d-4919-8d41-07b5ef713e41 tempest-CreateVolumesFromImageTest-1720852944 None] Deleted volume successfully. Sep 10 16:56:59 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-cb803cea-465b-4718-9952-ca778e7f9057 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "cinder-ae4df3ea-c979-43fe-b46b-e9a20372a484-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:59 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-26b0a1a6-754d-4919-8d41-07b5ef713e41 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "cinder-87f842ad-ec90-4a93-9602-b2cb6772b09e-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:56:59 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-cb803cea-465b-4718-9952-ca778e7f9057 tempest-CreateVolumesFromImageTest-1720852944 None] Acquiring lock "cinder-quobyte-ae4df3ea-c979-43fe-b46b-e9a20372a484" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:56:59 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-cb803cea-465b-4718-9952-ca778e7f9057 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "cinder-quobyte-ae4df3ea-c979-43fe-b46b-e9a20372a484" acquired by "delete_volume" :: waited 0.035s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:56:59 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[21060228-f318-4229-9154-ac9687e811bd]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:56:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cb803cea-465b-4718-9952-ca778e7f9057 tempest-CreateVolumesFromImageTest-1720852944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ae4df3ea-c979-43fe-b46b-e9a20372a484 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:56:59 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ae4df3ea-c979-43fe-b46b-e9a20372a484 Sep 10 16:56:59 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:00 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cb803cea-465b-4718-9952-ca778e7f9057 tempest-CreateVolumesFromImageTest-1720852944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ae4df3ea-c979-43fe-b46b-e9a20372a484" returned: 0 in 0.771s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cb803cea-465b-4718-9952-ca778e7f9057 tempest-CreateVolumesFromImageTest-1720852944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ae4df3ea-c979-43fe-b46b-e9a20372a484 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:00 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ae4df3ea-c979-43fe-b46b-e9a20372a484 Sep 10 16:57:00 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:01 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cb803cea-465b-4718-9952-ca778e7f9057 tempest-CreateVolumesFromImageTest-1720852944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-ae4df3ea-c979-43fe-b46b-e9a20372a484" returned: 0 in 0.742s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:01 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-cb803cea-465b-4718-9952-ca778e7f9057 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "cinder-quobyte-ae4df3ea-c979-43fe-b46b-e9a20372a484" released by "delete_volume" :: held 1.621s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:57:01 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:UPDATE=199,cinder:SELECT=145,cinder:DELETE=17,cinder:INSERT=45 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:57:01 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=139,cinder:UPDATE=193,cinder:INSERT=44,cinder:DELETE=20 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:57:01 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-cb803cea-465b-4718-9952-ca778e7f9057 tempest-CreateVolumesFromImageTest-1720852944 None] Created reservations ['9c7cac47-2d3b-4511-8c72-d23fa9914c59', 'aa7761ba-55d2-4de5-804e-51580ba1c8ea', '881992d8-3ca5-4acd-85e9-ff994f35d8d5', 'd1e378e3-fe08-4fd7-9d60-48245286ff27'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:57:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-cb803cea-465b-4718-9952-ca778e7f9057 tempest-CreateVolumesFromImageTest-1720852944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-cb803cea-465b-4718-9952-ca778e7f9057 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:01 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-cb803cea-465b-4718-9952-ca778e7f9057 tempest-CreateVolumesFromImageTest-1720852944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:57:01 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-cb803cea-465b-4718-9952-ca778e7f9057 tempest-CreateVolumesFromImageTest-1720852944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:57:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-cb803cea-465b-4718-9952-ca778e7f9057 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cb803cea-465b-4718-9952-ca778e7f9057 tempest-CreateVolumesFromImageTest-1720852944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:01 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:57:01 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-89219560-999a-4584-b836-19bbfa2f306a tempest-CreateVolumesFromImageTest-1720852944 None] Acquiring lock "cinder-3e16792e-e0bd-444a-92c7-b6d30541fae6-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:57:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-89219560-999a-4584-b836-19bbfa2f306a tempest-CreateVolumesFromImageTest-1720852944 None] Lock "cinder-3e16792e-e0bd-444a-92c7-b6d30541fae6-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:57:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-89219560-999a-4584-b836-19bbfa2f306a tempest-CreateVolumesFromImageTest-1720852944 None] Acquiring lock "cinder-quobyte-3e16792e-e0bd-444a-92c7-b6d30541fae6" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:57:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-89219560-999a-4584-b836-19bbfa2f306a tempest-CreateVolumesFromImageTest-1720852944 None] Lock "cinder-quobyte-3e16792e-e0bd-444a-92c7-b6d30541fae6" acquired by "delete_volume" :: waited 0.030s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:57:02 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c383673f-c2dd-40e8-934d-571bbbf70810]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:57:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-89219560-999a-4584-b836-19bbfa2f306a tempest-CreateVolumesFromImageTest-1720852944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3e16792e-e0bd-444a-92c7-b6d30541fae6 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:02 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cb803cea-465b-4718-9952-ca778e7f9057 tempest-CreateVolumesFromImageTest-1720852944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.781s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:02 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-cb803cea-465b-4718-9952-ca778e7f9057 tempest-CreateVolumesFromImageTest-1720852944 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:57:02 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-cb803cea-465b-4718-9952-ca778e7f9057 tempest-CreateVolumesFromImageTest-1720852944 None] Deleted volume successfully. Sep 10 16:57:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-cb803cea-465b-4718-9952-ca778e7f9057 tempest-CreateVolumesFromImageTest-1720852944 None] Lock "cinder-ae4df3ea-c979-43fe-b46b-e9a20372a484-delete_volume" released by "delete_volume" :: held 2.943s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:57:02 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3e16792e-e0bd-444a-92c7-b6d30541fae6 Sep 10 16:57:02 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:03 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-89219560-999a-4584-b836-19bbfa2f306a tempest-CreateVolumesFromImageTest-1720852944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3e16792e-e0bd-444a-92c7-b6d30541fae6" returned: 0 in 0.683s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-89219560-999a-4584-b836-19bbfa2f306a tempest-CreateVolumesFromImageTest-1720852944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3e16792e-e0bd-444a-92c7-b6d30541fae6 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:03 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3e16792e-e0bd-444a-92c7-b6d30541fae6 Sep 10 16:57:03 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:03 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-89219560-999a-4584-b836-19bbfa2f306a tempest-CreateVolumesFromImageTest-1720852944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3e16792e-e0bd-444a-92c7-b6d30541fae6" returned: 0 in 0.563s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-89219560-999a-4584-b836-19bbfa2f306a tempest-CreateVolumesFromImageTest-1720852944 None] Lock "cinder-quobyte-3e16792e-e0bd-444a-92c7-b6d30541fae6" released by "delete_volume" :: held 1.343s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:57:03 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-89219560-999a-4584-b836-19bbfa2f306a tempest-CreateVolumesFromImageTest-1720852944 None] Created reservations ['9cb9b95e-bcdc-4c68-a812-8a6adb160531', '13c761e4-1b1a-4001-add3-01c07d0687ed', '71370591-bf96-4254-96ac-0c5f083afbb7', 'bab32b9e-90ad-404c-a81e-b21841d7b278'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:57:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-89219560-999a-4584-b836-19bbfa2f306a tempest-CreateVolumesFromImageTest-1720852944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-89219560-999a-4584-b836-19bbfa2f306a tempest-CreateVolumesFromImageTest-1720852944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:03 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-89219560-999a-4584-b836-19bbfa2f306a tempest-CreateVolumesFromImageTest-1720852944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:57:03 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-89219560-999a-4584-b836-19bbfa2f306a tempest-CreateVolumesFromImageTest-1720852944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:57:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-89219560-999a-4584-b836-19bbfa2f306a tempest-CreateVolumesFromImageTest-1720852944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-89219560-999a-4584-b836-19bbfa2f306a tempest-CreateVolumesFromImageTest-1720852944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:03 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:57:03 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:04 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e" returned: 0 in 5.209s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:04 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Image conversion details: src /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109, size 1024.00 MB, duration 5.21 sec, destination /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e {{(pid=88189) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 16:57:04 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Converted 1024.00 MB image at 196.53 MB/s Sep 10 16:57:04 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e is being set with open permissions: ugo+rw Sep 10 16:57:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:04 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e Sep 10 16:57:04 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:04 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-89219560-999a-4584-b836-19bbfa2f306a tempest-CreateVolumesFromImageTest-1720852944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.422s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:04 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-89219560-999a-4584-b836-19bbfa2f306a tempest-CreateVolumesFromImageTest-1720852944 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:57:04 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-89219560-999a-4584-b836-19bbfa2f306a tempest-CreateVolumesFromImageTest-1720852944 None] Deleted volume successfully. Sep 10 16:57:04 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-89219560-999a-4584-b836-19bbfa2f306a tempest-CreateVolumesFromImageTest-1720852944 None] Lock "cinder-3e16792e-e0bd-444a-92c7-b6d30541fae6-delete_volume" released by "delete_volume" :: held 2.236s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:57:04 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e" returned: 0 in 0.258s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:04 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Lock "cinder-quobyte-a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e" released by "_copy_volume_from_snapshot" :: held 6.375s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:57:04 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Lock "cinder-quobyte-3555c650-f9d8-4bcd-b47a-d07d47c9acf3-a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e" released by "_create_volume_from_snapshot" :: held 6.459s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:57:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.482s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:04 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9606fae3-8c29-4d25-bdf4-24c04f360e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e', 'volume_size': 1, 'snapshot_id': '3555c650-f9d8-4bcd-b47a-d07d47c9acf3'}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:04 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74842332-1e2a-4c17-b4ed-522293771547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:04 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Volume volume-a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e (a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e): created successfully Sep 10 16:57:04 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74842332-1e2a-4c17-b4ed-522293771547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:04 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Flow 'volume_create_manager' (4faa054c-153c-4cf7-877e-d3a00e159fea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:57:04 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-67b752a1-5b39-4ad4-a7a2-0c310e660697 tempest-VolumeDependencyTests-1579706968 None] Created volume successfully. Sep 10 16:57:05 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c2c0eb34-3612-422c-885d-19f169a5f330 tempest-VolumeDependencyTests-1579706968 None] Acquiring lock "cinder-3555c650-f9d8-4bcd-b47a-d07d47c9acf3-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:57:05 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c2c0eb34-3612-422c-885d-19f169a5f330 tempest-VolumeDependencyTests-1579706968 None] Lock "cinder-3555c650-f9d8-4bcd-b47a-d07d47c9acf3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:57:05 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c2c0eb34-3612-422c-885d-19f169a5f330 tempest-VolumeDependencyTests-1579706968 None] Acquiring lock "cinder-quobyte-49d1e027-22fa-4b1e-8e99-6bca76140109" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:57:05 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c2c0eb34-3612-422c-885d-19f169a5f330 tempest-VolumeDependencyTests-1579706968 None] Lock "cinder-quobyte-49d1e027-22fa-4b1e-8e99-6bca76140109" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:57:05 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c2c0eb34-3612-422c-885d-19f169a5f330 tempest-VolumeDependencyTests-1579706968 None] Acquiring lock "cinder-quobyte-3555c650-f9d8-4bcd-b47a-d07d47c9acf3" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:57:05 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c2c0eb34-3612-422c-885d-19f169a5f330 tempest-VolumeDependencyTests-1579706968 None] Lock "cinder-quobyte-3555c650-f9d8-4bcd-b47a-d07d47c9acf3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:57:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-c2c0eb34-3612-422c-885d-19f169a5f330 tempest-VolumeDependencyTests-1579706968 None] Deleting offline snapshot 3555c650-f9d8-4bcd-b47a-d07d47c9acf3 of volume 49d1e027-22fa-4b1e-8e99-6bca76140109 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:57:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-c2c0eb34-3612-422c-885d-19f169a5f330 tempest-VolumeDependencyTests-1579706968 None] snapshot_file for this snap is: volume-49d1e027-22fa-4b1e-8e99-6bca76140109.3555c650-f9d8-4bcd-b47a-d07d47c9acf3 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:57:05 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a625f5a-4d93-48ab-a203-47deeb3d5186]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:57:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c2c0eb34-3612-422c-885d-19f169a5f330 tempest-VolumeDependencyTests-1579706968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109.3555c650-f9d8-4bcd-b47a-d07d47c9acf3 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:05 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109.3555c650-f9d8-4bcd-b47a-d07d47c9acf3 Sep 10 16:57:05 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:06 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c2c0eb34-3612-422c-885d-19f169a5f330 tempest-VolumeDependencyTests-1579706968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109.3555c650-f9d8-4bcd-b47a-d07d47c9acf3" returned: 0 in 0.375s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:06 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-c2c0eb34-3612-422c-885d-19f169a5f330 tempest-VolumeDependencyTests-1579706968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49d1e027-22fa-4b1e-8e99-6bca76140109(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:57:06 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f509c6-5629-4494-b758-466c227b197e]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:57:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c2c0eb34-3612-422c-885d-19f169a5f330 tempest-VolumeDependencyTests-1579706968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:06 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109 Sep 10 16:57:06 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:06 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c2c0eb34-3612-422c-885d-19f169a5f330 tempest-VolumeDependencyTests-1579706968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109" returned: 0 in 0.560s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c2c0eb34-3612-422c-885d-19f169a5f330 tempest-VolumeDependencyTests-1579706968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109.3555c650-f9d8-4bcd-b47a-d07d47c9acf3 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:06 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109.3555c650-f9d8-4bcd-b47a-d07d47c9acf3 Sep 10 16:57:06 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:07 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c2c0eb34-3612-422c-885d-19f169a5f330 tempest-VolumeDependencyTests-1579706968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109.3555c650-f9d8-4bcd-b47a-d07d47c9acf3" returned: 0 in 0.401s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c2c0eb34-3612-422c-885d-19f169a5f330 tempest-VolumeDependencyTests-1579706968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109.3555c650-f9d8-4bcd-b47a-d07d47c9acf3 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:07 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109.3555c650-f9d8-4bcd-b47a-d07d47c9acf3 Sep 10 16:57:07 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:07 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-6da7df83-b184-479c-85b8-b2917641c994 tempest-CinderUnicodeTest-1957735609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:57:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6da7df83-b184-479c-85b8-b2917641c994 tempest-CinderUnicodeTest-1957735609 None] Flow 'volume_create_manager' (1ad1746d-6f51-401f-bb00-da298b006f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:57:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6da7df83-b184-479c-85b8-b2917641c994 tempest-CinderUnicodeTest-1957735609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (464aa932-7bc2-4b04-8aab-977d0f1c6bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6da7df83-b184-479c-85b8-b2917641c994 tempest-CinderUnicodeTest-1957735609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (464aa932-7bc2-4b04-8aab-977d0f1c6bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8520279-d63c-4a4d-89e9-5607e2e6155b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7f4dc5524794fa6b8fa97eb1b39190d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:07Z,use_quota=True,user_id='abdc03527f76465cb67caf6b0aa87c82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6da7df83-b184-479c-85b8-b2917641c994 tempest-CinderUnicodeTest-1957735609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c320e22-42e9-4cd1-9678-a536c2a2594f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6da7df83-b184-479c-85b8-b2917641c994 tempest-CinderUnicodeTest-1957735609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c320e22-42e9-4cd1-9678-a536c2a2594f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6da7df83-b184-479c-85b8-b2917641c994 tempest-CinderUnicodeTest-1957735609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a3184bc-02ee-41d2-bbfc-ecee14c32771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6da7df83-b184-479c-85b8-b2917641c994 tempest-CinderUnicodeTest-1957735609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a3184bc-02ee-41d2-bbfc-ecee14c32771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8520279-d63c-4a4d-89e9-5607e2e6155b', 'volume_name': 'volume-d8520279-d63c-4a4d-89e9-5607e2e6155b', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6da7df83-b184-479c-85b8-b2917641c994 tempest-CinderUnicodeTest-1957735609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b3928c-3a86-4dbe-9861-d4f5a856ad2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6da7df83-b184-479c-85b8-b2917641c994 tempest-CinderUnicodeTest-1957735609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b3928c-3a86-4dbe-9861-d4f5a856ad2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6da7df83-b184-479c-85b8-b2917641c994 tempest-CinderUnicodeTest-1957735609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d015543d-a38d-421f-9c35-909ec59f79c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:07 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-6da7df83-b184-479c-85b8-b2917641c994 tempest-CinderUnicodeTest-1957735609 None] Volume d8520279-d63c-4a4d-89e9-5607e2e6155b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8520279-d63c-4a4d-89e9-5607e2e6155b', 'volume_size': 1} Sep 10 16:57:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6da7df83-b184-479c-85b8-b2917641c994 tempest-CinderUnicodeTest-1957735609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6da7df83-b184-479c-85b8-b2917641c994 tempest-CinderUnicodeTest-1957735609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:07 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6da7df83-b184-479c-85b8-b2917641c994 tempest-CinderUnicodeTest-1957735609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8520279-d63c-4a4d-89e9-5607e2e6155b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7f4dc5524794fa6b8fa97eb1b39190d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:07Z,use_quota=True,user_id='abdc03527f76465cb67caf6b0aa87c82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:57:07 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-6da7df83-b184-479c-85b8-b2917641c994 tempest-CinderUnicodeTest-1957735609 None] Creating volume d8520279-d63c-4a4d-89e9-5607e2e6155b {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:57:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6da7df83-b184-479c-85b8-b2917641c994 tempest-CinderUnicodeTest-1957735609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6da7df83-b184-479c-85b8-b2917641c994 tempest-CinderUnicodeTest-1957735609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:07 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6da7df83-b184-479c-85b8-b2917641c994 tempest-CinderUnicodeTest-1957735609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:57:07 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6da7df83-b184-479c-85b8-b2917641c994 tempest-CinderUnicodeTest-1957735609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:57:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6da7df83-b184-479c-85b8-b2917641c994 tempest-CinderUnicodeTest-1957735609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:07 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6da7df83-b184-479c-85b8-b2917641c994 tempest-CinderUnicodeTest-1957735609 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:57:07 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-6da7df83-b184-479c-85b8-b2917641c994 tempest-CinderUnicodeTest-1957735609 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:57:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6da7df83-b184-479c-85b8-b2917641c994 tempest-CinderUnicodeTest-1957735609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d8520279-d63c-4a4d-89e9-5607e2e6155b 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:07 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d8520279-d63c-4a4d-89e9-5607e2e6155b 1073741824 Sep 10 16:57:07 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:07 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c2c0eb34-3612-422c-885d-19f169a5f330 tempest-VolumeDependencyTests-1579706968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109.3555c650-f9d8-4bcd-b47a-d07d47c9acf3" returned: 0 in 0.254s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:07 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c2c0eb34-3612-422c-885d-19f169a5f330 tempest-VolumeDependencyTests-1579706968 None] Lock "cinder-quobyte-3555c650-f9d8-4bcd-b47a-d07d47c9acf3" released by "_delete_snapshot" :: held 1.702s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:57:07 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c2c0eb34-3612-422c-885d-19f169a5f330 tempest-VolumeDependencyTests-1579706968 None] Lock "cinder-quobyte-49d1e027-22fa-4b1e-8e99-6bca76140109" released by "delete_snapshot" :: held 1.729s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:57:07 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-c2c0eb34-3612-422c-885d-19f169a5f330 tempest-VolumeDependencyTests-1579706968 None] Created reservations ['b1cd20e0-3aad-4ff2-9b6b-dc29bf89c390', 'e637233a-9310-412f-be60-eaa6597cd19b', '0407b0d2-aefa-4aa5-ba15-2d0855a812a5', '667e36fc-dd30-4b5f-bc67-90f8befe1664'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:57:07 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-c2c0eb34-3612-422c-885d-19f169a5f330 tempest-VolumeDependencyTests-1579706968 None] Delete snapshot completed successfully. Sep 10 16:57:07 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c2c0eb34-3612-422c-885d-19f169a5f330 tempest-VolumeDependencyTests-1579706968 None] Lock "cinder-3555c650-f9d8-4bcd-b47a-d07d47c9acf3-delete_snapshot" released by "delete_snapshot" :: held 1.862s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:57:07 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6da7df83-b184-479c-85b8-b2917641c994 tempest-CinderUnicodeTest-1957735609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d8520279-d63c-4a4d-89e9-5607e2e6155b 1073741824" returned: 0 in 0.435s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6da7df83-b184-479c-85b8-b2917641c994 tempest-CinderUnicodeTest-1957735609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d8520279-d63c-4a4d-89e9-5607e2e6155b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:07 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d8520279-d63c-4a4d-89e9-5607e2e6155b Sep 10 16:57:07 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:07 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-116a55dc-b153-4eb1-868f-5ee357d623e2 tempest-VolumeDependencyTests-1579706968 None] Acquiring lock "cinder-49d1e027-22fa-4b1e-8e99-6bca76140109-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:57:07 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-116a55dc-b153-4eb1-868f-5ee357d623e2 tempest-VolumeDependencyTests-1579706968 None] Lock "cinder-49d1e027-22fa-4b1e-8e99-6bca76140109-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:57:07 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-116a55dc-b153-4eb1-868f-5ee357d623e2 tempest-VolumeDependencyTests-1579706968 None] Acquiring lock "cinder-quobyte-49d1e027-22fa-4b1e-8e99-6bca76140109" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:57:07 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-116a55dc-b153-4eb1-868f-5ee357d623e2 tempest-VolumeDependencyTests-1579706968 None] Lock "cinder-quobyte-49d1e027-22fa-4b1e-8e99-6bca76140109" acquired by "delete_volume" :: waited 0.014s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce11631-611f-4066-b918-d00195271a10]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-116a55dc-b153-4eb1-868f-5ee357d623e2 tempest-VolumeDependencyTests-1579706968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:08 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6da7df83-b184-479c-85b8-b2917641c994 tempest-CinderUnicodeTest-1957735609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d8520279-d63c-4a4d-89e9-5607e2e6155b" returned: 0 in 0.266s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6da7df83-b184-479c-85b8-b2917641c994 tempest-CinderUnicodeTest-1957735609 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6da7df83-b184-479c-85b8-b2917641c994 tempest-CinderUnicodeTest-1957735609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6da7df83-b184-479c-85b8-b2917641c994 tempest-CinderUnicodeTest-1957735609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d015543d-a38d-421f-9c35-909ec59f79c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8520279-d63c-4a4d-89e9-5607e2e6155b', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6da7df83-b184-479c-85b8-b2917641c994 tempest-CinderUnicodeTest-1957735609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9fc90f2-2ce6-47a8-935e-d7530f5e97b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:08 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-6da7df83-b184-479c-85b8-b2917641c994 tempest-CinderUnicodeTest-1957735609 None] Volume volume-d8520279-d63c-4a4d-89e9-5607e2e6155b (d8520279-d63c-4a4d-89e9-5607e2e6155b): created successfully Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6da7df83-b184-479c-85b8-b2917641c994 tempest-CinderUnicodeTest-1957735609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9fc90f2-2ce6-47a8-935e-d7530f5e97b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6da7df83-b184-479c-85b8-b2917641c994 tempest-CinderUnicodeTest-1957735609 None] Flow 'volume_create_manager' (1ad1746d-6f51-401f-bb00-da298b006f3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:57:08 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109 Sep 10 16:57:08 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:08 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-6da7df83-b184-479c-85b8-b2917641c994 tempest-CinderUnicodeTest-1957735609 None] Created volume successfully. Sep 10 16:57:08 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-116a55dc-b153-4eb1-868f-5ee357d623e2 tempest-VolumeDependencyTests-1579706968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109" returned: 0 in 0.369s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-116a55dc-b153-4eb1-868f-5ee357d623e2 tempest-VolumeDependencyTests-1579706968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:08 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109 Sep 10 16:57:08 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:08 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-116a55dc-b153-4eb1-868f-5ee357d623e2 tempest-VolumeDependencyTests-1579706968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-49d1e027-22fa-4b1e-8e99-6bca76140109" returned: 0 in 0.269s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-116a55dc-b153-4eb1-868f-5ee357d623e2 tempest-VolumeDependencyTests-1579706968 None] Lock "cinder-quobyte-49d1e027-22fa-4b1e-8e99-6bca76140109" released by "delete_volume" :: held 0.712s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-116a55dc-b153-4eb1-868f-5ee357d623e2 tempest-VolumeDependencyTests-1579706968 None] Created reservations ['cc0c5bd1-c2b9-40fe-aeb6-57f4f7a26ed8', '8785b092-ad22-4d12-9c69-6223f478e539', 'd9d45bef-36cd-44c8-8c93-f126d6179d20', '8441e173-b943-43dc-938e-712c7657d49f'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-116a55dc-b153-4eb1-868f-5ee357d623e2 tempest-VolumeDependencyTests-1579706968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-116a55dc-b153-4eb1-868f-5ee357d623e2 tempest-VolumeDependencyTests-1579706968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-116a55dc-b153-4eb1-868f-5ee357d623e2 tempest-VolumeDependencyTests-1579706968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-116a55dc-b153-4eb1-868f-5ee357d623e2 tempest-VolumeDependencyTests-1579706968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-116a55dc-b153-4eb1-868f-5ee357d623e2 tempest-VolumeDependencyTests-1579706968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-116a55dc-b153-4eb1-868f-5ee357d623e2 tempest-VolumeDependencyTests-1579706968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bc62996-efbc-4398-9cd9-457f60f9b303 tempest-CinderUnicodeTest-1957735609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:57:08 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:57:08 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7bc62996-efbc-4398-9cd9-457f60f9b303 tempest-CinderUnicodeTest-1957735609 None] Flow 'volume_create_manager' (acf6e82d-4813-4086-8f84-40e9db890282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7bc62996-efbc-4398-9cd9-457f60f9b303 tempest-CinderUnicodeTest-1957735609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9e0525-e0fc-4249-991f-7af121c8e55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7bc62996-efbc-4398-9cd9-457f60f9b303 tempest-CinderUnicodeTest-1957735609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9e0525-e0fc-4249-991f-7af121c8e55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-801240303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be60d417-9ab0-484f-8147-9fb64288a881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7f4dc5524794fa6b8fa97eb1b39190d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:09Z,use_quota=True,user_id='abdc03527f76465cb67caf6b0aa87c82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7bc62996-efbc-4398-9cd9-457f60f9b303 tempest-CinderUnicodeTest-1957735609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f66d9b45-efbd-4f4b-81ed-b5cf18f2e0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7bc62996-efbc-4398-9cd9-457f60f9b303 tempest-CinderUnicodeTest-1957735609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f66d9b45-efbd-4f4b-81ed-b5cf18f2e0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7bc62996-efbc-4398-9cd9-457f60f9b303 tempest-CinderUnicodeTest-1957735609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66c63e6d-fe41-45a9-a88b-4bb547cc680c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7bc62996-efbc-4398-9cd9-457f60f9b303 tempest-CinderUnicodeTest-1957735609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66c63e6d-fe41-45a9-a88b-4bb547cc680c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be60d417-9ab0-484f-8147-9fb64288a881', 'volume_name': 'volume-be60d417-9ab0-484f-8147-9fb64288a881', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7bc62996-efbc-4398-9cd9-457f60f9b303 tempest-CinderUnicodeTest-1957735609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f790f73a-4914-4db1-9ca4-25e3bc7c2723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7bc62996-efbc-4398-9cd9-457f60f9b303 tempest-CinderUnicodeTest-1957735609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f790f73a-4914-4db1-9ca4-25e3bc7c2723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7bc62996-efbc-4398-9cd9-457f60f9b303 tempest-CinderUnicodeTest-1957735609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ed77742-2e45-4618-ace7-9696d78b7693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:08 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-7bc62996-efbc-4398-9cd9-457f60f9b303 tempest-CinderUnicodeTest-1957735609 None] Volume be60d417-9ab0-484f-8147-9fb64288a881: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be60d417-9ab0-484f-8147-9fb64288a881', 'volume_size': 1} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7bc62996-efbc-4398-9cd9-457f60f9b303 tempest-CinderUnicodeTest-1957735609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7bc62996-efbc-4398-9cd9-457f60f9b303 tempest-CinderUnicodeTest-1957735609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7bc62996-efbc-4398-9cd9-457f60f9b303 tempest-CinderUnicodeTest-1957735609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-801240303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be60d417-9ab0-484f-8147-9fb64288a881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7f4dc5524794fa6b8fa97eb1b39190d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:09Z,use_quota=True,user_id='abdc03527f76465cb67caf6b0aa87c82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-7bc62996-efbc-4398-9cd9-457f60f9b303 tempest-CinderUnicodeTest-1957735609 None] Creating volume be60d417-9ab0-484f-8147-9fb64288a881 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7bc62996-efbc-4398-9cd9-457f60f9b303 tempest-CinderUnicodeTest-1957735609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7bc62996-efbc-4398-9cd9-457f60f9b303 tempest-CinderUnicodeTest-1957735609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7bc62996-efbc-4398-9cd9-457f60f9b303 tempest-CinderUnicodeTest-1957735609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7bc62996-efbc-4398-9cd9-457f60f9b303 tempest-CinderUnicodeTest-1957735609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7bc62996-efbc-4398-9cd9-457f60f9b303 tempest-CinderUnicodeTest-1957735609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7bc62996-efbc-4398-9cd9-457f60f9b303 tempest-CinderUnicodeTest-1957735609 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:57:08 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-7bc62996-efbc-4398-9cd9-457f60f9b303 tempest-CinderUnicodeTest-1957735609 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:57:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7bc62996-efbc-4398-9cd9-457f60f9b303 tempest-CinderUnicodeTest-1957735609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:08 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881 1073741824 Sep 10 16:57:08 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:09 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-116a55dc-b153-4eb1-868f-5ee357d623e2 tempest-VolumeDependencyTests-1579706968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.265s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:09 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-116a55dc-b153-4eb1-868f-5ee357d623e2 tempest-VolumeDependencyTests-1579706968 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:57:09 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b464347a-f41f-4039-a657-52eb296cdceb tempest-VolumeDependencyTests-1579706968 None] Acquiring lock "cinder-a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:57:09 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-116a55dc-b153-4eb1-868f-5ee357d623e2 tempest-VolumeDependencyTests-1579706968 None] Deleted volume successfully. Sep 10 16:57:09 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b464347a-f41f-4039-a657-52eb296cdceb tempest-VolumeDependencyTests-1579706968 None] Lock "cinder-a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:57:09 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-116a55dc-b153-4eb1-868f-5ee357d623e2 tempest-VolumeDependencyTests-1579706968 None] Lock "cinder-49d1e027-22fa-4b1e-8e99-6bca76140109-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:57:09 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b464347a-f41f-4039-a657-52eb296cdceb tempest-VolumeDependencyTests-1579706968 None] Acquiring lock "cinder-quobyte-a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:57:09 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b464347a-f41f-4039-a657-52eb296cdceb tempest-VolumeDependencyTests-1579706968 None] Lock "cinder-quobyte-a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e" acquired by "delete_volume" :: waited 0.018s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:57:09 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6755dc2-acc1-4692-a032-16d963298aa2]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:57:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b464347a-f41f-4039-a657-52eb296cdceb tempest-VolumeDependencyTests-1579706968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:09 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e Sep 10 16:57:09 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:09 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7bc62996-efbc-4398-9cd9-457f60f9b303 tempest-CinderUnicodeTest-1957735609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881 1073741824" returned: 0 in 0.482s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7bc62996-efbc-4398-9cd9-457f60f9b303 tempest-CinderUnicodeTest-1957735609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:09 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881 Sep 10 16:57:09 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:09 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b464347a-f41f-4039-a657-52eb296cdceb tempest-VolumeDependencyTests-1579706968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e" returned: 0 in 0.384s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b464347a-f41f-4039-a657-52eb296cdceb tempest-VolumeDependencyTests-1579706968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:09 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e Sep 10 16:57:09 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:09 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7bc62996-efbc-4398-9cd9-457f60f9b303 tempest-CinderUnicodeTest-1957735609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881" returned: 0 in 0.277s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:09 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7bc62996-efbc-4398-9cd9-457f60f9b303 tempest-CinderUnicodeTest-1957735609 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:57:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7bc62996-efbc-4398-9cd9-457f60f9b303 tempest-CinderUnicodeTest-1957735609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:09 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7bc62996-efbc-4398-9cd9-457f60f9b303 tempest-CinderUnicodeTest-1957735609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ed77742-2e45-4618-ace7-9696d78b7693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be60d417-9ab0-484f-8147-9fb64288a881', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:09 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7bc62996-efbc-4398-9cd9-457f60f9b303 tempest-CinderUnicodeTest-1957735609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (098d9dee-1feb-494b-b492-64fe3addc98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:09 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-7bc62996-efbc-4398-9cd9-457f60f9b303 tempest-CinderUnicodeTest-1957735609 None] Volume volume-be60d417-9ab0-484f-8147-9fb64288a881 (be60d417-9ab0-484f-8147-9fb64288a881): created successfully Sep 10 16:57:09 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7bc62996-efbc-4398-9cd9-457f60f9b303 tempest-CinderUnicodeTest-1957735609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (098d9dee-1feb-494b-b492-64fe3addc98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:09 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7bc62996-efbc-4398-9cd9-457f60f9b303 tempest-CinderUnicodeTest-1957735609 None] Flow 'volume_create_manager' (acf6e82d-4813-4086-8f84-40e9db890282) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:57:09 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-7bc62996-efbc-4398-9cd9-457f60f9b303 tempest-CinderUnicodeTest-1957735609 None] Created volume successfully. Sep 10 16:57:09 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b464347a-f41f-4039-a657-52eb296cdceb tempest-VolumeDependencyTests-1579706968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e" returned: 0 in 0.266s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:09 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b464347a-f41f-4039-a657-52eb296cdceb tempest-VolumeDependencyTests-1579706968 None] Lock "cinder-quobyte-a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e" released by "delete_volume" :: held 0.690s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:57:09 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-b464347a-f41f-4039-a657-52eb296cdceb tempest-VolumeDependencyTests-1579706968 None] Created reservations ['f2c021ad-0f96-4957-b4a0-04a74fab4b7a', '12bebde7-20e5-4438-9cf4-d1e4516346ac', '5e16da05-b834-4b03-9b8c-95e319cc6bc1', '2a66c693-53a8-4bda-b05a-345c69e79682'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:57:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b464347a-f41f-4039-a657-52eb296cdceb tempest-VolumeDependencyTests-1579706968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b464347a-f41f-4039-a657-52eb296cdceb tempest-VolumeDependencyTests-1579706968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:10 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b464347a-f41f-4039-a657-52eb296cdceb tempest-VolumeDependencyTests-1579706968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:57:10 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b464347a-f41f-4039-a657-52eb296cdceb tempest-VolumeDependencyTests-1579706968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:57:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b464347a-f41f-4039-a657-52eb296cdceb tempest-VolumeDependencyTests-1579706968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b464347a-f41f-4039-a657-52eb296cdceb tempest-VolumeDependencyTests-1579706968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:10 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:57:10 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:10 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b464347a-f41f-4039-a657-52eb296cdceb tempest-VolumeDependencyTests-1579706968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.255s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:10 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-b464347a-f41f-4039-a657-52eb296cdceb tempest-VolumeDependencyTests-1579706968 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:57:10 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-b464347a-f41f-4039-a657-52eb296cdceb tempest-VolumeDependencyTests-1579706968 None] Deleted volume successfully. Sep 10 16:57:10 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b464347a-f41f-4039-a657-52eb296cdceb tempest-VolumeDependencyTests-1579706968 None] Lock "cinder-a45769b5-b29e-4bf2-87bc-ca1bd5a6a61e-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:57:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-475b483d-317c-4c6e-971b-65c8e01340bb tempest-CinderUnicodeTest-1957735609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-475b483d-317c-4c6e-971b-65c8e01340bb tempest-CinderUnicodeTest-1957735609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:11 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-475b483d-317c-4c6e-971b-65c8e01340bb tempest-CinderUnicodeTest-1957735609 None] Creating offline snapshot ed2e4d02-b21c-4307-a3c4-d78692747ffc of volume be60d417-9ab0-484f-8147-9fb64288a881 {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:57:11 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[188a8910-701b-4013-bb6a-b7431019e0be]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:57:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-475b483d-317c-4c6e-971b-65c8e01340bb tempest-CinderUnicodeTest-1957735609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:11 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881 Sep 10 16:57:11 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:11 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-475b483d-317c-4c6e-971b-65c8e01340bb tempest-CinderUnicodeTest-1957735609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881" returned: 0 in 0.404s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-475b483d-317c-4c6e-971b-65c8e01340bb tempest-CinderUnicodeTest-1957735609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881.ed2e4d02-b21c-4307-a3c4-d78692747ffc 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:11 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881.ed2e4d02-b21c-4307-a3c4-d78692747ffc 1G Sep 10 16:57:11 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:12 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-475b483d-317c-4c6e-971b-65c8e01340bb tempest-CinderUnicodeTest-1957735609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881.ed2e4d02-b21c-4307-a3c4-d78692747ffc 1G" returned: 0 in 0.416s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-475b483d-317c-4c6e-971b-65c8e01340bb tempest-CinderUnicodeTest-1957735609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be60d417-9ab0-484f-8147-9fb64288a881 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881.ed2e4d02-b21c-4307-a3c4-d78692747ffc {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:12 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be60d417-9ab0-484f-8147-9fb64288a881 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881.ed2e4d02-b21c-4307-a3c4-d78692747ffc Sep 10 16:57:12 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:12 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-475b483d-317c-4c6e-971b-65c8e01340bb tempest-CinderUnicodeTest-1957735609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be60d417-9ab0-484f-8147-9fb64288a881 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881.ed2e4d02-b21c-4307-a3c4-d78692747ffc" returned: 0 in 0.307s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:12 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-475b483d-317c-4c6e-971b-65c8e01340bb tempest-CinderUnicodeTest-1957735609 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881.ed2e4d02-b21c-4307-a3c4-d78692747ffc is being set with open permissions: ugo+rw Sep 10 16:57:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-475b483d-317c-4c6e-971b-65c8e01340bb tempest-CinderUnicodeTest-1957735609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881.ed2e4d02-b21c-4307-a3c4-d78692747ffc {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:12 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881.ed2e4d02-b21c-4307-a3c4-d78692747ffc Sep 10 16:57:12 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:12 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-475b483d-317c-4c6e-971b-65c8e01340bb tempest-CinderUnicodeTest-1957735609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881.ed2e4d02-b21c-4307-a3c4-d78692747ffc" returned: 0 in 0.271s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-475b483d-317c-4c6e-971b-65c8e01340bb tempest-CinderUnicodeTest-1957735609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:12 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881.info Sep 10 16:57:12 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:12 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-475b483d-317c-4c6e-971b-65c8e01340bb tempest-CinderUnicodeTest-1957735609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881.info" returned: 0 in 0.264s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:12 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-475b483d-317c-4c6e-971b-65c8e01340bb tempest-CinderUnicodeTest-1957735609 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881.info is being set with open permissions: ugo+rw Sep 10 16:57:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-475b483d-317c-4c6e-971b-65c8e01340bb tempest-CinderUnicodeTest-1957735609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:12 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881.info Sep 10 16:57:12 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:13 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-475b483d-317c-4c6e-971b-65c8e01340bb tempest-CinderUnicodeTest-1957735609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881.info" returned: 0 in 0.245s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-475b483d-317c-4c6e-971b-65c8e01340bb tempest-CinderUnicodeTest-1957735609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:13 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-475b483d-317c-4c6e-971b-65c8e01340bb tempest-CinderUnicodeTest-1957735609 None] Create snapshot completed successfully Sep 10 16:57:13 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-fd4f2e18-f4ee-4c1e-b0f7-9b474ffdc5e9 tempest-CinderUnicodeTest-1957735609 None] Acquiring lock "cinder-ed2e4d02-b21c-4307-a3c4-d78692747ffc-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:57:13 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-fd4f2e18-f4ee-4c1e-b0f7-9b474ffdc5e9 tempest-CinderUnicodeTest-1957735609 None] Lock "cinder-ed2e4d02-b21c-4307-a3c4-d78692747ffc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:57:13 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-fd4f2e18-f4ee-4c1e-b0f7-9b474ffdc5e9 tempest-CinderUnicodeTest-1957735609 None] Acquiring lock "cinder-quobyte-be60d417-9ab0-484f-8147-9fb64288a881" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:57:13 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-fd4f2e18-f4ee-4c1e-b0f7-9b474ffdc5e9 tempest-CinderUnicodeTest-1957735609 None] Lock "cinder-quobyte-be60d417-9ab0-484f-8147-9fb64288a881" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:57:13 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-fd4f2e18-f4ee-4c1e-b0f7-9b474ffdc5e9 tempest-CinderUnicodeTest-1957735609 None] Acquiring lock "cinder-quobyte-ed2e4d02-b21c-4307-a3c4-d78692747ffc" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:57:13 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-fd4f2e18-f4ee-4c1e-b0f7-9b474ffdc5e9 tempest-CinderUnicodeTest-1957735609 None] Lock "cinder-quobyte-ed2e4d02-b21c-4307-a3c4-d78692747ffc" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:57:13 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-fd4f2e18-f4ee-4c1e-b0f7-9b474ffdc5e9 tempest-CinderUnicodeTest-1957735609 None] Deleting offline snapshot ed2e4d02-b21c-4307-a3c4-d78692747ffc of volume be60d417-9ab0-484f-8147-9fb64288a881 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:57:13 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-fd4f2e18-f4ee-4c1e-b0f7-9b474ffdc5e9 tempest-CinderUnicodeTest-1957735609 None] snapshot_file for this snap is: volume-be60d417-9ab0-484f-8147-9fb64288a881.ed2e4d02-b21c-4307-a3c4-d78692747ffc {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:57:13 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[896b5e46-a12b-44b7-86bf-81b830227b6a]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:57:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fd4f2e18-f4ee-4c1e-b0f7-9b474ffdc5e9 tempest-CinderUnicodeTest-1957735609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881.ed2e4d02-b21c-4307-a3c4-d78692747ffc {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:13 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881.ed2e4d02-b21c-4307-a3c4-d78692747ffc Sep 10 16:57:13 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:13 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fd4f2e18-f4ee-4c1e-b0f7-9b474ffdc5e9 tempest-CinderUnicodeTest-1957735609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881.ed2e4d02-b21c-4307-a3c4-d78692747ffc" returned: 0 in 0.391s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:13 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-fd4f2e18-f4ee-4c1e-b0f7-9b474ffdc5e9 tempest-CinderUnicodeTest-1957735609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be60d417-9ab0-484f-8147-9fb64288a881(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:57:13 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d645c1a-a20f-4776-bf5f-f2b21fd801d8]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:57:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fd4f2e18-f4ee-4c1e-b0f7-9b474ffdc5e9 tempest-CinderUnicodeTest-1957735609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:13 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881 Sep 10 16:57:13 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:14 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fd4f2e18-f4ee-4c1e-b0f7-9b474ffdc5e9 tempest-CinderUnicodeTest-1957735609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881" returned: 0 in 0.373s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fd4f2e18-f4ee-4c1e-b0f7-9b474ffdc5e9 tempest-CinderUnicodeTest-1957735609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881.ed2e4d02-b21c-4307-a3c4-d78692747ffc {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:14 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881.ed2e4d02-b21c-4307-a3c4-d78692747ffc Sep 10 16:57:14 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:14 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fd4f2e18-f4ee-4c1e-b0f7-9b474ffdc5e9 tempest-CinderUnicodeTest-1957735609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881.ed2e4d02-b21c-4307-a3c4-d78692747ffc" returned: 0 in 0.366s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fd4f2e18-f4ee-4c1e-b0f7-9b474ffdc5e9 tempest-CinderUnicodeTest-1957735609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881.ed2e4d02-b21c-4307-a3c4-d78692747ffc {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:14 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881.ed2e4d02-b21c-4307-a3c4-d78692747ffc Sep 10 16:57:14 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:14 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fd4f2e18-f4ee-4c1e-b0f7-9b474ffdc5e9 tempest-CinderUnicodeTest-1957735609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881.ed2e4d02-b21c-4307-a3c4-d78692747ffc" returned: 0 in 0.259s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:14 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-fd4f2e18-f4ee-4c1e-b0f7-9b474ffdc5e9 tempest-CinderUnicodeTest-1957735609 None] Lock "cinder-quobyte-ed2e4d02-b21c-4307-a3c4-d78692747ffc" released by "_delete_snapshot" :: held 1.506s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:57:14 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-fd4f2e18-f4ee-4c1e-b0f7-9b474ffdc5e9 tempest-CinderUnicodeTest-1957735609 None] Lock "cinder-quobyte-be60d417-9ab0-484f-8147-9fb64288a881" released by "delete_snapshot" :: held 1.536s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:57:15 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-fd4f2e18-f4ee-4c1e-b0f7-9b474ffdc5e9 tempest-CinderUnicodeTest-1957735609 None] Created reservations ['1df7ae11-97c3-4d2d-9f31-921ab4ec90ca', '6ceeccc4-8f8a-42b1-84ab-bd6f55b41b47', '802f2c50-3aa6-44dc-8f1d-a767faabfe57', '24e6236f-5920-4dfe-9175-9b9a6bf517d4'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:57:15 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-fd4f2e18-f4ee-4c1e-b0f7-9b474ffdc5e9 tempest-CinderUnicodeTest-1957735609 None] Delete snapshot completed successfully. Sep 10 16:57:15 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-fd4f2e18-f4ee-4c1e-b0f7-9b474ffdc5e9 tempest-CinderUnicodeTest-1957735609 None] Lock "cinder-ed2e4d02-b21c-4307-a3c4-d78692747ffc-delete_snapshot" released by "delete_snapshot" :: held 1.676s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:57:15 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:57:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Flow 'volume_create_manager' (1b5cf4d0-d258-40f0-9ebb-5618b1bd716f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:57:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dd03537-dda7-41c2-95a2-e0d789a43053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:15 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-1e61f949-2b68-42eb-bc21-291884e4e3df tempest-CinderUnicodeTest-1957735609 None] Acquiring lock "cinder-be60d417-9ab0-484f-8147-9fb64288a881-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:57:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dd03537-dda7-41c2-95a2-e0d789a43053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e8518f3-e2dc-458d-8405-03085426d63c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fc19dad8a834c2789a7dc428b52aa5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:15Z,use_quota=True,user_id='8856846a8cce401e87a221a95a3769d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0de69eb2-02a0-49e8-bffb-1fd065d558cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0de69eb2-02a0-49e8-bffb-1fd065d558cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d744bfb0-e6f6-4eb4-9c42-93a96de0c54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:15 devstack cinder-volume[88189]: DEBUG cinder.image.glance [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Creating Keystone auth plugin from conf {{(pid=88189) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 16:57:15 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-1e61f949-2b68-42eb-bc21-291884e4e3df tempest-CinderUnicodeTest-1957735609 None] Lock "cinder-be60d417-9ab0-484f-8147-9fb64288a881-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:57:15 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-1e61f949-2b68-42eb-bc21-291884e4e3df tempest-CinderUnicodeTest-1957735609 None] Acquiring lock "cinder-quobyte-be60d417-9ab0-484f-8147-9fb64288a881" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:57:15 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-1e61f949-2b68-42eb-bc21-291884e4e3df tempest-CinderUnicodeTest-1957735609 None] Lock "cinder-quobyte-be60d417-9ab0-484f-8147-9fb64288a881" acquired by "delete_volume" :: waited 0.023s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:57:15 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e259eab-88cd-413d-a9b0-5f6e316c88f0]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:57:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1e61f949-2b68-42eb-bc21-291884e4e3df tempest-CinderUnicodeTest-1957735609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:15 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881 Sep 10 16:57:15 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d744bfb0-e6f6-4eb4-9c42-93a96de0c54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4e8518f3-e2dc-458d-8405-03085426d63c', 'volume_name': 'volume-4e8518f3-e2dc-458d-8405-03085426d63c', 'volume_size': 1, 'image_id': '2add7823-0912-4333-9d16-b80cb6075343', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2add7823-0912-4333-9d16-b80cb6075343', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ba3b6aff8e6a0c9550ae4bd20dea541c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7fc19dad8a834c2789a7dc428b52aa5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '069ebd6eae286f791edbea3d62637c4566be95acf6686e5214a9cc457b6318a96872458160755c649214d11cbf2a2dfab93363dc06eecd39a517bd0ee18b1094', 'id': '2add7823-0912-4333-9d16-b80cb6075343', 'created_at': datetime.datetime(2026, 9, 10, 14, 57, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 14, 57, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2add7823-0912-4333-9d16-b80cb6075343/file', 'properties': {}}, 'image_service': }' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35c78555-a735-42ee-9342-ba36c572bf45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35c78555-a735-42ee-9342-ba36c572bf45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b4f912-1601-4cc0-80b1-88b3201a1e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:15 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Volume 4e8518f3-e2dc-458d-8405-03085426d63c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4e8518f3-e2dc-458d-8405-03085426d63c', 'volume_size': 1, 'image_id': '2add7823-0912-4333-9d16-b80cb6075343', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2add7823-0912-4333-9d16-b80cb6075343', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ba3b6aff8e6a0c9550ae4bd20dea541c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7fc19dad8a834c2789a7dc428b52aa5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '069ebd6eae286f791edbea3d62637c4566be95acf6686e5214a9cc457b6318a96872458160755c649214d11cbf2a2dfab93363dc06eecd39a517bd0ee18b1094', 'id': '2add7823-0912-4333-9d16-b80cb6075343', 'created_at': datetime.datetime(2026, 9, 10, 14, 57, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 14, 57, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2add7823-0912-4333-9d16-b80cb6075343/file', 'properties': {}}, 'image_service': } Sep 10 16:57:15 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Trying to clone 4e8518f3-e2dc-458d-8405-03085426d63c from image 2add7823-0912-4333-9d16-b80cb6075343 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2add7823-0912-4333-9d16-b80cb6075343', 'metadata': {}}]). {{(pid=88189) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 16:57:16 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2add7823-0912-4333-9d16-b80cb6075343_mi2qrdpodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88189) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 16:57:16 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Image download 0.00 MB at 0.00 MB/s Sep 10 16:57:16 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c984340-26a9-40da-9d51-b6f0c16591b6]: (4, 'raw') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:57:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2add7823-0912-4333-9d16-b80cb6075343_mi2qrdpodevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:16 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1e61f949-2b68-42eb-bc21-291884e4e3df tempest-CinderUnicodeTest-1957735609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881" returned: 0 in 0.372s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1e61f949-2b68-42eb-bc21-291884e4e3df tempest-CinderUnicodeTest-1957735609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:16 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881 Sep 10 16:57:16 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:16 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2add7823-0912-4333-9d16-b80cb6075343_mi2qrdpodevstack@QuobyteHD Sep 10 16:57:16 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:16 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1e61f949-2b68-42eb-bc21-291884e4e3df tempest-CinderUnicodeTest-1957735609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-be60d417-9ab0-484f-8147-9fb64288a881" returned: 0 in 0.254s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:16 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2add7823-0912-4333-9d16-b80cb6075343_mi2qrdpodevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2add7823-0912-4333-9d16-b80cb6075343_mi2qrdpodevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:16 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-1e61f949-2b68-42eb-bc21-291884e4e3df tempest-CinderUnicodeTest-1957735609 None] Lock "cinder-quobyte-be60d417-9ab0-484f-8147-9fb64288a881" released by "delete_volume" :: held 0.728s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:57:16 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-1e61f949-2b68-42eb-bc21-291884e4e3df tempest-CinderUnicodeTest-1957735609 None] Created reservations ['b631caa5-9514-4837-9c85-6c01be55df57', '2f3fc694-0f15-4c84-8ed0-06fe9be7c892', '822b4a41-d259-409f-a19e-81179c67726f', '6e156f34-099d-4115-8af3-7a0c79dbfc83'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:57:16 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2add7823-0912-4333-9d16-b80cb6075343_mi2qrdpodevstack@QuobyteHD Sep 10 16:57:16 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-1e61f949-2b68-42eb-bc21-291884e4e3df tempest-CinderUnicodeTest-1957735609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-1e61f949-2b68-42eb-bc21-291884e4e3df tempest-CinderUnicodeTest-1957735609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-1e61f949-2b68-42eb-bc21-291884e4e3df tempest-CinderUnicodeTest-1957735609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:57:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-1e61f949-2b68-42eb-bc21-291884e4e3df tempest-CinderUnicodeTest-1957735609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:57:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-1e61f949-2b68-42eb-bc21-291884e4e3df tempest-CinderUnicodeTest-1957735609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1e61f949-2b68-42eb-bc21-291884e4e3df tempest-CinderUnicodeTest-1957735609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:16 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:57:16 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:16 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-cd4e4a97-33c1-458f-a0ff-da3ce168e124 tempest-CinderUnicodeTest-1957735609 None] Acquiring lock "cinder-d8520279-d63c-4a4d-89e9-5607e2e6155b-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:57:16 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:16 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-cd4e4a97-33c1-458f-a0ff-da3ce168e124 tempest-CinderUnicodeTest-1957735609 None] Lock "cinder-d8520279-d63c-4a4d-89e9-5607e2e6155b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:57:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2add7823-0912-4333-9d16-b80cb6075343_mi2qrdpodevstack@QuobyteHD" returned: 1 in 0.367s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2add7823-0912-4333-9d16-b80cb6075343_mi2qrdpodevstack@QuobyteHD' failed. Not Retrying. {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 16:57:16 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Temporary image 2add7823-0912-4333-9d16-b80cb6075343 is fetched for user 8856846a8cce401e87a221a95a3769d2. {{(pid=88189) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 16:57:16 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1e61f949-2b68-42eb-bc21-291884e4e3df tempest-CinderUnicodeTest-1957735609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.274s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:16 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-1e61f949-2b68-42eb-bc21-291884e4e3df tempest-CinderUnicodeTest-1957735609 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:57:16 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-1e61f949-2b68-42eb-bc21-291884e4e3df tempest-CinderUnicodeTest-1957735609 None] Deleted volume successfully. Sep 10 16:57:16 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-cd4e4a97-33c1-458f-a0ff-da3ce168e124 tempest-CinderUnicodeTest-1957735609 None] Acquiring lock "cinder-quobyte-d8520279-d63c-4a4d-89e9-5607e2e6155b" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:57:16 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-cd4e4a97-33c1-458f-a0ff-da3ce168e124 tempest-CinderUnicodeTest-1957735609 None] Lock "cinder-quobyte-d8520279-d63c-4a4d-89e9-5607e2e6155b" acquired by "delete_volume" :: waited 0.024s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:57:16 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b03829-233e-4ebc-87b4-bec0e4e71025]: (4, 'raw') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:57:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2add7823-0912-4333-9d16-b80cb6075343_mi2qrdpodevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:16 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-1e61f949-2b68-42eb-bc21-291884e4e3df tempest-CinderUnicodeTest-1957735609 None] Lock "cinder-be60d417-9ab0-484f-8147-9fb64288a881-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:57:16 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f6f3dd-4fd5-4c7d-9354-ce7bc0463cf1]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:57:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cd4e4a97-33c1-458f-a0ff-da3ce168e124 tempest-CinderUnicodeTest-1957735609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d8520279-d63c-4a4d-89e9-5607e2e6155b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:17 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2add7823-0912-4333-9d16-b80cb6075343_mi2qrdpodevstack@QuobyteHD Sep 10 16:57:17 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:17 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d8520279-d63c-4a4d-89e9-5607e2e6155b Sep 10 16:57:17 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:17 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2add7823-0912-4333-9d16-b80cb6075343_mi2qrdpodevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2add7823-0912-4333-9d16-b80cb6075343_mi2qrdpodevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:17 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cd4e4a97-33c1-458f-a0ff-da3ce168e124 tempest-CinderUnicodeTest-1957735609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d8520279-d63c-4a4d-89e9-5607e2e6155b" returned: 0 in 0.367s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cd4e4a97-33c1-458f-a0ff-da3ce168e124 tempest-CinderUnicodeTest-1957735609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d8520279-d63c-4a4d-89e9-5607e2e6155b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:17 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d8520279-d63c-4a4d-89e9-5607e2e6155b Sep 10 16:57:17 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:17 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2add7823-0912-4333-9d16-b80cb6075343_mi2qrdpodevstack@QuobyteHD Sep 10 16:57:17 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:17 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cd4e4a97-33c1-458f-a0ff-da3ce168e124 tempest-CinderUnicodeTest-1957735609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-d8520279-d63c-4a4d-89e9-5607e2e6155b" returned: 0 in 0.257s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:17 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-cd4e4a97-33c1-458f-a0ff-da3ce168e124 tempest-CinderUnicodeTest-1957735609 None] Lock "cinder-quobyte-d8520279-d63c-4a4d-89e9-5607e2e6155b" released by "delete_volume" :: held 0.678s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:57:17 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2add7823-0912-4333-9d16-b80cb6075343_mi2qrdpodevstack@QuobyteHD" returned: 1 in 0.339s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2add7823-0912-4333-9d16-b80cb6075343_mi2qrdpodevstack@QuobyteHD' failed. Not Retrying. {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 16:57:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e8518f3-e2dc-458d-8405-03085426d63c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fc19dad8a834c2789a7dc428b52aa5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:15Z,use_quota=True,user_id='8856846a8cce401e87a221a95a3769d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:57:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Creating volume 4e8518f3-e2dc-458d-8405-03085426d63c {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:57:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:57:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:57:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:57:17 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:57:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4e8518f3-e2dc-458d-8405-03085426d63c 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:17 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-cd4e4a97-33c1-458f-a0ff-da3ce168e124 tempest-CinderUnicodeTest-1957735609 None] Created reservations ['f235f326-1206-4abf-be9b-3e656e69ce3c', 'c19d0f5a-6493-47b0-acc4-802c2e21fd22', '58dae2c2-95fd-45b6-8b64-1cfde5c81318', 'fc071d5b-d9da-40db-b06b-47b0db2d7976'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:57:17 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4e8518f3-e2dc-458d-8405-03085426d63c 1073741824 Sep 10 16:57:17 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-cd4e4a97-33c1-458f-a0ff-da3ce168e124 tempest-CinderUnicodeTest-1957735609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-cd4e4a97-33c1-458f-a0ff-da3ce168e124 tempest-CinderUnicodeTest-1957735609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-cd4e4a97-33c1-458f-a0ff-da3ce168e124 tempest-CinderUnicodeTest-1957735609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:57:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-cd4e4a97-33c1-458f-a0ff-da3ce168e124 tempest-CinderUnicodeTest-1957735609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:57:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-cd4e4a97-33c1-458f-a0ff-da3ce168e124 tempest-CinderUnicodeTest-1957735609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cd4e4a97-33c1-458f-a0ff-da3ce168e124 tempest-CinderUnicodeTest-1957735609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:17 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:57:17 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:17 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cd4e4a97-33c1-458f-a0ff-da3ce168e124 tempest-CinderUnicodeTest-1957735609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.261s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:17 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-cd4e4a97-33c1-458f-a0ff-da3ce168e124 tempest-CinderUnicodeTest-1957735609 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:57:18 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-cd4e4a97-33c1-458f-a0ff-da3ce168e124 tempest-CinderUnicodeTest-1957735609 None] Deleted volume successfully. Sep 10 16:57:18 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-cd4e4a97-33c1-458f-a0ff-da3ce168e124 tempest-CinderUnicodeTest-1957735609 None] Lock "cinder-d8520279-d63c-4a4d-89e9-5607e2e6155b-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:57:18 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4e8518f3-e2dc-458d-8405-03085426d63c 1073741824" returned: 0 in 0.455s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4e8518f3-e2dc-458d-8405-03085426d63c {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:18 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4e8518f3-e2dc-458d-8405-03085426d63c Sep 10 16:57:18 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:18 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4e8518f3-e2dc-458d-8405-03085426d63c" returned: 0 in 0.253s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:18 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:57:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:18 devstack cinder-volume[88189]: DEBUG cinder.volume.volume_utils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Attempting download of 2add7823-0912-4333-9d16-b80cb6075343 ((None, [{'url': 'file:///opt/stack/data/glance/images/2add7823-0912-4333-9d16-b80cb6075343', 'metadata': {}}])) to volume 4e8518f3-e2dc-458d-8405-03085426d63c. {{(pid=88189) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 16:57:18 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[03eef2e2-a53c-4539-ae8a-8b03a50ed887]: (4, 'raw') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:57:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2add7823-0912-4333-9d16-b80cb6075343_z5qhz4ch {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:18 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2add7823-0912-4333-9d16-b80cb6075343_z5qhz4ch Sep 10 16:57:18 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:18 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2add7823-0912-4333-9d16-b80cb6075343_z5qhz4ch" returned: 0 in 0.356s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2add7823-0912-4333-9d16-b80cb6075343_z5qhz4ch {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:18 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2add7823-0912-4333-9d16-b80cb6075343_z5qhz4ch Sep 10 16:57:18 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:19 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2add7823-0912-4333-9d16-b80cb6075343_z5qhz4ch" returned: 1 in 0.366s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2add7823-0912-4333-9d16-b80cb6075343_z5qhz4ch' failed. Not Retrying. {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 16:57:19 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[907f5fa1-f91f-416d-ba61-9f73abecdd4f]: (4, 'raw') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:57:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2add7823-0912-4333-9d16-b80cb6075343_mi2qrdpodevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:19 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2add7823-0912-4333-9d16-b80cb6075343_mi2qrdpodevstack@QuobyteHD Sep 10 16:57:19 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:19 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2add7823-0912-4333-9d16-b80cb6075343_mi2qrdpodevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2add7823-0912-4333-9d16-b80cb6075343_mi2qrdpodevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:19 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2add7823-0912-4333-9d16-b80cb6075343_mi2qrdpodevstack@QuobyteHD Sep 10 16:57:19 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:19 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2add7823-0912-4333-9d16-b80cb6075343_mi2qrdpodevstack@QuobyteHD" returned: 1 in 0.328s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2add7823-0912-4333-9d16-b80cb6075343_mi2qrdpodevstack@QuobyteHD' failed. Not Retrying. {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 16:57:19 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] 2add7823-0912-4333-9d16-b80cb6075343 was raw, converting to qcow2 {{(pid=88189) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 16:57:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2add7823-0912-4333-9d16-b80cb6075343_mi2qrdpodevstack@QuobyteHD /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4e8518f3-e2dc-458d-8405-03085426d63c {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:19 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2add7823-0912-4333-9d16-b80cb6075343_mi2qrdpodevstack@QuobyteHD /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4e8518f3-e2dc-458d-8405-03085426d63c Sep 10 16:57:19 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:20 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2add7823-0912-4333-9d16-b80cb6075343_mi2qrdpodevstack@QuobyteHD /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4e8518f3-e2dc-458d-8405-03085426d63c" returned: 0 in 0.458s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:20 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2add7823-0912-4333-9d16-b80cb6075343_mi2qrdpodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4e8518f3-e2dc-458d-8405-03085426d63c {{(pid=88189) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 16:57:20 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Converted 0.00 MB image at 0.00 MB/s Sep 10 16:57:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4e8518f3-e2dc-458d-8405-03085426d63c 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:20 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4e8518f3-e2dc-458d-8405-03085426d63c 1G Sep 10 16:57:20 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:20 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4e8518f3-e2dc-458d-8405-03085426d63c 1G" returned: 0 in 0.337s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:20 devstack cinder-volume[88189]: DEBUG cinder.volume.volume_utils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Downloaded image 2add7823-0912-4333-9d16-b80cb6075343 ((None, [{'url': 'file:///opt/stack/data/glance/images/2add7823-0912-4333-9d16-b80cb6075343', 'metadata': {}}])) to volume 4e8518f3-e2dc-458d-8405-03085426d63c successfully. {{(pid=88189) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 16:57:20 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Temporary image 2add7823-0912-4333-9d16-b80cb6075343 for user 8856846a8cce401e87a221a95a3769d2 is deleted. {{(pid=88189) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 16:57:20 devstack cinder-volume[88189]: DEBUG cinder.volume.volume_utils [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Marking volume 4e8518f3-e2dc-458d-8405-03085426d63c as bootable. {{(pid=88189) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 16:57:20 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Copying metadata from image 2add7823-0912-4333-9d16-b80cb6075343 to 4e8518f3-e2dc-458d-8405-03085426d63c. {{(pid=88189) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 16:57:20 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Creating volume glance metadata for volume 4e8518f3-e2dc-458d-8405-03085426d63c backed by image 2add7823-0912-4333-9d16-b80cb6075343 with: {'image_id': '2add7823-0912-4333-9d16-b80cb6075343', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ba3b6aff8e6a0c9550ae4bd20dea541c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88189) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 16:57:20 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b4f912-1601-4cc0-80b1-88b3201a1e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e8518f3-e2dc-458d-8405-03085426d63c', 'volume_size': 1, 'image_id': '2add7823-0912-4333-9d16-b80cb6075343', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2add7823-0912-4333-9d16-b80cb6075343', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ba3b6aff8e6a0c9550ae4bd20dea541c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7fc19dad8a834c2789a7dc428b52aa5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '069ebd6eae286f791edbea3d62637c4566be95acf6686e5214a9cc457b6318a96872458160755c649214d11cbf2a2dfab93363dc06eecd39a517bd0ee18b1094', 'id': '2add7823-0912-4333-9d16-b80cb6075343', 'created_at': datetime.datetime(2026, 9, 10, 14, 57, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 14, 57, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2add7823-0912-4333-9d16-b80cb6075343/file', 'properties': {}}, 'image_service': }' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:20 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e45053b-da02-4deb-928f-a1c290405066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:20 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Volume volume-4e8518f3-e2dc-458d-8405-03085426d63c (4e8518f3-e2dc-458d-8405-03085426d63c): created successfully Sep 10 16:57:20 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e45053b-da02-4deb-928f-a1c290405066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:20 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Flow 'volume_create_manager' (1b5cf4d0-d258-40f0-9ebb-5618b1bd716f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:57:20 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-1f0d8ac4-1754-4fde-8f6e-f7a92e80084a tempest-VolumeImageDependencyTests-785439500 None] Created volume successfully. Sep 10 16:57:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4e14f48c-7342-4226-a4de-7a3fc8ddf422 tempest-VolumeImageDependencyTests-785439500 None] Acquiring lock "cinder-4e8518f3-e2dc-458d-8405-03085426d63c-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:57:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4e14f48c-7342-4226-a4de-7a3fc8ddf422 tempest-VolumeImageDependencyTests-785439500 None] Lock "cinder-4e8518f3-e2dc-458d-8405-03085426d63c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:57:22 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4e14f48c-7342-4226-a4de-7a3fc8ddf422 tempest-VolumeImageDependencyTests-785439500 None] Acquiring lock "cinder-quobyte-4e8518f3-e2dc-458d-8405-03085426d63c" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:57:22 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4e14f48c-7342-4226-a4de-7a3fc8ddf422 tempest-VolumeImageDependencyTests-785439500 None] Lock "cinder-quobyte-4e8518f3-e2dc-458d-8405-03085426d63c" acquired by "delete_volume" :: waited 0.018s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:57:22 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0aa3f8e-503c-4400-bc30-97478ce21e96]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:57:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4e14f48c-7342-4226-a4de-7a3fc8ddf422 tempest-VolumeImageDependencyTests-785439500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4e8518f3-e2dc-458d-8405-03085426d63c {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:22 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4e8518f3-e2dc-458d-8405-03085426d63c Sep 10 16:57:22 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:22 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4e14f48c-7342-4226-a4de-7a3fc8ddf422 tempest-VolumeImageDependencyTests-785439500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4e8518f3-e2dc-458d-8405-03085426d63c" returned: 0 in 0.364s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4e14f48c-7342-4226-a4de-7a3fc8ddf422 tempest-VolumeImageDependencyTests-785439500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4e8518f3-e2dc-458d-8405-03085426d63c {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:22 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4e8518f3-e2dc-458d-8405-03085426d63c Sep 10 16:57:22 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:22 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4e14f48c-7342-4226-a4de-7a3fc8ddf422 tempest-VolumeImageDependencyTests-785439500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4e8518f3-e2dc-458d-8405-03085426d63c" returned: 0 in 0.262s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:22 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4e14f48c-7342-4226-a4de-7a3fc8ddf422 tempest-VolumeImageDependencyTests-785439500 None] Lock "cinder-quobyte-4e8518f3-e2dc-458d-8405-03085426d63c" released by "delete_volume" :: held 0.675s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:57:22 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-4e14f48c-7342-4226-a4de-7a3fc8ddf422 tempest-VolumeImageDependencyTests-785439500 None] Created reservations ['e1837e56-c5ff-4937-9ee5-9e83f1f317db', '35ac93bd-9202-4031-93d5-36e3fa7bf47b', '267ed5b5-957a-453c-af29-2d23020841fa', '976c0a5d-3e32-421a-b7a6-085af3ba1af0'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:57:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4e14f48c-7342-4226-a4de-7a3fc8ddf422 tempest-VolumeImageDependencyTests-785439500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4e14f48c-7342-4226-a4de-7a3fc8ddf422 tempest-VolumeImageDependencyTests-785439500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:22 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-4e14f48c-7342-4226-a4de-7a3fc8ddf422 tempest-VolumeImageDependencyTests-785439500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:57:22 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-4e14f48c-7342-4226-a4de-7a3fc8ddf422 tempest-VolumeImageDependencyTests-785439500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:57:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4e14f48c-7342-4226-a4de-7a3fc8ddf422 tempest-VolumeImageDependencyTests-785439500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4e14f48c-7342-4226-a4de-7a3fc8ddf422 tempest-VolumeImageDependencyTests-785439500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:22 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:57:22 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:23 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4e14f48c-7342-4226-a4de-7a3fc8ddf422 tempest-VolumeImageDependencyTests-785439500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.275s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:23 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-4e14f48c-7342-4226-a4de-7a3fc8ddf422 tempest-VolumeImageDependencyTests-785439500 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:57:23 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-4e14f48c-7342-4226-a4de-7a3fc8ddf422 tempest-VolumeImageDependencyTests-785439500 None] Deleted volume successfully. Sep 10 16:57:23 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4e14f48c-7342-4226-a4de-7a3fc8ddf422 tempest-VolumeImageDependencyTests-785439500 None] Lock "cinder-4e8518f3-e2dc-458d-8405-03085426d63c-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:57:26 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaafb949-d92d-4441-89f0-0caa9d82adc0 tempest-ProjectReaderTests-953054728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:57:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-aaafb949-d92d-4441-89f0-0caa9d82adc0 tempest-ProjectReaderTests-953054728 None] Flow 'volume_create_manager' (18a8979b-9f59-4de9-bdf4-02ed0689e651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:57:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-aaafb949-d92d-4441-89f0-0caa9d82adc0 tempest-ProjectReaderTests-953054728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9190e50-e980-4f83-b8fe-30f54f8bf78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-aaafb949-d92d-4441-89f0-0caa9d82adc0 tempest-ProjectReaderTests-953054728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9190e50-e980-4f83-b8fe-30f54f8bf78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-634271320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e41e5fb3-c50b-489b-b3ae-233a8dcc2733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87c983b76fa8415ea7c3ba6aa05688b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:27Z,use_quota=True,user_id='10716954400b4cfcadec6dddff019d1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-aaafb949-d92d-4441-89f0-0caa9d82adc0 tempest-ProjectReaderTests-953054728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f32d1be-fd41-4a6d-91bb-328b89722ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-aaafb949-d92d-4441-89f0-0caa9d82adc0 tempest-ProjectReaderTests-953054728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f32d1be-fd41-4a6d-91bb-328b89722ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-aaafb949-d92d-4441-89f0-0caa9d82adc0 tempest-ProjectReaderTests-953054728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0da3f01b-3931-493f-80ce-90184c60f00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-aaafb949-d92d-4441-89f0-0caa9d82adc0 tempest-ProjectReaderTests-953054728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0da3f01b-3931-493f-80ce-90184c60f00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e41e5fb3-c50b-489b-b3ae-233a8dcc2733', 'volume_name': 'volume-e41e5fb3-c50b-489b-b3ae-233a8dcc2733', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-aaafb949-d92d-4441-89f0-0caa9d82adc0 tempest-ProjectReaderTests-953054728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef3efe9-8cfc-42d7-ad9d-5795187a74b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-aaafb949-d92d-4441-89f0-0caa9d82adc0 tempest-ProjectReaderTests-953054728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef3efe9-8cfc-42d7-ad9d-5795187a74b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-aaafb949-d92d-4441-89f0-0caa9d82adc0 tempest-ProjectReaderTests-953054728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c7864e1-ea35-4683-be18-94d195673ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:26 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-aaafb949-d92d-4441-89f0-0caa9d82adc0 tempest-ProjectReaderTests-953054728 None] Volume e41e5fb3-c50b-489b-b3ae-233a8dcc2733: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e41e5fb3-c50b-489b-b3ae-233a8dcc2733', 'volume_size': 1} Sep 10 16:57:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-aaafb949-d92d-4441-89f0-0caa9d82adc0 tempest-ProjectReaderTests-953054728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-aaafb949-d92d-4441-89f0-0caa9d82adc0 tempest-ProjectReaderTests-953054728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-aaafb949-d92d-4441-89f0-0caa9d82adc0 tempest-ProjectReaderTests-953054728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-634271320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e41e5fb3-c50b-489b-b3ae-233a8dcc2733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87c983b76fa8415ea7c3ba6aa05688b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:27Z,use_quota=True,user_id='10716954400b4cfcadec6dddff019d1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:57:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-aaafb949-d92d-4441-89f0-0caa9d82adc0 tempest-ProjectReaderTests-953054728 None] Creating volume e41e5fb3-c50b-489b-b3ae-233a8dcc2733 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:57:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-aaafb949-d92d-4441-89f0-0caa9d82adc0 tempest-ProjectReaderTests-953054728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-aaafb949-d92d-4441-89f0-0caa9d82adc0 tempest-ProjectReaderTests-953054728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-aaafb949-d92d-4441-89f0-0caa9d82adc0 tempest-ProjectReaderTests-953054728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:57:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-aaafb949-d92d-4441-89f0-0caa9d82adc0 tempest-ProjectReaderTests-953054728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:57:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-aaafb949-d92d-4441-89f0-0caa9d82adc0 tempest-ProjectReaderTests-953054728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-aaafb949-d92d-4441-89f0-0caa9d82adc0 tempest-ProjectReaderTests-953054728 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:57:26 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-aaafb949-d92d-4441-89f0-0caa9d82adc0 tempest-ProjectReaderTests-953054728 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:57:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-aaafb949-d92d-4441-89f0-0caa9d82adc0 tempest-ProjectReaderTests-953054728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e41e5fb3-c50b-489b-b3ae-233a8dcc2733 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:26 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e41e5fb3-c50b-489b-b3ae-233a8dcc2733 1073741824 Sep 10 16:57:26 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:27 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-aaafb949-d92d-4441-89f0-0caa9d82adc0 tempest-ProjectReaderTests-953054728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e41e5fb3-c50b-489b-b3ae-233a8dcc2733 1073741824" returned: 0 in 0.382s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-aaafb949-d92d-4441-89f0-0caa9d82adc0 tempest-ProjectReaderTests-953054728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e41e5fb3-c50b-489b-b3ae-233a8dcc2733 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:27 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e41e5fb3-c50b-489b-b3ae-233a8dcc2733 Sep 10 16:57:27 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:27 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-aaafb949-d92d-4441-89f0-0caa9d82adc0 tempest-ProjectReaderTests-953054728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e41e5fb3-c50b-489b-b3ae-233a8dcc2733" returned: 0 in 0.238s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-aaafb949-d92d-4441-89f0-0caa9d82adc0 tempest-ProjectReaderTests-953054728 None] <== create_volume: return (661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:57:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-aaafb949-d92d-4441-89f0-0caa9d82adc0 tempest-ProjectReaderTests-953054728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.663s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-aaafb949-d92d-4441-89f0-0caa9d82adc0 tempest-ProjectReaderTests-953054728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c7864e1-ea35-4683-be18-94d195673ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e41e5fb3-c50b-489b-b3ae-233a8dcc2733', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-aaafb949-d92d-4441-89f0-0caa9d82adc0 tempest-ProjectReaderTests-953054728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7fe467f-7146-4b3b-bd24-f83d6726e39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:27 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-aaafb949-d92d-4441-89f0-0caa9d82adc0 tempest-ProjectReaderTests-953054728 None] Volume volume-e41e5fb3-c50b-489b-b3ae-233a8dcc2733 (e41e5fb3-c50b-489b-b3ae-233a8dcc2733): created successfully Sep 10 16:57:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-aaafb949-d92d-4441-89f0-0caa9d82adc0 tempest-ProjectReaderTests-953054728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7fe467f-7146-4b3b-bd24-f83d6726e39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-aaafb949-d92d-4441-89f0-0caa9d82adc0 tempest-ProjectReaderTests-953054728 None] Flow 'volume_create_manager' (18a8979b-9f59-4de9-bdf4-02ed0689e651) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:57:27 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-aaafb949-d92d-4441-89f0-0caa9d82adc0 tempest-ProjectReaderTests-953054728 None] Created volume successfully. Sep 10 16:57:27 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-74aa6083-663c-4006-8a9b-db703b471001 tempest-ProjectReaderTests-953054728 None] Acquiring lock "cinder-e41e5fb3-c50b-489b-b3ae-233a8dcc2733-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:57:27 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-74aa6083-663c-4006-8a9b-db703b471001 tempest-ProjectReaderTests-953054728 None] Lock "cinder-e41e5fb3-c50b-489b-b3ae-233a8dcc2733-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:57:27 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-74aa6083-663c-4006-8a9b-db703b471001 tempest-ProjectReaderTests-953054728 None] Acquiring lock "cinder-quobyte-e41e5fb3-c50b-489b-b3ae-233a8dcc2733" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:57:27 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-74aa6083-663c-4006-8a9b-db703b471001 tempest-ProjectReaderTests-953054728 None] Lock "cinder-quobyte-e41e5fb3-c50b-489b-b3ae-233a8dcc2733" acquired by "delete_volume" :: waited 0.013s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:57:27 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a54bf1d-ae75-4dab-8ec6-2bd29a0674e7]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:57:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-74aa6083-663c-4006-8a9b-db703b471001 tempest-ProjectReaderTests-953054728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e41e5fb3-c50b-489b-b3ae-233a8dcc2733 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:27 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e41e5fb3-c50b-489b-b3ae-233a8dcc2733 Sep 10 16:57:27 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:28 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-74aa6083-663c-4006-8a9b-db703b471001 tempest-ProjectReaderTests-953054728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e41e5fb3-c50b-489b-b3ae-233a8dcc2733" returned: 0 in 0.345s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-74aa6083-663c-4006-8a9b-db703b471001 tempest-ProjectReaderTests-953054728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e41e5fb3-c50b-489b-b3ae-233a8dcc2733 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:28 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e41e5fb3-c50b-489b-b3ae-233a8dcc2733 Sep 10 16:57:28 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:28 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-74aa6083-663c-4006-8a9b-db703b471001 tempest-ProjectReaderTests-953054728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e41e5fb3-c50b-489b-b3ae-233a8dcc2733" returned: 0 in 0.235s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:28 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-74aa6083-663c-4006-8a9b-db703b471001 tempest-ProjectReaderTests-953054728 None] Lock "cinder-quobyte-e41e5fb3-c50b-489b-b3ae-233a8dcc2733" released by "delete_volume" :: held 0.614s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:57:28 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-74aa6083-663c-4006-8a9b-db703b471001 tempest-ProjectReaderTests-953054728 None] Created reservations ['ec987a2b-845d-4a31-9b79-26ace89565f4', 'b6af8361-9262-425c-80ea-7683052dc797', '484e86e2-97fb-4193-a8a8-9353cea4ed95', '1d303e02-587d-426c-afe7-56910eea13da'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:57:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-74aa6083-663c-4006-8a9b-db703b471001 tempest-ProjectReaderTests-953054728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-74aa6083-663c-4006-8a9b-db703b471001 tempest-ProjectReaderTests-953054728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:28 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-74aa6083-663c-4006-8a9b-db703b471001 tempest-ProjectReaderTests-953054728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:57:28 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-74aa6083-663c-4006-8a9b-db703b471001 tempest-ProjectReaderTests-953054728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:57:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-74aa6083-663c-4006-8a9b-db703b471001 tempest-ProjectReaderTests-953054728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-74aa6083-663c-4006-8a9b-db703b471001 tempest-ProjectReaderTests-953054728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:28 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:57:28 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:28 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-74aa6083-663c-4006-8a9b-db703b471001 tempest-ProjectReaderTests-953054728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.241s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:28 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-74aa6083-663c-4006-8a9b-db703b471001 tempest-ProjectReaderTests-953054728 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:57:28 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-74aa6083-663c-4006-8a9b-db703b471001 tempest-ProjectReaderTests-953054728 None] Deleted volume successfully. Sep 10 16:57:28 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-74aa6083-663c-4006-8a9b-db703b471001 tempest-ProjectReaderTests-953054728 None] Lock "cinder-e41e5fb3-c50b-489b-b3ae-233a8dcc2733-delete_volume" released by "delete_volume" :: held 1.031s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:57:29 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-d738a057-f596-4e22-bec7-7ec60107a5dc tempest-ProjectReaderTests-953054728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:57:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d738a057-f596-4e22-bec7-7ec60107a5dc tempest-ProjectReaderTests-953054728 None] Flow 'volume_create_manager' (17a718ee-70f4-4b0f-9178-61465e1a2d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:57:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d738a057-f596-4e22-bec7-7ec60107a5dc tempest-ProjectReaderTests-953054728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd51019-be75-45c9-82ab-b08ddf778982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d738a057-f596-4e22-bec7-7ec60107a5dc tempest-ProjectReaderTests-953054728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd51019-be75-45c9-82ab-b08ddf778982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-173237021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f388b3b3-659d-44b6-bca0-dda0ef3571b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87c983b76fa8415ea7c3ba6aa05688b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:29Z,use_quota=True,user_id='10716954400b4cfcadec6dddff019d1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d738a057-f596-4e22-bec7-7ec60107a5dc tempest-ProjectReaderTests-953054728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43a5079b-e2b9-4214-9b11-c2fda73411cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d738a057-f596-4e22-bec7-7ec60107a5dc tempest-ProjectReaderTests-953054728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43a5079b-e2b9-4214-9b11-c2fda73411cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d738a057-f596-4e22-bec7-7ec60107a5dc tempest-ProjectReaderTests-953054728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d95037-56c6-4efe-b851-2a78512a4a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d738a057-f596-4e22-bec7-7ec60107a5dc tempest-ProjectReaderTests-953054728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d95037-56c6-4efe-b851-2a78512a4a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f388b3b3-659d-44b6-bca0-dda0ef3571b3', 'volume_name': 'volume-f388b3b3-659d-44b6-bca0-dda0ef3571b3', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d738a057-f596-4e22-bec7-7ec60107a5dc tempest-ProjectReaderTests-953054728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a98c3f0c-c825-470b-85cc-476ea40de70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d738a057-f596-4e22-bec7-7ec60107a5dc tempest-ProjectReaderTests-953054728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a98c3f0c-c825-470b-85cc-476ea40de70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d738a057-f596-4e22-bec7-7ec60107a5dc tempest-ProjectReaderTests-953054728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8d05da7-1108-4ea4-babf-78256cea092b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:29 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-d738a057-f596-4e22-bec7-7ec60107a5dc tempest-ProjectReaderTests-953054728 None] Volume f388b3b3-659d-44b6-bca0-dda0ef3571b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f388b3b3-659d-44b6-bca0-dda0ef3571b3', 'volume_size': 1} Sep 10 16:57:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d738a057-f596-4e22-bec7-7ec60107a5dc tempest-ProjectReaderTests-953054728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d738a057-f596-4e22-bec7-7ec60107a5dc tempest-ProjectReaderTests-953054728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:29 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d738a057-f596-4e22-bec7-7ec60107a5dc tempest-ProjectReaderTests-953054728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-173237021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f388b3b3-659d-44b6-bca0-dda0ef3571b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87c983b76fa8415ea7c3ba6aa05688b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:29Z,use_quota=True,user_id='10716954400b4cfcadec6dddff019d1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:57:29 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-d738a057-f596-4e22-bec7-7ec60107a5dc tempest-ProjectReaderTests-953054728 None] Creating volume f388b3b3-659d-44b6-bca0-dda0ef3571b3 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:57:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d738a057-f596-4e22-bec7-7ec60107a5dc tempest-ProjectReaderTests-953054728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d738a057-f596-4e22-bec7-7ec60107a5dc tempest-ProjectReaderTests-953054728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:29 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d738a057-f596-4e22-bec7-7ec60107a5dc tempest-ProjectReaderTests-953054728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:57:29 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d738a057-f596-4e22-bec7-7ec60107a5dc tempest-ProjectReaderTests-953054728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:57:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d738a057-f596-4e22-bec7-7ec60107a5dc tempest-ProjectReaderTests-953054728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:29 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d738a057-f596-4e22-bec7-7ec60107a5dc tempest-ProjectReaderTests-953054728 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:57:29 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-d738a057-f596-4e22-bec7-7ec60107a5dc tempest-ProjectReaderTests-953054728 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:57:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d738a057-f596-4e22-bec7-7ec60107a5dc tempest-ProjectReaderTests-953054728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f388b3b3-659d-44b6-bca0-dda0ef3571b3 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:29 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f388b3b3-659d-44b6-bca0-dda0ef3571b3 1073741824 Sep 10 16:57:29 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:29 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d738a057-f596-4e22-bec7-7ec60107a5dc tempest-ProjectReaderTests-953054728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f388b3b3-659d-44b6-bca0-dda0ef3571b3 1073741824" returned: 0 in 0.396s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d738a057-f596-4e22-bec7-7ec60107a5dc tempest-ProjectReaderTests-953054728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f388b3b3-659d-44b6-bca0-dda0ef3571b3 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:29 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f388b3b3-659d-44b6-bca0-dda0ef3571b3 Sep 10 16:57:29 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:30 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d738a057-f596-4e22-bec7-7ec60107a5dc tempest-ProjectReaderTests-953054728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f388b3b3-659d-44b6-bca0-dda0ef3571b3" returned: 0 in 0.235s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d738a057-f596-4e22-bec7-7ec60107a5dc tempest-ProjectReaderTests-953054728 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:57:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d738a057-f596-4e22-bec7-7ec60107a5dc tempest-ProjectReaderTests-953054728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d738a057-f596-4e22-bec7-7ec60107a5dc tempest-ProjectReaderTests-953054728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8d05da7-1108-4ea4-babf-78256cea092b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f388b3b3-659d-44b6-bca0-dda0ef3571b3', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d738a057-f596-4e22-bec7-7ec60107a5dc tempest-ProjectReaderTests-953054728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f68974-f40f-4cfd-beed-efaad1d7c5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:30 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-d738a057-f596-4e22-bec7-7ec60107a5dc tempest-ProjectReaderTests-953054728 None] Volume volume-f388b3b3-659d-44b6-bca0-dda0ef3571b3 (f388b3b3-659d-44b6-bca0-dda0ef3571b3): created successfully Sep 10 16:57:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d738a057-f596-4e22-bec7-7ec60107a5dc tempest-ProjectReaderTests-953054728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f68974-f40f-4cfd-beed-efaad1d7c5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d738a057-f596-4e22-bec7-7ec60107a5dc tempest-ProjectReaderTests-953054728 None] Flow 'volume_create_manager' (17a718ee-70f4-4b0f-9178-61465e1a2d91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:57:30 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-d738a057-f596-4e22-bec7-7ec60107a5dc tempest-ProjectReaderTests-953054728 None] Created volume successfully. Sep 10 16:57:30 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-935e05c4-9124-436a-949e-23eefcba6e80 tempest-ProjectReaderTests-953054728 None] Acquiring lock "cinder-f388b3b3-659d-44b6-bca0-dda0ef3571b3-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:57:30 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-935e05c4-9124-436a-949e-23eefcba6e80 tempest-ProjectReaderTests-953054728 None] Lock "cinder-f388b3b3-659d-44b6-bca0-dda0ef3571b3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:57:30 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-935e05c4-9124-436a-949e-23eefcba6e80 tempest-ProjectReaderTests-953054728 None] Acquiring lock "cinder-quobyte-f388b3b3-659d-44b6-bca0-dda0ef3571b3" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:57:30 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-935e05c4-9124-436a-949e-23eefcba6e80 tempest-ProjectReaderTests-953054728 None] Lock "cinder-quobyte-f388b3b3-659d-44b6-bca0-dda0ef3571b3" acquired by "delete_volume" :: waited 0.016s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:57:30 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[570ee11a-da83-4db8-b374-653e141fa4b4]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:57:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-935e05c4-9124-436a-949e-23eefcba6e80 tempest-ProjectReaderTests-953054728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f388b3b3-659d-44b6-bca0-dda0ef3571b3 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:30 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f388b3b3-659d-44b6-bca0-dda0ef3571b3 Sep 10 16:57:30 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:30 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-935e05c4-9124-436a-949e-23eefcba6e80 tempest-ProjectReaderTests-953054728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f388b3b3-659d-44b6-bca0-dda0ef3571b3" returned: 0 in 0.348s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-935e05c4-9124-436a-949e-23eefcba6e80 tempest-ProjectReaderTests-953054728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f388b3b3-659d-44b6-bca0-dda0ef3571b3 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:30 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f388b3b3-659d-44b6-bca0-dda0ef3571b3 Sep 10 16:57:30 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:30 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-935e05c4-9124-436a-949e-23eefcba6e80 tempest-ProjectReaderTests-953054728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f388b3b3-659d-44b6-bca0-dda0ef3571b3" returned: 0 in 0.232s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:30 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-935e05c4-9124-436a-949e-23eefcba6e80 tempest-ProjectReaderTests-953054728 None] Lock "cinder-quobyte-f388b3b3-659d-44b6-bca0-dda0ef3571b3" released by "delete_volume" :: held 0.615s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:57:31 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-935e05c4-9124-436a-949e-23eefcba6e80 tempest-ProjectReaderTests-953054728 None] Created reservations ['11108fb0-9323-4de7-8581-bf9a9df11a1c', 'a42b89b3-3f70-408f-a319-221837080c3a', '604c42ba-adf5-480d-8eb7-fc78426a2386', '4dc049b1-cdda-4396-a095-b98f12789682'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:57:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-935e05c4-9124-436a-949e-23eefcba6e80 tempest-ProjectReaderTests-953054728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-935e05c4-9124-436a-949e-23eefcba6e80 tempest-ProjectReaderTests-953054728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:31 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-935e05c4-9124-436a-949e-23eefcba6e80 tempest-ProjectReaderTests-953054728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:57:31 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-935e05c4-9124-436a-949e-23eefcba6e80 tempest-ProjectReaderTests-953054728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:57:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-935e05c4-9124-436a-949e-23eefcba6e80 tempest-ProjectReaderTests-953054728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-935e05c4-9124-436a-949e-23eefcba6e80 tempest-ProjectReaderTests-953054728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:31 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:57:31 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:31 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-935e05c4-9124-436a-949e-23eefcba6e80 tempest-ProjectReaderTests-953054728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.234s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:31 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-935e05c4-9124-436a-949e-23eefcba6e80 tempest-ProjectReaderTests-953054728 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:57:31 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-935e05c4-9124-436a-949e-23eefcba6e80 tempest-ProjectReaderTests-953054728 None] Deleted volume successfully. Sep 10 16:57:31 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-935e05c4-9124-436a-949e-23eefcba6e80 tempest-ProjectReaderTests-953054728 None] Lock "cinder-f388b3b3-659d-44b6-bca0-dda0ef3571b3-delete_volume" released by "delete_volume" :: held 1.034s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:57:41 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=68,cinder:INSERT=28,cinder:UPDATE=102,cinder:DELETE=9 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:57:41 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=81,cinder:INSERT=32,cinder:UPDATE=104,cinder:DELETE=7 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:57:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:57:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:57:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:57:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:49 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:57:49 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:49 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.261s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:49 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:57:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager._thread_info {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:57:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread count: 28 {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 16:57:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread info: [<_MainThread(MainThread, started 125792070905984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 16:57:51 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0656c51-3f08-4bbd-a001-0d0fb39a91a7 tempest-CreateVolumesFromImageTest-843695759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:57:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b0656c51-3f08-4bbd-a001-0d0fb39a91a7 tempest-CreateVolumesFromImageTest-843695759 None] Flow 'volume_create_manager' (b2f42d67-caf1-4267-992e-03ecbc7f89dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:57:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b0656c51-3f08-4bbd-a001-0d0fb39a91a7 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53d8b82e-8cf2-4f61-b92f-c1b2a834e59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b0656c51-3f08-4bbd-a001-0d0fb39a91a7 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53d8b82e-8cf2-4f61-b92f-c1b2a834e59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-311234785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eb474d8-9d18-460f-8bbd-a4ff0eb74d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d312c275f0146538483173d3f73a947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:51Z,use_quota=True,user_id='ec95e003f89d4d85ae7f648a75d3ea41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b0656c51-3f08-4bbd-a001-0d0fb39a91a7 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a48fc50c-96f1-46fb-a7f1-99e2e623fa81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b0656c51-3f08-4bbd-a001-0d0fb39a91a7 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a48fc50c-96f1-46fb-a7f1-99e2e623fa81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b0656c51-3f08-4bbd-a001-0d0fb39a91a7 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d582995c-d8f6-4d45-80fc-48e3cff2fd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b0656c51-3f08-4bbd-a001-0d0fb39a91a7 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d582995c-d8f6-4d45-80fc-48e3cff2fd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eb474d8-9d18-460f-8bbd-a4ff0eb74d76', 'volume_name': 'volume-5eb474d8-9d18-460f-8bbd-a4ff0eb74d76', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b0656c51-3f08-4bbd-a001-0d0fb39a91a7 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (689ef66a-0177-4b75-bc06-0192160a1b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b0656c51-3f08-4bbd-a001-0d0fb39a91a7 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (689ef66a-0177-4b75-bc06-0192160a1b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b0656c51-3f08-4bbd-a001-0d0fb39a91a7 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f2cb71-f256-4891-a312-b366e918bff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:51 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-b0656c51-3f08-4bbd-a001-0d0fb39a91a7 tempest-CreateVolumesFromImageTest-843695759 None] Volume 5eb474d8-9d18-460f-8bbd-a4ff0eb74d76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eb474d8-9d18-460f-8bbd-a4ff0eb74d76', 'volume_size': 1} Sep 10 16:57:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b0656c51-3f08-4bbd-a001-0d0fb39a91a7 tempest-CreateVolumesFromImageTest-843695759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b0656c51-3f08-4bbd-a001-0d0fb39a91a7 tempest-CreateVolumesFromImageTest-843695759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:51 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b0656c51-3f08-4bbd-a001-0d0fb39a91a7 tempest-CreateVolumesFromImageTest-843695759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-311234785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eb474d8-9d18-460f-8bbd-a4ff0eb74d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d312c275f0146538483173d3f73a947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:51Z,use_quota=True,user_id='ec95e003f89d4d85ae7f648a75d3ea41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:57:51 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-b0656c51-3f08-4bbd-a001-0d0fb39a91a7 tempest-CreateVolumesFromImageTest-843695759 None] Creating volume 5eb474d8-9d18-460f-8bbd-a4ff0eb74d76 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:57:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b0656c51-3f08-4bbd-a001-0d0fb39a91a7 tempest-CreateVolumesFromImageTest-843695759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b0656c51-3f08-4bbd-a001-0d0fb39a91a7 tempest-CreateVolumesFromImageTest-843695759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:51 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b0656c51-3f08-4bbd-a001-0d0fb39a91a7 tempest-CreateVolumesFromImageTest-843695759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:57:51 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b0656c51-3f08-4bbd-a001-0d0fb39a91a7 tempest-CreateVolumesFromImageTest-843695759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:57:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b0656c51-3f08-4bbd-a001-0d0fb39a91a7 tempest-CreateVolumesFromImageTest-843695759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:51 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b0656c51-3f08-4bbd-a001-0d0fb39a91a7 tempest-CreateVolumesFromImageTest-843695759 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:57:51 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-b0656c51-3f08-4bbd-a001-0d0fb39a91a7 tempest-CreateVolumesFromImageTest-843695759 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:57:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b0656c51-3f08-4bbd-a001-0d0fb39a91a7 tempest-CreateVolumesFromImageTest-843695759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5eb474d8-9d18-460f-8bbd-a4ff0eb74d76 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:51 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5eb474d8-9d18-460f-8bbd-a4ff0eb74d76 1073741824 Sep 10 16:57:51 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:51 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbc2a6a6-e395-4270-ae9b-8899884672c1 tempest-VolumeDependencyTests-1552907241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:57:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-cbc2a6a6-e395-4270-ae9b-8899884672c1 tempest-VolumeDependencyTests-1552907241 None] Flow 'volume_create_manager' (d5809bba-98c2-4df5-a63b-97bc13b30600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:57:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-cbc2a6a6-e395-4270-ae9b-8899884672c1 tempest-VolumeDependencyTests-1552907241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d97d64a4-f162-4928-aa60-78f364e6bd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-cbc2a6a6-e395-4270-ae9b-8899884672c1 tempest-VolumeDependencyTests-1552907241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d97d64a4-f162-4928-aa60-78f364e6bd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1093121601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94917c13-8ff3-4652-a116-abe3a2e80337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='999d16fcc2da463aa14d52ce1e240d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:51Z,use_quota=True,user_id='8b90e7cc938b4bc0bbd4f4be72ca19f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-cbc2a6a6-e395-4270-ae9b-8899884672c1 tempest-VolumeDependencyTests-1552907241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ba31221-7996-43ee-b6b5-3be5369441b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-cbc2a6a6-e395-4270-ae9b-8899884672c1 tempest-VolumeDependencyTests-1552907241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ba31221-7996-43ee-b6b5-3be5369441b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-cbc2a6a6-e395-4270-ae9b-8899884672c1 tempest-VolumeDependencyTests-1552907241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (025c3806-1193-45e8-9ac2-9522e5ab5768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-cbc2a6a6-e395-4270-ae9b-8899884672c1 tempest-VolumeDependencyTests-1552907241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (025c3806-1193-45e8-9ac2-9522e5ab5768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94917c13-8ff3-4652-a116-abe3a2e80337', 'volume_name': 'volume-94917c13-8ff3-4652-a116-abe3a2e80337', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-cbc2a6a6-e395-4270-ae9b-8899884672c1 tempest-VolumeDependencyTests-1552907241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e7c3722-2a58-4251-b208-1e91c26534c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-cbc2a6a6-e395-4270-ae9b-8899884672c1 tempest-VolumeDependencyTests-1552907241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e7c3722-2a58-4251-b208-1e91c26534c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-cbc2a6a6-e395-4270-ae9b-8899884672c1 tempest-VolumeDependencyTests-1552907241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c424087-8a62-4ad5-935f-e3aa50ce8da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:51 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-cbc2a6a6-e395-4270-ae9b-8899884672c1 tempest-VolumeDependencyTests-1552907241 None] Volume 94917c13-8ff3-4652-a116-abe3a2e80337: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94917c13-8ff3-4652-a116-abe3a2e80337', 'volume_size': 1} Sep 10 16:57:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-cbc2a6a6-e395-4270-ae9b-8899884672c1 tempest-VolumeDependencyTests-1552907241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:52 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b0656c51-3f08-4bbd-a001-0d0fb39a91a7 tempest-CreateVolumesFromImageTest-843695759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5eb474d8-9d18-460f-8bbd-a4ff0eb74d76 1073741824" returned: 0 in 0.635s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b0656c51-3f08-4bbd-a001-0d0fb39a91a7 tempest-CreateVolumesFromImageTest-843695759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5eb474d8-9d18-460f-8bbd-a4ff0eb74d76 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:52 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5eb474d8-9d18-460f-8bbd-a4ff0eb74d76 Sep 10 16:57:52 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-bba2122a-f248-456c-873f-7f87b696586b tempest-CreateVolumesFromImageTest-843695759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bba2122a-f248-456c-873f-7f87b696586b tempest-CreateVolumesFromImageTest-843695759 None] Flow 'volume_create_manager' (b5a088c6-cea3-409c-9da8-295badf69e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bba2122a-f248-456c-873f-7f87b696586b tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff0144b6-bbb4-4221-95b3-8f2aa94fb19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bba2122a-f248-456c-873f-7f87b696586b tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff0144b6-bbb4-4221-95b3-8f2aa94fb19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1529357945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cab3e7b-fc26-41bd-961d-4336b781b1ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d312c275f0146538483173d3f73a947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:52Z,use_quota=True,user_id='ec95e003f89d4d85ae7f648a75d3ea41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bba2122a-f248-456c-873f-7f87b696586b tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd05865d-8456-42bf-baa7-202945c952a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bba2122a-f248-456c-873f-7f87b696586b tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd05865d-8456-42bf-baa7-202945c952a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bba2122a-f248-456c-873f-7f87b696586b tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d53385-0fb8-4696-9cee-13e6b05a2f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bba2122a-f248-456c-873f-7f87b696586b tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d53385-0fb8-4696-9cee-13e6b05a2f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cab3e7b-fc26-41bd-961d-4336b781b1ed', 'volume_name': 'volume-7cab3e7b-fc26-41bd-961d-4336b781b1ed', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bba2122a-f248-456c-873f-7f87b696586b tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f76f04-f020-4014-9b7e-da82e0824215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:52 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bba2122a-f248-456c-873f-7f87b696586b tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f76f04-f020-4014-9b7e-da82e0824215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bba2122a-f248-456c-873f-7f87b696586b tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b433ac11-0351-4b45-8e84-5b0cb7411080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:52 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-bba2122a-f248-456c-873f-7f87b696586b tempest-CreateVolumesFromImageTest-843695759 None] Volume 7cab3e7b-fc26-41bd-961d-4336b781b1ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cab3e7b-fc26-41bd-961d-4336b781b1ed', 'volume_size': 1} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-bba2122a-f248-456c-873f-7f87b696586b tempest-CreateVolumesFromImageTest-843695759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b0656c51-3f08-4bbd-a001-0d0fb39a91a7 tempest-CreateVolumesFromImageTest-843695759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5eb474d8-9d18-460f-8bbd-a4ff0eb74d76" returned: 0 in 0.314s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b0656c51-3f08-4bbd-a001-0d0fb39a91a7 tempest-CreateVolumesFromImageTest-843695759 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b0656c51-3f08-4bbd-a001-0d0fb39a91a7 tempest-CreateVolumesFromImageTest-843695759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-cbc2a6a6-e395-4270-ae9b-8899884672c1 tempest-VolumeDependencyTests-1552907241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.786s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-cbc2a6a6-e395-4270-ae9b-8899884672c1 tempest-VolumeDependencyTests-1552907241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1093121601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94917c13-8ff3-4652-a116-abe3a2e80337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='999d16fcc2da463aa14d52ce1e240d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:51Z,use_quota=True,user_id='8b90e7cc938b4bc0bbd4f4be72ca19f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-cbc2a6a6-e395-4270-ae9b-8899884672c1 tempest-VolumeDependencyTests-1552907241 None] Creating volume 94917c13-8ff3-4652-a116-abe3a2e80337 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-cbc2a6a6-e395-4270-ae9b-8899884672c1 tempest-VolumeDependencyTests-1552907241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-cbc2a6a6-e395-4270-ae9b-8899884672c1 tempest-VolumeDependencyTests-1552907241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-cbc2a6a6-e395-4270-ae9b-8899884672c1 tempest-VolumeDependencyTests-1552907241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-cbc2a6a6-e395-4270-ae9b-8899884672c1 tempest-VolumeDependencyTests-1552907241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-cbc2a6a6-e395-4270-ae9b-8899884672c1 tempest-VolumeDependencyTests-1552907241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-cbc2a6a6-e395-4270-ae9b-8899884672c1 tempest-VolumeDependencyTests-1552907241 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:57:52 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-cbc2a6a6-e395-4270-ae9b-8899884672c1 tempest-VolumeDependencyTests-1552907241 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cbc2a6a6-e395-4270-ae9b-8899884672c1 tempest-VolumeDependencyTests-1552907241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:52 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337 1073741824 Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b0656c51-3f08-4bbd-a001-0d0fb39a91a7 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f2cb71-f256-4891-a312-b366e918bff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eb474d8-9d18-460f-8bbd-a4ff0eb74d76', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b0656c51-3f08-4bbd-a001-0d0fb39a91a7 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce9f1e58-4ea5-4618-9831-86eade73594f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:52 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:52 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-b0656c51-3f08-4bbd-a001-0d0fb39a91a7 tempest-CreateVolumesFromImageTest-843695759 None] Volume volume-5eb474d8-9d18-460f-8bbd-a4ff0eb74d76 (5eb474d8-9d18-460f-8bbd-a4ff0eb74d76): created successfully Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b0656c51-3f08-4bbd-a001-0d0fb39a91a7 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce9f1e58-4ea5-4618-9831-86eade73594f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b0656c51-3f08-4bbd-a001-0d0fb39a91a7 tempest-CreateVolumesFromImageTest-843695759 None] Flow 'volume_create_manager' (b2f42d67-caf1-4267-992e-03ecbc7f89dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:57:52 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-b0656c51-3f08-4bbd-a001-0d0fb39a91a7 tempest-CreateVolumesFromImageTest-843695759 None] Created volume successfully. Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fb660a0-e008-49a7-8bc5-da411da1d02e tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2fb660a0-e008-49a7-8bc5-da411da1d02e tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Flow 'volume_create_manager' (3042a361-edbe-4ac9-be08-b3ec112da448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2fb660a0-e008-49a7-8bc5-da411da1d02e tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c01e06b2-bc20-47ae-906b-92c654d5bfe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2fb660a0-e008-49a7-8bc5-da411da1d02e tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c01e06b2-bc20-47ae-906b-92c654d5bfe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1794805862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bac3796-3390-43ae-bd98-da4a71c40083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651df1d6352e47aea56922d5c2943021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:53Z,use_quota=True,user_id='d3c7ff82f0594964b586230ee61e09ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2fb660a0-e008-49a7-8bc5-da411da1d02e tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0734fba7-c88d-49c6-8c1c-995012863089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2fb660a0-e008-49a7-8bc5-da411da1d02e tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0734fba7-c88d-49c6-8c1c-995012863089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2fb660a0-e008-49a7-8bc5-da411da1d02e tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a92d1cf-d940-4ae1-958d-54ebb7f4c32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2fb660a0-e008-49a7-8bc5-da411da1d02e tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a92d1cf-d940-4ae1-958d-54ebb7f4c32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bac3796-3390-43ae-bd98-da4a71c40083', 'volume_name': 'volume-7bac3796-3390-43ae-bd98-da4a71c40083', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2fb660a0-e008-49a7-8bc5-da411da1d02e tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (336bad88-b5a8-4201-8571-31ff9d6565aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2fb660a0-e008-49a7-8bc5-da411da1d02e tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (336bad88-b5a8-4201-8571-31ff9d6565aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2fb660a0-e008-49a7-8bc5-da411da1d02e tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f29b4713-9268-444e-875d-5ec69e6dcd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:52 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-2fb660a0-e008-49a7-8bc5-da411da1d02e tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Volume 7bac3796-3390-43ae-bd98-da4a71c40083: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bac3796-3390-43ae-bd98-da4a71c40083', 'volume_size': 1} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2fb660a0-e008-49a7-8bc5-da411da1d02e tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec83da99-aaa6-4472-bc92-8b7f2d99dc9f tempest-CreateVolumesFromImageTest-843695759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ec83da99-aaa6-4472-bc92-8b7f2d99dc9f tempest-CreateVolumesFromImageTest-843695759 None] Flow 'volume_create_manager' (bcf5b64f-0192-4365-8a6f-bf479f9dc841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:57:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ec83da99-aaa6-4472-bc92-8b7f2d99dc9f tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512817ac-e67a-4826-ac89-d154e9418ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ec83da99-aaa6-4472-bc92-8b7f2d99dc9f tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512817ac-e67a-4826-ac89-d154e9418ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2144466947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2bf43ec-1cb6-40ae-beb6-db2995a1655c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d312c275f0146538483173d3f73a947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:53Z,use_quota=True,user_id='ec95e003f89d4d85ae7f648a75d3ea41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ec83da99-aaa6-4472-bc92-8b7f2d99dc9f tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b327dd7e-2d03-4986-8e4b-7e21f3ff97f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ec83da99-aaa6-4472-bc92-8b7f2d99dc9f tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b327dd7e-2d03-4986-8e4b-7e21f3ff97f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ec83da99-aaa6-4472-bc92-8b7f2d99dc9f tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d10994cd-9f8e-489c-a8ff-72382c5987a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ec83da99-aaa6-4472-bc92-8b7f2d99dc9f tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d10994cd-9f8e-489c-a8ff-72382c5987a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2bf43ec-1cb6-40ae-beb6-db2995a1655c', 'volume_name': 'volume-f2bf43ec-1cb6-40ae-beb6-db2995a1655c', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ec83da99-aaa6-4472-bc92-8b7f2d99dc9f tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c2b34a-c78d-4af6-9367-c82ede242df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ec83da99-aaa6-4472-bc92-8b7f2d99dc9f tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c2b34a-c78d-4af6-9367-c82ede242df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ec83da99-aaa6-4472-bc92-8b7f2d99dc9f tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6155fbdf-a5e4-49bc-bceb-2461414b594a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:53 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-ec83da99-aaa6-4472-bc92-8b7f2d99dc9f tempest-CreateVolumesFromImageTest-843695759 None] Volume f2bf43ec-1cb6-40ae-beb6-db2995a1655c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2bf43ec-1cb6-40ae-beb6-db2995a1655c', 'volume_size': 1} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ec83da99-aaa6-4472-bc92-8b7f2d99dc9f tempest-CreateVolumesFromImageTest-843695759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8b4e896-a14f-42cb-ab46-aace6a2677b5 tempest-CreateVolumesFromImageTest-843695759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e8b4e896-a14f-42cb-ab46-aace6a2677b5 tempest-CreateVolumesFromImageTest-843695759 None] Flow 'volume_create_manager' (4b275d9a-0e99-458f-9e87-389edc335f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e8b4e896-a14f-42cb-ab46-aace6a2677b5 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9eea029-bf19-438d-b044-e9631e2fc767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e8b4e896-a14f-42cb-ab46-aace6a2677b5 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9eea029-bf19-438d-b044-e9631e2fc767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2053537592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb61d652-2a32-4266-8ac8-3a937009d1e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d312c275f0146538483173d3f73a947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:53Z,use_quota=True,user_id='ec95e003f89d4d85ae7f648a75d3ea41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e8b4e896-a14f-42cb-ab46-aace6a2677b5 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb57f537-0533-41f5-b4e0-9f50db82735e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e8b4e896-a14f-42cb-ab46-aace6a2677b5 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb57f537-0533-41f5-b4e0-9f50db82735e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e8b4e896-a14f-42cb-ab46-aace6a2677b5 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfaf55bf-2edf-415e-88ad-a43228d11782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e8b4e896-a14f-42cb-ab46-aace6a2677b5 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfaf55bf-2edf-415e-88ad-a43228d11782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb61d652-2a32-4266-8ac8-3a937009d1e0', 'volume_name': 'volume-cb61d652-2a32-4266-8ac8-3a937009d1e0', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e8b4e896-a14f-42cb-ab46-aace6a2677b5 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b9f809b-1617-48ac-929a-822f94d60446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e8b4e896-a14f-42cb-ab46-aace6a2677b5 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b9f809b-1617-48ac-929a-822f94d60446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e8b4e896-a14f-42cb-ab46-aace6a2677b5 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a0e50e1-f71a-4c25-9789-bde58f04c2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:53 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-e8b4e896-a14f-42cb-ab46-aace6a2677b5 tempest-CreateVolumesFromImageTest-843695759 None] Volume cb61d652-2a32-4266-8ac8-3a937009d1e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb61d652-2a32-4266-8ac8-3a937009d1e0', 'volume_size': 1} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e8b4e896-a14f-42cb-ab46-aace6a2677b5 tempest-CreateVolumesFromImageTest-843695759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:53 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cbc2a6a6-e395-4270-ae9b-8899884672c1 tempest-VolumeDependencyTests-1552907241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337 1073741824" returned: 0 in 0.730s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cbc2a6a6-e395-4270-ae9b-8899884672c1 tempest-VolumeDependencyTests-1552907241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:53 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337 Sep 10 16:57:53 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d196cf9-0d71-44c8-a792-a7281a3f7381 tempest-CreateVolumesFromImageTest-843695759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d196cf9-0d71-44c8-a792-a7281a3f7381 tempest-CreateVolumesFromImageTest-843695759 None] Flow 'volume_create_manager' (fe468562-eb1c-4f6d-95e7-f90ba107d09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d196cf9-0d71-44c8-a792-a7281a3f7381 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc1f3686-8275-4f3e-bfa5-024ad673273b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d196cf9-0d71-44c8-a792-a7281a3f7381 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc1f3686-8275-4f3e-bfa5-024ad673273b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1191484871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcd3888d-5993-405c-b20c-b8522badc428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d312c275f0146538483173d3f73a947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:53Z,use_quota=True,user_id='ec95e003f89d4d85ae7f648a75d3ea41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d196cf9-0d71-44c8-a792-a7281a3f7381 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8075edb9-e313-4301-a184-d94f8d783c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d196cf9-0d71-44c8-a792-a7281a3f7381 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8075edb9-e313-4301-a184-d94f8d783c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:53 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d196cf9-0d71-44c8-a792-a7281a3f7381 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2af27057-7970-4be1-8648-e9f989ddd4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d196cf9-0d71-44c8-a792-a7281a3f7381 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2af27057-7970-4be1-8648-e9f989ddd4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcd3888d-5993-405c-b20c-b8522badc428', 'volume_name': 'volume-bcd3888d-5993-405c-b20c-b8522badc428', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d196cf9-0d71-44c8-a792-a7281a3f7381 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa9a2217-9d8a-4503-9814-1334289d3c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d196cf9-0d71-44c8-a792-a7281a3f7381 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa9a2217-9d8a-4503-9814-1334289d3c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d196cf9-0d71-44c8-a792-a7281a3f7381 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b6a1f0-a69c-4282-9092-6763c8792880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:53 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-6d196cf9-0d71-44c8-a792-a7281a3f7381 tempest-CreateVolumesFromImageTest-843695759 None] Volume bcd3888d-5993-405c-b20c-b8522badc428: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcd3888d-5993-405c-b20c-b8522badc428', 'volume_size': 1} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6d196cf9-0d71-44c8-a792-a7281a3f7381 tempest-CreateVolumesFromImageTest-843695759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cbc2a6a6-e395-4270-ae9b-8899884672c1 tempest-VolumeDependencyTests-1552907241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337" returned: 0 in 0.336s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-cbc2a6a6-e395-4270-ae9b-8899884672c1 tempest-VolumeDependencyTests-1552907241 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-cbc2a6a6-e395-4270-ae9b-8899884672c1 tempest-VolumeDependencyTests-1552907241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-bba2122a-f248-456c-873f-7f87b696586b tempest-CreateVolumesFromImageTest-843695759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.125s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-bba2122a-f248-456c-873f-7f87b696586b tempest-CreateVolumesFromImageTest-843695759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1529357945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cab3e7b-fc26-41bd-961d-4336b781b1ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d312c275f0146538483173d3f73a947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:52Z,use_quota=True,user_id='ec95e003f89d4d85ae7f648a75d3ea41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-bba2122a-f248-456c-873f-7f87b696586b tempest-CreateVolumesFromImageTest-843695759 None] Creating volume 7cab3e7b-fc26-41bd-961d-4336b781b1ed {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-bba2122a-f248-456c-873f-7f87b696586b tempest-CreateVolumesFromImageTest-843695759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-bba2122a-f248-456c-873f-7f87b696586b tempest-CreateVolumesFromImageTest-843695759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-bba2122a-f248-456c-873f-7f87b696586b tempest-CreateVolumesFromImageTest-843695759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-bba2122a-f248-456c-873f-7f87b696586b tempest-CreateVolumesFromImageTest-843695759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-bba2122a-f248-456c-873f-7f87b696586b tempest-CreateVolumesFromImageTest-843695759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-bba2122a-f248-456c-873f-7f87b696586b tempest-CreateVolumesFromImageTest-843695759 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:57:53 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-bba2122a-f248-456c-873f-7f87b696586b tempest-CreateVolumesFromImageTest-843695759 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bba2122a-f248-456c-873f-7f87b696586b tempest-CreateVolumesFromImageTest-843695759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7cab3e7b-fc26-41bd-961d-4336b781b1ed 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:53 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7cab3e7b-fc26-41bd-961d-4336b781b1ed 1073741824 Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-cbc2a6a6-e395-4270-ae9b-8899884672c1 tempest-VolumeDependencyTests-1552907241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c424087-8a62-4ad5-935f-e3aa50ce8da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94917c13-8ff3-4652-a116-abe3a2e80337', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:53 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-cbc2a6a6-e395-4270-ae9b-8899884672c1 tempest-VolumeDependencyTests-1552907241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a9a84d4-599b-496d-abf3-77b66e20f020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:53 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-cbc2a6a6-e395-4270-ae9b-8899884672c1 tempest-VolumeDependencyTests-1552907241 None] Volume volume-94917c13-8ff3-4652-a116-abe3a2e80337 (94917c13-8ff3-4652-a116-abe3a2e80337): created successfully Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-cbc2a6a6-e395-4270-ae9b-8899884672c1 tempest-VolumeDependencyTests-1552907241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a9a84d4-599b-496d-abf3-77b66e20f020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-cbc2a6a6-e395-4270-ae9b-8899884672c1 tempest-VolumeDependencyTests-1552907241 None] Flow 'volume_create_manager' (d5809bba-98c2-4df5-a63b-97bc13b30600) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:57:53 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-cbc2a6a6-e395-4270-ae9b-8899884672c1 tempest-VolumeDependencyTests-1552907241 None] Created volume successfully. Sep 10 16:57:54 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bba2122a-f248-456c-873f-7f87b696586b tempest-CreateVolumesFromImageTest-843695759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7cab3e7b-fc26-41bd-961d-4336b781b1ed 1073741824" returned: 0 in 0.464s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bba2122a-f248-456c-873f-7f87b696586b tempest-CreateVolumesFromImageTest-843695759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7cab3e7b-fc26-41bd-961d-4336b781b1ed {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:54 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7cab3e7b-fc26-41bd-961d-4336b781b1ed Sep 10 16:57:54 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-60682dde-4b7b-4194-962c-1e8c8c9afd79 tempest-VolumeDependencyTests-1552907241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:54 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bba2122a-f248-456c-873f-7f87b696586b tempest-CreateVolumesFromImageTest-843695759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7cab3e7b-fc26-41bd-961d-4336b781b1ed" returned: 0 in 0.295s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:54 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-bba2122a-f248-456c-873f-7f87b696586b tempest-CreateVolumesFromImageTest-843695759 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:57:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-bba2122a-f248-456c-873f-7f87b696586b tempest-CreateVolumesFromImageTest-843695759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2fb660a0-e008-49a7-8bc5-da411da1d02e tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.427s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:54 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-2fb660a0-e008-49a7-8bc5-da411da1d02e tempest-CreateVolumesFromSourceVolumeTest-738548049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1794805862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bac3796-3390-43ae-bd98-da4a71c40083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651df1d6352e47aea56922d5c2943021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:53Z,use_quota=True,user_id='d3c7ff82f0594964b586230ee61e09ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:57:54 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-2fb660a0-e008-49a7-8bc5-da411da1d02e tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Creating volume 7bac3796-3390-43ae-bd98-da4a71c40083 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:57:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2fb660a0-e008-49a7-8bc5-da411da1d02e tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2fb660a0-e008-49a7-8bc5-da411da1d02e tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:54 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-2fb660a0-e008-49a7-8bc5-da411da1d02e tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:57:54 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-2fb660a0-e008-49a7-8bc5-da411da1d02e tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:57:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2fb660a0-e008-49a7-8bc5-da411da1d02e tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:54 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-2fb660a0-e008-49a7-8bc5-da411da1d02e tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:57:54 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-2fb660a0-e008-49a7-8bc5-da411da1d02e tempest-CreateVolumesFromSourceVolumeTest-738548049 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:57:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2fb660a0-e008-49a7-8bc5-da411da1d02e tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7bac3796-3390-43ae-bd98-da4a71c40083 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:54 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bba2122a-f248-456c-873f-7f87b696586b tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b433ac11-0351-4b45-8e84-5b0cb7411080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cab3e7b-fc26-41bd-961d-4336b781b1ed', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:54 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7bac3796-3390-43ae-bd98-da4a71c40083 1073741824 Sep 10 16:57:54 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:54 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bba2122a-f248-456c-873f-7f87b696586b tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75e112d5-8fe1-4041-846a-853737d05888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:54 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-bba2122a-f248-456c-873f-7f87b696586b tempest-CreateVolumesFromImageTest-843695759 None] Volume volume-7cab3e7b-fc26-41bd-961d-4336b781b1ed (7cab3e7b-fc26-41bd-961d-4336b781b1ed): created successfully Sep 10 16:57:54 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bba2122a-f248-456c-873f-7f87b696586b tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75e112d5-8fe1-4041-846a-853737d05888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:54 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-bba2122a-f248-456c-873f-7f87b696586b tempest-CreateVolumesFromImageTest-843695759 None] Flow 'volume_create_manager' (b5a088c6-cea3-409c-9da8-295badf69e78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:57:54 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-bba2122a-f248-456c-873f-7f87b696586b tempest-CreateVolumesFromImageTest-843695759 None] Created volume successfully. Sep 10 16:57:54 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2fb660a0-e008-49a7-8bc5-da411da1d02e tempest-CreateVolumesFromSourceVolumeTest-738548049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7bac3796-3390-43ae-bd98-da4a71c40083 1073741824" returned: 0 in 0.445s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2fb660a0-e008-49a7-8bc5-da411da1d02e tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7bac3796-3390-43ae-bd98-da4a71c40083 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:54 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7bac3796-3390-43ae-bd98-da4a71c40083 Sep 10 16:57:54 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:55 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2fb660a0-e008-49a7-8bc5-da411da1d02e tempest-CreateVolumesFromSourceVolumeTest-738548049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7bac3796-3390-43ae-bd98-da4a71c40083" returned: 0 in 0.270s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:55 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-2fb660a0-e008-49a7-8bc5-da411da1d02e tempest-CreateVolumesFromSourceVolumeTest-738548049 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:57:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-2fb660a0-e008-49a7-8bc5-da411da1d02e tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ec83da99-aaa6-4472-bc92-8b7f2d99dc9f tempest-CreateVolumesFromImageTest-843695759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.089s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:55 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ec83da99-aaa6-4472-bc92-8b7f2d99dc9f tempest-CreateVolumesFromImageTest-843695759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2144466947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2bf43ec-1cb6-40ae-beb6-db2995a1655c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d312c275f0146538483173d3f73a947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:53Z,use_quota=True,user_id='ec95e003f89d4d85ae7f648a75d3ea41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:57:55 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-ec83da99-aaa6-4472-bc92-8b7f2d99dc9f tempest-CreateVolumesFromImageTest-843695759 None] Creating volume f2bf43ec-1cb6-40ae-beb6-db2995a1655c {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:57:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ec83da99-aaa6-4472-bc92-8b7f2d99dc9f tempest-CreateVolumesFromImageTest-843695759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ec83da99-aaa6-4472-bc92-8b7f2d99dc9f tempest-CreateVolumesFromImageTest-843695759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:55 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ec83da99-aaa6-4472-bc92-8b7f2d99dc9f tempest-CreateVolumesFromImageTest-843695759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:57:55 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ec83da99-aaa6-4472-bc92-8b7f2d99dc9f tempest-CreateVolumesFromImageTest-843695759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:57:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ec83da99-aaa6-4472-bc92-8b7f2d99dc9f tempest-CreateVolumesFromImageTest-843695759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:55 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ec83da99-aaa6-4472-bc92-8b7f2d99dc9f tempest-CreateVolumesFromImageTest-843695759 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:57:55 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-ec83da99-aaa6-4472-bc92-8b7f2d99dc9f tempest-CreateVolumesFromImageTest-843695759 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:57:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ec83da99-aaa6-4472-bc92-8b7f2d99dc9f tempest-CreateVolumesFromImageTest-843695759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f2bf43ec-1cb6-40ae-beb6-db2995a1655c 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:55 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2fb660a0-e008-49a7-8bc5-da411da1d02e tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f29b4713-9268-444e-875d-5ec69e6dcd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bac3796-3390-43ae-bd98-da4a71c40083', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:55 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2fb660a0-e008-49a7-8bc5-da411da1d02e tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd53233f-eb81-4990-8c8b-2247153a20f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:55 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f2bf43ec-1cb6-40ae-beb6-db2995a1655c 1073741824 Sep 10 16:57:55 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:55 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-2fb660a0-e008-49a7-8bc5-da411da1d02e tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Volume volume-7bac3796-3390-43ae-bd98-da4a71c40083 (7bac3796-3390-43ae-bd98-da4a71c40083): created successfully Sep 10 16:57:55 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2fb660a0-e008-49a7-8bc5-da411da1d02e tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd53233f-eb81-4990-8c8b-2247153a20f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:55 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-2fb660a0-e008-49a7-8bc5-da411da1d02e tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Flow 'volume_create_manager' (3042a361-edbe-4ac9-be08-b3ec112da448) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:57:55 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-2fb660a0-e008-49a7-8bc5-da411da1d02e tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Created volume successfully. Sep 10 16:57:55 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ec83da99-aaa6-4472-bc92-8b7f2d99dc9f tempest-CreateVolumesFromImageTest-843695759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f2bf43ec-1cb6-40ae-beb6-db2995a1655c 1073741824" returned: 0 in 0.488s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ec83da99-aaa6-4472-bc92-8b7f2d99dc9f tempest-CreateVolumesFromImageTest-843695759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f2bf43ec-1cb6-40ae-beb6-db2995a1655c {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:55 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f2bf43ec-1cb6-40ae-beb6-db2995a1655c Sep 10 16:57:55 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:55 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ec83da99-aaa6-4472-bc92-8b7f2d99dc9f tempest-CreateVolumesFromImageTest-843695759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f2bf43ec-1cb6-40ae-beb6-db2995a1655c" returned: 0 in 0.317s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:55 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ec83da99-aaa6-4472-bc92-8b7f2d99dc9f tempest-CreateVolumesFromImageTest-843695759 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:57:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ec83da99-aaa6-4472-bc92-8b7f2d99dc9f tempest-CreateVolumesFromImageTest-843695759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e8b4e896-a14f-42cb-ab46-aace6a2677b5 tempest-CreateVolumesFromImageTest-843695759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.841s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-e8b4e896-a14f-42cb-ab46-aace6a2677b5 tempest-CreateVolumesFromImageTest-843695759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2053537592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb61d652-2a32-4266-8ac8-3a937009d1e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d312c275f0146538483173d3f73a947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:53Z,use_quota=True,user_id='ec95e003f89d4d85ae7f648a75d3ea41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-e8b4e896-a14f-42cb-ab46-aace6a2677b5 tempest-CreateVolumesFromImageTest-843695759 None] Creating volume cb61d652-2a32-4266-8ac8-3a937009d1e0 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e8b4e896-a14f-42cb-ab46-aace6a2677b5 tempest-CreateVolumesFromImageTest-843695759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e8b4e896-a14f-42cb-ab46-aace6a2677b5 tempest-CreateVolumesFromImageTest-843695759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-e8b4e896-a14f-42cb-ab46-aace6a2677b5 tempest-CreateVolumesFromImageTest-843695759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-e8b4e896-a14f-42cb-ab46-aace6a2677b5 tempest-CreateVolumesFromImageTest-843695759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e8b4e896-a14f-42cb-ab46-aace6a2677b5 tempest-CreateVolumesFromImageTest-843695759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-e8b4e896-a14f-42cb-ab46-aace6a2677b5 tempest-CreateVolumesFromImageTest-843695759 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:57:56 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-e8b4e896-a14f-42cb-ab46-aace6a2677b5 tempest-CreateVolumesFromImageTest-843695759 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e8b4e896-a14f-42cb-ab46-aace6a2677b5 tempest-CreateVolumesFromImageTest-843695759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cb61d652-2a32-4266-8ac8-3a937009d1e0 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ec83da99-aaa6-4472-bc92-8b7f2d99dc9f tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6155fbdf-a5e4-49bc-bceb-2461414b594a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2bf43ec-1cb6-40ae-beb6-db2995a1655c', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:56 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cb61d652-2a32-4266-8ac8-3a937009d1e0 1073741824 Sep 10 16:57:56 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ec83da99-aaa6-4472-bc92-8b7f2d99dc9f tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c87d94c5-cd92-4830-b671-314cc10270b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:56 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-ec83da99-aaa6-4472-bc92-8b7f2d99dc9f tempest-CreateVolumesFromImageTest-843695759 None] Volume volume-f2bf43ec-1cb6-40ae-beb6-db2995a1655c (f2bf43ec-1cb6-40ae-beb6-db2995a1655c): created successfully Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ec83da99-aaa6-4472-bc92-8b7f2d99dc9f tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c87d94c5-cd92-4830-b671-314cc10270b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ec83da99-aaa6-4472-bc92-8b7f2d99dc9f tempest-CreateVolumesFromImageTest-843695759 None] Flow 'volume_create_manager' (bcf5b64f-0192-4365-8a6f-bf479f9dc841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:57:56 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-ec83da99-aaa6-4472-bc92-8b7f2d99dc9f tempest-CreateVolumesFromImageTest-843695759 None] Created volume successfully. Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Flow 'volume_create_manager' (9b40b168-1534-4669-a86f-1d9923116978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd8acbe2-fd1c-4a48-add9-c02ccd174b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd8acbe2-fd1c-4a48-add9-c02ccd174b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6323f669-ab6a-4a99-9c1f-fece1c0597f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50cf4050ca5644f0afa5039ef3a4c48a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:56Z,use_quota=True,user_id='32e2041bd4434cbfb3ecc1ab2a32e1b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e507d436-e8d6-4076-aa8d-2c269f6f3fc7),volume_type_id=e507d436-e8d6-4076-aa8d-2c269f6f3fc7)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (025ba062-fc0c-4a3f-8181-c82c0ec236d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (025ba062-fc0c-4a3f-8181-c82c0ec236d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e19d10bd-0ab4-4d89-a726-9d5c01d7e18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.image.glance [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Creating Keystone auth plugin from conf {{(pid=88189) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 16:57:56 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e8b4e896-a14f-42cb-ab46-aace6a2677b5 tempest-CreateVolumesFromImageTest-843695759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cb61d652-2a32-4266-8ac8-3a937009d1e0 1073741824" returned: 0 in 0.519s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e8b4e896-a14f-42cb-ab46-aace6a2677b5 tempest-CreateVolumesFromImageTest-843695759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cb61d652-2a32-4266-8ac8-3a937009d1e0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:56 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cb61d652-2a32-4266-8ac8-3a937009d1e0 Sep 10 16:57:56 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-3de75d9c-3457-4efc-a900-3f0f81487968 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3de75d9c-3457-4efc-a900-3f0f81487968 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Flow 'volume_create_manager' (2b9d55e3-4b79-4a12-8d59-c9017e326721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3de75d9c-3457-4efc-a900-3f0f81487968 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d50deede-199e-4101-a41d-716d56b34953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3de75d9c-3457-4efc-a900-3f0f81487968 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d50deede-199e-4101-a41d-716d56b34953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1749369766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4588285a-3aa8-41a0-ab81-d4ad83a31583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651df1d6352e47aea56922d5c2943021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:57Z,use_quota=True,user_id='d3c7ff82f0594964b586230ee61e09ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3de75d9c-3457-4efc-a900-3f0f81487968 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81aa92f1-8812-4c47-bbea-285010a47db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3de75d9c-3457-4efc-a900-3f0f81487968 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81aa92f1-8812-4c47-bbea-285010a47db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3de75d9c-3457-4efc-a900-3f0f81487968 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9bd8db-856e-4293-a97a-d8b3f6e211c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3de75d9c-3457-4efc-a900-3f0f81487968 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9bd8db-856e-4293-a97a-d8b3f6e211c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4588285a-3aa8-41a0-ab81-d4ad83a31583', 'volume_name': 'volume-4588285a-3aa8-41a0-ab81-d4ad83a31583', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3de75d9c-3457-4efc-a900-3f0f81487968 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed3af7b-4228-4cb5-a736-13535c9141d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3de75d9c-3457-4efc-a900-3f0f81487968 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed3af7b-4228-4cb5-a736-13535c9141d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3de75d9c-3457-4efc-a900-3f0f81487968 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88cf817e-8edc-4734-b169-8c6b8e4d270d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:56 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-3de75d9c-3457-4efc-a900-3f0f81487968 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Volume 4588285a-3aa8-41a0-ab81-d4ad83a31583: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4588285a-3aa8-41a0-ab81-d4ad83a31583', 'volume_size': 1} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3de75d9c-3457-4efc-a900-3f0f81487968 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-104f86e4-63e4-4206-96cb-ec889eb4d9ab tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:57:56 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-104f86e4-63e4-4206-96cb-ec889eb4d9ab tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Flow 'volume_create_manager' (ab8dae76-af99-425a-a3de-dc0bcd22f58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-104f86e4-63e4-4206-96cb-ec889eb4d9ab tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b753f15-fff8-498c-92a6-764203036596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e8b4e896-a14f-42cb-ab46-aace6a2677b5 tempest-CreateVolumesFromImageTest-843695759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cb61d652-2a32-4266-8ac8-3a937009d1e0" returned: 0 in 0.312s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-e8b4e896-a14f-42cb-ab46-aace6a2677b5 tempest-CreateVolumesFromImageTest-843695759 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e8b4e896-a14f-42cb-ab46-aace6a2677b5 tempest-CreateVolumesFromImageTest-843695759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6d196cf9-0d71-44c8-a792-a7281a3f7381 tempest-CreateVolumesFromImageTest-843695759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.383s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6d196cf9-0d71-44c8-a792-a7281a3f7381 tempest-CreateVolumesFromImageTest-843695759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1191484871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcd3888d-5993-405c-b20c-b8522badc428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d312c275f0146538483173d3f73a947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:53Z,use_quota=True,user_id='ec95e003f89d4d85ae7f648a75d3ea41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-6d196cf9-0d71-44c8-a792-a7281a3f7381 tempest-CreateVolumesFromImageTest-843695759 None] Creating volume bcd3888d-5993-405c-b20c-b8522badc428 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6d196cf9-0d71-44c8-a792-a7281a3f7381 tempest-CreateVolumesFromImageTest-843695759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6d196cf9-0d71-44c8-a792-a7281a3f7381 tempest-CreateVolumesFromImageTest-843695759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6d196cf9-0d71-44c8-a792-a7281a3f7381 tempest-CreateVolumesFromImageTest-843695759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6d196cf9-0d71-44c8-a792-a7281a3f7381 tempest-CreateVolumesFromImageTest-843695759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6d196cf9-0d71-44c8-a792-a7281a3f7381 tempest-CreateVolumesFromImageTest-843695759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6d196cf9-0d71-44c8-a792-a7281a3f7381 tempest-CreateVolumesFromImageTest-843695759 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:57:56 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-6d196cf9-0d71-44c8-a792-a7281a3f7381 tempest-CreateVolumesFromImageTest-843695759 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6d196cf9-0d71-44c8-a792-a7281a3f7381 tempest-CreateVolumesFromImageTest-843695759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bcd3888d-5993-405c-b20c-b8522badc428 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-104f86e4-63e4-4206-96cb-ec889eb4d9ab tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b753f15-fff8-498c-92a6-764203036596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1329014915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3c579f-de68-4b47-aaaf-f6dd7fb1e969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651df1d6352e47aea56922d5c2943021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:57Z,use_quota=True,user_id='d3c7ff82f0594964b586230ee61e09ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-104f86e4-63e4-4206-96cb-ec889eb4d9ab tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91dc7bb8-421e-4a9a-a033-ead85406a251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:56 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bcd3888d-5993-405c-b20c-b8522badc428 1073741824 Sep 10 16:57:56 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-104f86e4-63e4-4206-96cb-ec889eb4d9ab tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91dc7bb8-421e-4a9a-a033-ead85406a251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-104f86e4-63e4-4206-96cb-ec889eb4d9ab tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef6961d0-afda-4e0f-948f-4c418058bf83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-104f86e4-63e4-4206-96cb-ec889eb4d9ab tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef6961d0-afda-4e0f-948f-4c418058bf83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d3c579f-de68-4b47-aaaf-f6dd7fb1e969', 'volume_name': 'volume-0d3c579f-de68-4b47-aaaf-f6dd7fb1e969', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:56 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-104f86e4-63e4-4206-96cb-ec889eb4d9ab tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cbc018f-2e41-4774-861b-d969a22bd7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-104f86e4-63e4-4206-96cb-ec889eb4d9ab tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cbc018f-2e41-4774-861b-d969a22bd7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-104f86e4-63e4-4206-96cb-ec889eb4d9ab tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7336cd51-e1a8-48c4-bd53-c67d51b0b863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:57 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-104f86e4-63e4-4206-96cb-ec889eb4d9ab tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Volume 0d3c579f-de68-4b47-aaaf-f6dd7fb1e969: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d3c579f-de68-4b47-aaaf-f6dd7fb1e969', 'volume_size': 1} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-104f86e4-63e4-4206-96cb-ec889eb4d9ab tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e19d10bd-0ab4-4d89-a726-9d5c01d7e18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6323f669-ab6a-4a99-9c1f-fece1c0597f2', 'volume_name': 'volume-6323f669-ab6a-4a99-9c1f-fece1c0597f2', 'volume_size': 1, 'image_id': 'a7f1d7fb-66a4-4376-a07f-79b134b81983', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7f1d7fb-66a4-4376-a07f-79b134b81983', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e8f8e8e6b4a39d8f9ca9f7a090b924d9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '50cf4050ca5644f0afa5039ef3a4c48a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c46585de935df7e0d199b588bea0d633ab464d39b3f18bb975368f3b27b0503519e793ccf53225cd9df2b89e50d84ed2e1634655f9d381f49f1cd0d4e25bef37', 'id': 'a7f1d7fb-66a4-4376-a07f-79b134b81983', 'created_at': datetime.datetime(2026, 9, 10, 14, 57, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 14, 57, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7f1d7fb-66a4-4376-a07f-79b134b81983/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a0f2ee2-de6c-4ca2-8707-4ea33b123a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a0f2ee2-de6c-4ca2-8707-4ea33b123a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a7fe3c-285e-46a5-ac34-d8e31b5052c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:57 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Volume 6323f669-ab6a-4a99-9c1f-fece1c0597f2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6323f669-ab6a-4a99-9c1f-fece1c0597f2', 'volume_size': 1, 'image_id': 'a7f1d7fb-66a4-4376-a07f-79b134b81983', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7f1d7fb-66a4-4376-a07f-79b134b81983', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e8f8e8e6b4a39d8f9ca9f7a090b924d9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '50cf4050ca5644f0afa5039ef3a4c48a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c46585de935df7e0d199b588bea0d633ab464d39b3f18bb975368f3b27b0503519e793ccf53225cd9df2b89e50d84ed2e1634655f9d381f49f1cd0d4e25bef37', 'id': 'a7f1d7fb-66a4-4376-a07f-79b134b81983', 'created_at': datetime.datetime(2026, 9, 10, 14, 57, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 14, 57, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7f1d7fb-66a4-4376-a07f-79b134b81983/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Trying to clone 6323f669-ab6a-4a99-9c1f-fece1c0597f2 from image a7f1d7fb-66a4-4376-a07f-79b134b81983 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a7f1d7fb-66a4-4376-a07f-79b134b81983', 'metadata': {}}]). {{(pid=88189) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e8b4e896-a14f-42cb-ab46-aace6a2677b5 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a0e50e1-f71a-4c25-9789-bde58f04c2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb61d652-2a32-4266-8ac8-3a937009d1e0', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e8b4e896-a14f-42cb-ab46-aace6a2677b5 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1f311f5-ffb7-4a2d-84b9-8234b0a97917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-04480767-6368-4026-8610-192ff8750832 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-04480767-6368-4026-8610-192ff8750832 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Flow 'volume_create_manager' (f3436d41-1cd9-40de-9c18-f8cc75e5c7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-04480767-6368-4026-8610-192ff8750832 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b56b8f5a-eb8f-48e9-ad43-ea8b619bc8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:57 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-e8b4e896-a14f-42cb-ab46-aace6a2677b5 tempest-CreateVolumesFromImageTest-843695759 None] Volume volume-cb61d652-2a32-4266-8ac8-3a937009d1e0 (cb61d652-2a32-4266-8ac8-3a937009d1e0): created successfully Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e8b4e896-a14f-42cb-ab46-aace6a2677b5 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1f311f5-ffb7-4a2d-84b9-8234b0a97917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e8b4e896-a14f-42cb-ab46-aace6a2677b5 tempest-CreateVolumesFromImageTest-843695759 None] Flow 'volume_create_manager' (4b275d9a-0e99-458f-9e87-389edc335f78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-04480767-6368-4026-8610-192ff8750832 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b56b8f5a-eb8f-48e9-ad43-ea8b619bc8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-253637491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9370698c-189a-428f-a594-f064db863774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651df1d6352e47aea56922d5c2943021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:57Z,use_quota=True,user_id='d3c7ff82f0594964b586230ee61e09ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-04480767-6368-4026-8610-192ff8750832 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f56ff02-baf7-4a2b-8a1e-29893d2f464a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-04480767-6368-4026-8610-192ff8750832 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f56ff02-baf7-4a2b-8a1e-29893d2f464a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-04480767-6368-4026-8610-192ff8750832 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b986f480-4cdd-46f6-8cf1-7203a9ca4f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-04480767-6368-4026-8610-192ff8750832 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b986f480-4cdd-46f6-8cf1-7203a9ca4f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9370698c-189a-428f-a594-f064db863774', 'volume_name': 'volume-9370698c-189a-428f-a594-f064db863774', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-04480767-6368-4026-8610-192ff8750832 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a027a167-4d98-4860-b11c-65e401a21637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-04480767-6368-4026-8610-192ff8750832 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a027a167-4d98-4860-b11c-65e401a21637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-04480767-6368-4026-8610-192ff8750832 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (971d46f8-09a3-4f58-9dd7-88898019aa71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:57 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-04480767-6368-4026-8610-192ff8750832 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Volume 9370698c-189a-428f-a594-f064db863774: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9370698c-189a-428f-a594-f064db863774', 'volume_size': 1} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-04480767-6368-4026-8610-192ff8750832 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:57 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-e8b4e896-a14f-42cb-ab46-aace6a2677b5 tempest-CreateVolumesFromImageTest-843695759 None] Created volume successfully. Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a7f1d7fb-66a4-4376-a07f-79b134b81983_gy3rgfijdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88189) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 16:57:57 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Image download 0.00 MB at 0.00 MB/s Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecdc5f0d-816a-42cc-8619-192a2a2b415b]: (4, 'raw') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f1d7fb-66a4-4376-a07f-79b134b81983_gy3rgfijdevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-265e2c0f-9d9b-4676-8601-4be84a8ad951 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-265e2c0f-9d9b-4676-8601-4be84a8ad951 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Flow 'volume_create_manager' (fc80ff6a-afcc-4110-85d6-9196cbbba3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-265e2c0f-9d9b-4676-8601-4be84a8ad951 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b871c4c-f2ea-4b4d-9477-69948fa59479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:57 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f1d7fb-66a4-4376-a07f-79b134b81983_gy3rgfijdevstack@QuobyteHD Sep 10 16:57:57 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-265e2c0f-9d9b-4676-8601-4be84a8ad951 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b871c4c-f2ea-4b4d-9477-69948fa59479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1538212365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=378b568d-168b-40d1-a3f0-3961f6ccb2d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651df1d6352e47aea56922d5c2943021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:57Z,use_quota=True,user_id='d3c7ff82f0594964b586230ee61e09ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-265e2c0f-9d9b-4676-8601-4be84a8ad951 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9b32d3d-6675-4276-9c2f-632bb10a98f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-265e2c0f-9d9b-4676-8601-4be84a8ad951 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9b32d3d-6675-4276-9c2f-632bb10a98f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-265e2c0f-9d9b-4676-8601-4be84a8ad951 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b93d57-0f0f-4906-8416-5cfe444a82fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-265e2c0f-9d9b-4676-8601-4be84a8ad951 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b93d57-0f0f-4906-8416-5cfe444a82fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '378b568d-168b-40d1-a3f0-3961f6ccb2d1', 'volume_name': 'volume-378b568d-168b-40d1-a3f0-3961f6ccb2d1', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-265e2c0f-9d9b-4676-8601-4be84a8ad951 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (883970bc-b947-4644-a759-306442500d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-265e2c0f-9d9b-4676-8601-4be84a8ad951 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (883970bc-b947-4644-a759-306442500d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-265e2c0f-9d9b-4676-8601-4be84a8ad951 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e64c41ef-05b6-4eeb-a0a6-58adf39e6bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:57 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-265e2c0f-9d9b-4676-8601-4be84a8ad951 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Volume 378b568d-168b-40d1-a3f0-3961f6ccb2d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-378b568d-168b-40d1-a3f0-3961f6ccb2d1', 'volume_size': 1} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-265e2c0f-9d9b-4676-8601-4be84a8ad951 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:57 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6d196cf9-0d71-44c8-a792-a7281a3f7381 tempest-CreateVolumesFromImageTest-843695759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bcd3888d-5993-405c-b20c-b8522badc428 1073741824" returned: 0 in 0.665s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6d196cf9-0d71-44c8-a792-a7281a3f7381 tempest-CreateVolumesFromImageTest-843695759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bcd3888d-5993-405c-b20c-b8522badc428 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:57 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bcd3888d-5993-405c-b20c-b8522badc428 Sep 10 16:57:57 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:57 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f1d7fb-66a4-4376-a07f-79b134b81983_gy3rgfijdevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f1d7fb-66a4-4376-a07f-79b134b81983_gy3rgfijdevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-33bfbb33-60e5-4717-9fe1-525bb382080b tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:57:57 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f1d7fb-66a4-4376-a07f-79b134b81983_gy3rgfijdevstack@QuobyteHD Sep 10 16:57:57 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-33bfbb33-60e5-4717-9fe1-525bb382080b tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Flow 'volume_create_manager' (a8b2cb96-c764-4bb7-b748-3daf23ffccab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-33bfbb33-60e5-4717-9fe1-525bb382080b tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e570dd03-4916-495d-87f9-7727ed013288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-33bfbb33-60e5-4717-9fe1-525bb382080b tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e570dd03-4916-495d-87f9-7727ed013288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1526123002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ed48b7b-1722-4eff-a1cf-6ad1d85835f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651df1d6352e47aea56922d5c2943021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:58Z,use_quota=True,user_id='d3c7ff82f0594964b586230ee61e09ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-33bfbb33-60e5-4717-9fe1-525bb382080b tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e945eaa-1f89-4c6a-ae41-3e72cc025315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-33bfbb33-60e5-4717-9fe1-525bb382080b tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e945eaa-1f89-4c6a-ae41-3e72cc025315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-33bfbb33-60e5-4717-9fe1-525bb382080b tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81620716-8a73-4908-aad7-240042d9e84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-33bfbb33-60e5-4717-9fe1-525bb382080b tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81620716-8a73-4908-aad7-240042d9e84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ed48b7b-1722-4eff-a1cf-6ad1d85835f1', 'volume_name': 'volume-2ed48b7b-1722-4eff-a1cf-6ad1d85835f1', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-33bfbb33-60e5-4717-9fe1-525bb382080b tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd20c8f2-7020-47b3-8cc1-57b28005376d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:57 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-33bfbb33-60e5-4717-9fe1-525bb382080b tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd20c8f2-7020-47b3-8cc1-57b28005376d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-33bfbb33-60e5-4717-9fe1-525bb382080b tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a697a03-0215-4f66-8895-38cab505770c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:57 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-33bfbb33-60e5-4717-9fe1-525bb382080b tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Volume 2ed48b7b-1722-4eff-a1cf-6ad1d85835f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ed48b7b-1722-4eff-a1cf-6ad1d85835f1', 'volume_size': 1} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-33bfbb33-60e5-4717-9fe1-525bb382080b tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6d196cf9-0d71-44c8-a792-a7281a3f7381 tempest-CreateVolumesFromImageTest-843695759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bcd3888d-5993-405c-b20c-b8522badc428" returned: 0 in 0.286s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6d196cf9-0d71-44c8-a792-a7281a3f7381 tempest-CreateVolumesFromImageTest-843695759 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6d196cf9-0d71-44c8-a792-a7281a3f7381 tempest-CreateVolumesFromImageTest-843695759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-60682dde-4b7b-4194-962c-1e8c8c9afd79 tempest-VolumeDependencyTests-1552907241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.709s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d196cf9-0d71-44c8-a792-a7281a3f7381 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b6a1f0-a69c-4282-9092-6763c8792880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcd3888d-5993-405c-b20c-b8522badc428', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d196cf9-0d71-44c8-a792-a7281a3f7381 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c64de2ab-4013-475f-bc39-ba4bcad263c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-60682dde-4b7b-4194-962c-1e8c8c9afd79 tempest-VolumeDependencyTests-1552907241 None] Creating offline snapshot e73cb5d4-cec6-46ad-9eab-2ed1f28c5262 of volume 94917c13-8ff3-4652-a116-abe3a2e80337 {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:57:57 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-6d196cf9-0d71-44c8-a792-a7281a3f7381 tempest-CreateVolumesFromImageTest-843695759 None] Volume volume-bcd3888d-5993-405c-b20c-b8522badc428 (bcd3888d-5993-405c-b20c-b8522badc428): created successfully Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d196cf9-0d71-44c8-a792-a7281a3f7381 tempest-CreateVolumesFromImageTest-843695759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c64de2ab-4013-475f-bc39-ba4bcad263c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6d196cf9-0d71-44c8-a792-a7281a3f7381 tempest-CreateVolumesFromImageTest-843695759 None] Flow 'volume_create_manager' (fe468562-eb1c-4f6d-95e7-f90ba107d09e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3260b0f9-a801-4fe5-861a-f74ddb4bc8ea]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:57:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-60682dde-4b7b-4194-962c-1e8c8c9afd79 tempest-VolumeDependencyTests-1552907241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:58 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-6d196cf9-0d71-44c8-a792-a7281a3f7381 tempest-CreateVolumesFromImageTest-843695759 None] Created volume successfully. Sep 10 16:57:58 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f1d7fb-66a4-4376-a07f-79b134b81983_gy3rgfijdevstack@QuobyteHD" returned: 1 in 0.348s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f1d7fb-66a4-4376-a07f-79b134b81983_gy3rgfijdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 16:57:58 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Temporary image a7f1d7fb-66a4-4376-a07f-79b134b81983 is fetched for user 32e2041bd4434cbfb3ecc1ab2a32e1b9. {{(pid=88189) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 16:57:58 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337 Sep 10 16:57:58 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:58 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[488b3c6c-e8cf-400b-9fce-ec824397b410]: (4, 'raw') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:57:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f1d7fb-66a4-4376-a07f-79b134b81983_gy3rgfijdevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:58 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8b8dbc22-c6d1-41c9-abb8-340a145e22ac tempest-CreateVolumesFromImageTest-843695759 None] Acquiring lock "cinder-bcd3888d-5993-405c-b20c-b8522badc428-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:57:58 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f1d7fb-66a4-4376-a07f-79b134b81983_gy3rgfijdevstack@QuobyteHD Sep 10 16:57:58 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:58 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8b8dbc22-c6d1-41c9-abb8-340a145e22ac tempest-CreateVolumesFromImageTest-843695759 None] Lock "cinder-bcd3888d-5993-405c-b20c-b8522badc428-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:57:58 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8b8dbc22-c6d1-41c9-abb8-340a145e22ac tempest-CreateVolumesFromImageTest-843695759 None] Acquiring lock "cinder-quobyte-bcd3888d-5993-405c-b20c-b8522badc428" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:57:58 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8b8dbc22-c6d1-41c9-abb8-340a145e22ac tempest-CreateVolumesFromImageTest-843695759 None] Lock "cinder-quobyte-bcd3888d-5993-405c-b20c-b8522badc428" acquired by "delete_volume" :: waited 0.036s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:57:58 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8052bc4-db0a-46dd-9f35-62085cc423a8]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:57:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8b8dbc22-c6d1-41c9-abb8-340a145e22ac tempest-CreateVolumesFromImageTest-843695759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bcd3888d-5993-405c-b20c-b8522badc428 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:58 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-60682dde-4b7b-4194-962c-1e8c8c9afd79 tempest-VolumeDependencyTests-1552907241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337" returned: 0 in 0.466s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-60682dde-4b7b-4194-962c-1e8c8c9afd79 tempest-VolumeDependencyTests-1552907241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337.e73cb5d4-cec6-46ad-9eab-2ed1f28c5262 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:58 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337.e73cb5d4-cec6-46ad-9eab-2ed1f28c5262 1G Sep 10 16:57:58 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:58 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bcd3888d-5993-405c-b20c-b8522badc428 Sep 10 16:57:58 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:58 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f1d7fb-66a4-4376-a07f-79b134b81983_gy3rgfijdevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f1d7fb-66a4-4376-a07f-79b134b81983_gy3rgfijdevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:58 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f1d7fb-66a4-4376-a07f-79b134b81983_gy3rgfijdevstack@QuobyteHD Sep 10 16:57:58 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:58 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8b8dbc22-c6d1-41c9-abb8-340a145e22ac tempest-CreateVolumesFromImageTest-843695759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bcd3888d-5993-405c-b20c-b8522badc428" returned: 0 in 0.422s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8b8dbc22-c6d1-41c9-abb8-340a145e22ac tempest-CreateVolumesFromImageTest-843695759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bcd3888d-5993-405c-b20c-b8522badc428 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:58 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bcd3888d-5993-405c-b20c-b8522badc428 Sep 10 16:57:58 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:58 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:58 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f1d7fb-66a4-4376-a07f-79b134b81983_gy3rgfijdevstack@QuobyteHD" returned: 1 in 0.358s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f1d7fb-66a4-4376-a07f-79b134b81983_gy3rgfijdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 16:57:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-60682dde-4b7b-4194-962c-1e8c8c9afd79 tempest-VolumeDependencyTests-1552907241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337.e73cb5d4-cec6-46ad-9eab-2ed1f28c5262 1G" returned: 0 in 0.474s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-60682dde-4b7b-4194-962c-1e8c8c9afd79 tempest-VolumeDependencyTests-1552907241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94917c13-8ff3-4652-a116-abe3a2e80337 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337.e73cb5d4-cec6-46ad-9eab-2ed1f28c5262 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:58 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94917c13-8ff3-4652-a116-abe3a2e80337 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337.e73cb5d4-cec6-46ad-9eab-2ed1f28c5262 Sep 10 16:57:58 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:59 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8b8dbc22-c6d1-41c9-abb8-340a145e22ac tempest-CreateVolumesFromImageTest-843695759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bcd3888d-5993-405c-b20c-b8522badc428" returned: 0 in 0.267s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:59 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8b8dbc22-c6d1-41c9-abb8-340a145e22ac tempest-CreateVolumesFromImageTest-843695759 None] Lock "cinder-quobyte-bcd3888d-5993-405c-b20c-b8522badc428" released by "delete_volume" :: held 0.749s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:57:59 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-8b8dbc22-c6d1-41c9-abb8-340a145e22ac tempest-CreateVolumesFromImageTest-843695759 None] Created reservations ['6936cf34-5853-49cd-8138-3dba2e00bd46', '9bf28a83-26bc-4aff-8b54-24d8ce60efdb', 'd96271d0-3805-47b7-91c1-8fbea8263da2', '3bfad6a6-31b2-4ac5-bf64-ef57875390a6'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:57:59 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-60682dde-4b7b-4194-962c-1e8c8c9afd79 tempest-VolumeDependencyTests-1552907241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94917c13-8ff3-4652-a116-abe3a2e80337 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337.e73cb5d4-cec6-46ad-9eab-2ed1f28c5262" returned: 0 in 0.306s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:59 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-60682dde-4b7b-4194-962c-1e8c8c9afd79 tempest-VolumeDependencyTests-1552907241 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337.e73cb5d4-cec6-46ad-9eab-2ed1f28c5262 is being set with open permissions: ugo+rw Sep 10 16:57:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-60682dde-4b7b-4194-962c-1e8c8c9afd79 tempest-VolumeDependencyTests-1552907241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337.e73cb5d4-cec6-46ad-9eab-2ed1f28c5262 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8b8dbc22-c6d1-41c9-abb8-340a145e22ac tempest-CreateVolumesFromImageTest-843695759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:57:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8b8dbc22-c6d1-41c9-abb8-340a145e22ac tempest-CreateVolumesFromImageTest-843695759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:57:59 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337.e73cb5d4-cec6-46ad-9eab-2ed1f28c5262 Sep 10 16:57:59 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8b8dbc22-c6d1-41c9-abb8-340a145e22ac tempest-CreateVolumesFromImageTest-843695759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:57:59 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:59 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8b8dbc22-c6d1-41c9-abb8-340a145e22ac tempest-CreateVolumesFromImageTest-843695759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:57:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8b8dbc22-c6d1-41c9-abb8-340a145e22ac tempest-CreateVolumesFromImageTest-843695759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:57:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8b8dbc22-c6d1-41c9-abb8-340a145e22ac tempest-CreateVolumesFromImageTest-843695759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:59 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:57:59 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:59 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-60682dde-4b7b-4194-962c-1e8c8c9afd79 tempest-VolumeDependencyTests-1552907241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337.e73cb5d4-cec6-46ad-9eab-2ed1f28c5262" returned: 0 in 0.271s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:59 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-673f4a04-4815-48ef-99d9-32b8b74a470d tempest-CreateVolumesFromImageTest-843695759 None] Acquiring lock "cinder-cb61d652-2a32-4266-8ac8-3a937009d1e0-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:57:59 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8b8dbc22-c6d1-41c9-abb8-340a145e22ac tempest-CreateVolumesFromImageTest-843695759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.276s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:59 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-8b8dbc22-c6d1-41c9-abb8-340a145e22ac tempest-CreateVolumesFromImageTest-843695759 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:57:59 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-673f4a04-4815-48ef-99d9-32b8b74a470d tempest-CreateVolumesFromImageTest-843695759 None] Lock "cinder-cb61d652-2a32-4266-8ac8-3a937009d1e0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:57:59 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-8b8dbc22-c6d1-41c9-abb8-340a145e22ac tempest-CreateVolumesFromImageTest-843695759 None] Deleted volume successfully. Sep 10 16:57:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-60682dde-4b7b-4194-962c-1e8c8c9afd79 tempest-VolumeDependencyTests-1552907241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:59 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337.info Sep 10 16:57:59 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:59 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8b8dbc22-c6d1-41c9-abb8-340a145e22ac tempest-CreateVolumesFromImageTest-843695759 None] Lock "cinder-bcd3888d-5993-405c-b20c-b8522badc428-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:57:59 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-673f4a04-4815-48ef-99d9-32b8b74a470d tempest-CreateVolumesFromImageTest-843695759 None] Acquiring lock "cinder-quobyte-cb61d652-2a32-4266-8ac8-3a937009d1e0" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:57:59 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-673f4a04-4815-48ef-99d9-32b8b74a470d tempest-CreateVolumesFromImageTest-843695759 None] Lock "cinder-quobyte-cb61d652-2a32-4266-8ac8-3a937009d1e0" acquired by "delete_volume" :: waited 0.017s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:57:59 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3615b8c-c185-4518-8f7f-b60b32743bd2]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:57:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-673f4a04-4815-48ef-99d9-32b8b74a470d tempest-CreateVolumesFromImageTest-843695759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cb61d652-2a32-4266-8ac8-3a937009d1e0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:59 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cb61d652-2a32-4266-8ac8-3a937009d1e0 Sep 10 16:57:59 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:57:59 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Sep 10 16:57:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-60682dde-4b7b-4194-962c-1e8c8c9afd79 tempest-VolumeDependencyTests-1552907241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337.info" returned: 0 in 0.270s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:57:59 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-60682dde-4b7b-4194-962c-1e8c8c9afd79 tempest-VolumeDependencyTests-1552907241 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337.info is being set with open permissions: ugo+rw Sep 10 16:57:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-60682dde-4b7b-4194-962c-1e8c8c9afd79 tempest-VolumeDependencyTests-1552907241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:57:59 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337.info Sep 10 16:57:59 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:00 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-673f4a04-4815-48ef-99d9-32b8b74a470d tempest-CreateVolumesFromImageTest-843695759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cb61d652-2a32-4266-8ac8-3a937009d1e0" returned: 0 in 0.369s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-673f4a04-4815-48ef-99d9-32b8b74a470d tempest-CreateVolumesFromImageTest-843695759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cb61d652-2a32-4266-8ac8-3a937009d1e0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:00 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cb61d652-2a32-4266-8ac8-3a937009d1e0 Sep 10 16:58:00 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:00 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-60682dde-4b7b-4194-962c-1e8c8c9afd79 tempest-VolumeDependencyTests-1552907241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337.info" returned: 0 in 0.265s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-60682dde-4b7b-4194-962c-1e8c8c9afd79 tempest-VolumeDependencyTests-1552907241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.205s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3de75d9c-3457-4efc-a900-3f0f81487968 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.291s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:00 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3de75d9c-3457-4efc-a900-3f0f81487968 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1749369766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4588285a-3aa8-41a0-ab81-d4ad83a31583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651df1d6352e47aea56922d5c2943021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:57Z,use_quota=True,user_id='d3c7ff82f0594964b586230ee61e09ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:58:00 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-3de75d9c-3457-4efc-a900-3f0f81487968 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Creating volume 4588285a-3aa8-41a0-ab81-d4ad83a31583 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:58:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3de75d9c-3457-4efc-a900-3f0f81487968 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3de75d9c-3457-4efc-a900-3f0f81487968 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:00 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3de75d9c-3457-4efc-a900-3f0f81487968 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:00 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3de75d9c-3457-4efc-a900-3f0f81487968 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3de75d9c-3457-4efc-a900-3f0f81487968 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:00 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3de75d9c-3457-4efc-a900-3f0f81487968 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:58:00 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-3de75d9c-3457-4efc-a900-3f0f81487968 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:58:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3de75d9c-3457-4efc-a900-3f0f81487968 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4588285a-3aa8-41a0-ab81-d4ad83a31583 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:00 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4588285a-3aa8-41a0-ab81-d4ad83a31583 1073741824 Sep 10 16:58:00 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:00 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-60682dde-4b7b-4194-962c-1e8c8c9afd79 tempest-VolumeDependencyTests-1552907241 None] Create snapshot completed successfully Sep 10 16:58:00 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-673f4a04-4815-48ef-99d9-32b8b74a470d tempest-CreateVolumesFromImageTest-843695759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-cb61d652-2a32-4266-8ac8-3a937009d1e0" returned: 0 in 0.275s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:00 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-673f4a04-4815-48ef-99d9-32b8b74a470d tempest-CreateVolumesFromImageTest-843695759 None] Lock "cinder-quobyte-cb61d652-2a32-4266-8ac8-3a937009d1e0" released by "delete_volume" :: held 0.681s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:00 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-673f4a04-4815-48ef-99d9-32b8b74a470d tempest-CreateVolumesFromImageTest-843695759 None] Created reservations ['bda91fd6-a0af-4653-8024-c7b34001813c', '61b29019-f77b-488b-93e4-72291e4ab026', '85c4d66f-95c9-47aa-8eee-3e09b799adce', '202427ba-9038-4aff-b6ac-63651b4d3c74'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:58:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-673f4a04-4815-48ef-99d9-32b8b74a470d tempest-CreateVolumesFromImageTest-843695759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-673f4a04-4815-48ef-99d9-32b8b74a470d tempest-CreateVolumesFromImageTest-843695759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:00 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-673f4a04-4815-48ef-99d9-32b8b74a470d tempest-CreateVolumesFromImageTest-843695759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:00 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-673f4a04-4815-48ef-99d9-32b8b74a470d tempest-CreateVolumesFromImageTest-843695759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-673f4a04-4815-48ef-99d9-32b8b74a470d tempest-CreateVolumesFromImageTest-843695759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-673f4a04-4815-48ef-99d9-32b8b74a470d tempest-CreateVolumesFromImageTest-843695759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:00 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:58:00 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:00 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3de75d9c-3457-4efc-a900-3f0f81487968 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4588285a-3aa8-41a0-ab81-d4ad83a31583 1073741824" returned: 0 in 0.481s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3de75d9c-3457-4efc-a900-3f0f81487968 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4588285a-3aa8-41a0-ab81-d4ad83a31583 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:00 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-1d5d79c8-b407-46c5-bfd3-c529d70a1569 tempest-CreateVolumesFromImageTest-843695759 None] Acquiring lock "cinder-f2bf43ec-1cb6-40ae-beb6-db2995a1655c-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:00 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4588285a-3aa8-41a0-ab81-d4ad83a31583 Sep 10 16:58:00 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:00 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-1d5d79c8-b407-46c5-bfd3-c529d70a1569 tempest-CreateVolumesFromImageTest-843695759 None] Lock "cinder-f2bf43ec-1cb6-40ae-beb6-db2995a1655c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:00 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-673f4a04-4815-48ef-99d9-32b8b74a470d tempest-CreateVolumesFromImageTest-843695759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.339s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:00 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-673f4a04-4815-48ef-99d9-32b8b74a470d tempest-CreateVolumesFromImageTest-843695759 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:58:00 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-673f4a04-4815-48ef-99d9-32b8b74a470d tempest-CreateVolumesFromImageTest-843695759 None] Deleted volume successfully. Sep 10 16:58:00 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-1d5d79c8-b407-46c5-bfd3-c529d70a1569 tempest-CreateVolumesFromImageTest-843695759 None] Acquiring lock "cinder-quobyte-f2bf43ec-1cb6-40ae-beb6-db2995a1655c" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:00 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-673f4a04-4815-48ef-99d9-32b8b74a470d tempest-CreateVolumesFromImageTest-843695759 None] Lock "cinder-cb61d652-2a32-4266-8ac8-3a937009d1e0-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:00 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-1d5d79c8-b407-46c5-bfd3-c529d70a1569 tempest-CreateVolumesFromImageTest-843695759 None] Lock "cinder-quobyte-f2bf43ec-1cb6-40ae-beb6-db2995a1655c" acquired by "delete_volume" :: waited 0.019s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:00 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45b5ad0-bafb-4f26-8a21-3e9f3725dd76]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1d5d79c8-b407-46c5-bfd3-c529d70a1569 tempest-CreateVolumesFromImageTest-843695759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f2bf43ec-1cb6-40ae-beb6-db2995a1655c {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:01 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3de75d9c-3457-4efc-a900-3f0f81487968 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4588285a-3aa8-41a0-ab81-d4ad83a31583" returned: 0 in 0.328s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:01 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f2bf43ec-1cb6-40ae-beb6-db2995a1655c Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3de75d9c-3457-4efc-a900-3f0f81487968 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:58:01 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3de75d9c-3457-4efc-a900-3f0f81487968 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-104f86e4-63e4-4206-96cb-ec889eb4d9ab tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.032s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-104f86e4-63e4-4206-96cb-ec889eb4d9ab tempest-CreateVolumesFromSourceVolumeTest-738548049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1329014915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3c579f-de68-4b47-aaaf-f6dd7fb1e969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651df1d6352e47aea56922d5c2943021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:57Z,use_quota=True,user_id='d3c7ff82f0594964b586230ee61e09ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-104f86e4-63e4-4206-96cb-ec889eb4d9ab tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Creating volume 0d3c579f-de68-4b47-aaaf-f6dd7fb1e969 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-104f86e4-63e4-4206-96cb-ec889eb4d9ab tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-104f86e4-63e4-4206-96cb-ec889eb4d9ab tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-104f86e4-63e4-4206-96cb-ec889eb4d9ab tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-104f86e4-63e4-4206-96cb-ec889eb4d9ab tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-104f86e4-63e4-4206-96cb-ec889eb4d9ab tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-104f86e4-63e4-4206-96cb-ec889eb4d9ab tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:58:01 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-104f86e4-63e4-4206-96cb-ec889eb4d9ab tempest-CreateVolumesFromSourceVolumeTest-738548049 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-104f86e4-63e4-4206-96cb-ec889eb4d9ab tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0d3c579f-de68-4b47-aaaf-f6dd7fb1e969 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:01 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0d3c579f-de68-4b47-aaaf-f6dd7fb1e969 1073741824 Sep 10 16:58:01 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3de75d9c-3457-4efc-a900-3f0f81487968 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88cf817e-8edc-4734-b169-8c6b8e4d270d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4588285a-3aa8-41a0-ab81-d4ad83a31583', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3de75d9c-3457-4efc-a900-3f0f81487968 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0279dd89-a6c1-42fc-96dd-65f6cce22a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:01 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-3de75d9c-3457-4efc-a900-3f0f81487968 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Volume volume-4588285a-3aa8-41a0-ab81-d4ad83a31583 (4588285a-3aa8-41a0-ab81-d4ad83a31583): created successfully Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3de75d9c-3457-4efc-a900-3f0f81487968 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0279dd89-a6c1-42fc-96dd-65f6cce22a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3de75d9c-3457-4efc-a900-3f0f81487968 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Flow 'volume_create_manager' (2b9d55e3-4b79-4a12-8d59-c9017e326721) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:01 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-3de75d9c-3457-4efc-a900-3f0f81487968 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Created volume successfully. Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Flow 'volume_create_manager' (5d877c81-70d7-4d99-a2ee-23e339aa3dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a29f392-d1fa-4664-a454-98e00fc84673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a29f392-d1fa-4664-a454-98e00fc84673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-978192668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98efc725-c418-4a35-88bd-c8e4f00d2389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='999d16fcc2da463aa14d52ce1e240d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e73cb5d4-cec6-46ad-9eab-2ed1f28c5262,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:01Z,use_quota=True,user_id='8b90e7cc938b4bc0bbd4f4be72ca19f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (915f193b-bea8-4052-9801-cd7ebbd5e2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (915f193b-bea8-4052-9801-cd7ebbd5e2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef4e1472-f591-42b3-9a95-6d7102d81d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef4e1472-f591-42b3-9a95-6d7102d81d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '98efc725-c418-4a35-88bd-c8e4f00d2389', 'volume_name': 'volume-98efc725-c418-4a35-88bd-c8e4f00d2389', 'volume_size': 1, 'snapshot_id': 'e73cb5d4-cec6-46ad-9eab-2ed1f28c5262'}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0648f9bd-b385-49b6-ab47-1c3e0ec0b409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0648f9bd-b385-49b6-ab47-1c3e0ec0b409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ad17fb-e4d1-46b5-bcaf-29eec2c2d050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:01 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Volume 98efc725-c418-4a35-88bd-c8e4f00d2389: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-98efc725-c418-4a35-88bd-c8e4f00d2389', 'volume_size': 1, 'snapshot_id': 'e73cb5d4-cec6-46ad-9eab-2ed1f28c5262'} Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:01 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1d5d79c8-b407-46c5-bfd3-c529d70a1569 tempest-CreateVolumesFromImageTest-843695759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f2bf43ec-1cb6-40ae-beb6-db2995a1655c" returned: 0 in 0.495s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1d5d79c8-b407-46c5-bfd3-c529d70a1569 tempest-CreateVolumesFromImageTest-843695759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f2bf43ec-1cb6-40ae-beb6-db2995a1655c {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:01 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f2bf43ec-1cb6-40ae-beb6-db2995a1655c Sep 10 16:58:01 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:01 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-104f86e4-63e4-4206-96cb-ec889eb4d9ab tempest-CreateVolumesFromSourceVolumeTest-738548049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0d3c579f-de68-4b47-aaaf-f6dd7fb1e969 1073741824" returned: 0 in 0.600s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-104f86e4-63e4-4206-96cb-ec889eb4d9ab tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0d3c579f-de68-4b47-aaaf-f6dd7fb1e969 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:01 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1d5d79c8-b407-46c5-bfd3-c529d70a1569 tempest-CreateVolumesFromImageTest-843695759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-f2bf43ec-1cb6-40ae-beb6-db2995a1655c" returned: 0 in 0.310s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:01 devstack sudo[107875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0d3c579f-de68-4b47-aaaf-f6dd7fb1e969 Sep 10 16:58:01 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-1d5d79c8-b407-46c5-bfd3-c529d70a1569 tempest-CreateVolumesFromImageTest-843695759 None] Lock "cinder-quobyte-f2bf43ec-1cb6-40ae-beb6-db2995a1655c" released by "delete_volume" :: held 0.874s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-1d5d79c8-b407-46c5-bfd3-c529d70a1569 tempest-CreateVolumesFromImageTest-843695759 None] Created reservations ['b812d8d0-eb24-4145-b1ee-b50b5e6b0270', '00b3c712-08fa-47c3-bdf0-430bbb19ec27', '68d4b68d-2fc3-49c0-ad05-b88a20656d05', '65557299-01df-41d1-8f6a-15f96381f888'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-1d5d79c8-b407-46c5-bfd3-c529d70a1569 tempest-CreateVolumesFromImageTest-843695759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-1d5d79c8-b407-46c5-bfd3-c529d70a1569 tempest-CreateVolumesFromImageTest-843695759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-1d5d79c8-b407-46c5-bfd3-c529d70a1569 tempest-CreateVolumesFromImageTest-843695759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-1d5d79c8-b407-46c5-bfd3-c529d70a1569 tempest-CreateVolumesFromImageTest-843695759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-1d5d79c8-b407-46c5-bfd3-c529d70a1569 tempest-CreateVolumesFromImageTest-843695759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1d5d79c8-b407-46c5-bfd3-c529d70a1569 tempest-CreateVolumesFromImageTest-843695759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:01 devstack sudo[107877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:58:01 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:01 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-ed31150f-9efc-41a7-8137-ad1d8a257f78 tempest-CreateVolumesFromImageTest-843695759 None] Acquiring lock "cinder-7cab3e7b-fc26-41bd-961d-4336b781b1ed-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-ed31150f-9efc-41a7-8137-ad1d8a257f78 tempest-CreateVolumesFromImageTest-843695759 None] Lock "cinder-7cab3e7b-fc26-41bd-961d-4336b781b1ed-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-ed31150f-9efc-41a7-8137-ad1d8a257f78 tempest-CreateVolumesFromImageTest-843695759 None] Acquiring lock "cinder-quobyte-7cab3e7b-fc26-41bd-961d-4336b781b1ed" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:02 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-104f86e4-63e4-4206-96cb-ec889eb4d9ab tempest-CreateVolumesFromSourceVolumeTest-738548049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0d3c579f-de68-4b47-aaaf-f6dd7fb1e969" returned: 0 in 0.379s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-104f86e4-63e4-4206-96cb-ec889eb4d9ab tempest-CreateVolumesFromSourceVolumeTest-738548049 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-104f86e4-63e4-4206-96cb-ec889eb4d9ab tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-ed31150f-9efc-41a7-8137-ad1d8a257f78 tempest-CreateVolumesFromImageTest-843695759 None] Lock "cinder-quobyte-7cab3e7b-fc26-41bd-961d-4336b781b1ed" acquired by "delete_volume" :: waited 0.023s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-04480767-6368-4026-8610-192ff8750832 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.888s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-04480767-6368-4026-8610-192ff8750832 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-253637491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9370698c-189a-428f-a594-f064db863774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651df1d6352e47aea56922d5c2943021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:57Z,use_quota=True,user_id='d3c7ff82f0594964b586230ee61e09ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-04480767-6368-4026-8610-192ff8750832 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Creating volume 9370698c-189a-428f-a594-f064db863774 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-04480767-6368-4026-8610-192ff8750832 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-04480767-6368-4026-8610-192ff8750832 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-04480767-6368-4026-8610-192ff8750832 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-04480767-6368-4026-8610-192ff8750832 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-04480767-6368-4026-8610-192ff8750832 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-04480767-6368-4026-8610-192ff8750832 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:58:02 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-04480767-6368-4026-8610-192ff8750832 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-04480767-6368-4026-8610-192ff8750832 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9370698c-189a-428f-a594-f064db863774 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7c25ba-7c7b-4bde-84e6-7c151b1b9b62]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed31150f-9efc-41a7-8137-ad1d8a257f78 tempest-CreateVolumesFromImageTest-843695759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7cab3e7b-fc26-41bd-961d-4336b781b1ed {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:02 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9370698c-189a-428f-a594-f064db863774 1073741824 Sep 10 16:58:02 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-104f86e4-63e4-4206-96cb-ec889eb4d9ab tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7336cd51-e1a8-48c4-bd53-c67d51b0b863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d3c579f-de68-4b47-aaaf-f6dd7fb1e969', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-104f86e4-63e4-4206-96cb-ec889eb4d9ab tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb9ac24-5d1f-4fb6-8c6f-be889a8487e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:02 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-104f86e4-63e4-4206-96cb-ec889eb4d9ab tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Volume volume-0d3c579f-de68-4b47-aaaf-f6dd7fb1e969 (0d3c579f-de68-4b47-aaaf-f6dd7fb1e969): created successfully Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-104f86e4-63e4-4206-96cb-ec889eb4d9ab tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb9ac24-5d1f-4fb6-8c6f-be889a8487e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-104f86e4-63e4-4206-96cb-ec889eb4d9ab tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Flow 'volume_create_manager' (ab8dae76-af99-425a-a3de-dc0bcd22f58c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:02 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-104f86e4-63e4-4206-96cb-ec889eb4d9ab tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Created volume successfully. Sep 10 16:58:02 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7cab3e7b-fc26-41bd-961d-4336b781b1ed Sep 10 16:58:02 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:02 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-1d5d79c8-b407-46c5-bfd3-c529d70a1569 tempest-CreateVolumesFromImageTest-843695759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.387s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-1d5d79c8-b407-46c5-bfd3-c529d70a1569 tempest-CreateVolumesFromImageTest-843695759 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:58:02 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-1d5d79c8-b407-46c5-bfd3-c529d70a1569 tempest-CreateVolumesFromImageTest-843695759 None] Deleted volume successfully. Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-1d5d79c8-b407-46c5-bfd3-c529d70a1569 tempest-CreateVolumesFromImageTest-843695759 None] Lock "cinder-f2bf43ec-1cb6-40ae-beb6-db2995a1655c-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:02 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed31150f-9efc-41a7-8137-ad1d8a257f78 tempest-CreateVolumesFromImageTest-843695759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7cab3e7b-fc26-41bd-961d-4336b781b1ed" returned: 0 in 0.383s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed31150f-9efc-41a7-8137-ad1d8a257f78 tempest-CreateVolumesFromImageTest-843695759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7cab3e7b-fc26-41bd-961d-4336b781b1ed {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:02 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7cab3e7b-fc26-41bd-961d-4336b781b1ed Sep 10 16:58:02 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:02 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-04480767-6368-4026-8610-192ff8750832 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9370698c-189a-428f-a594-f064db863774 1073741824" returned: 0 in 0.490s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-04480767-6368-4026-8610-192ff8750832 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9370698c-189a-428f-a594-f064db863774 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:02 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9370698c-189a-428f-a594-f064db863774 Sep 10 16:58:02 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:02 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed31150f-9efc-41a7-8137-ad1d8a257f78 tempest-CreateVolumesFromImageTest-843695759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7cab3e7b-fc26-41bd-961d-4336b781b1ed" returned: 0 in 0.275s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-ed31150f-9efc-41a7-8137-ad1d8a257f78 tempest-CreateVolumesFromImageTest-843695759 None] Lock "cinder-quobyte-7cab3e7b-fc26-41bd-961d-4336b781b1ed" released by "delete_volume" :: held 0.719s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-ed31150f-9efc-41a7-8137-ad1d8a257f78 tempest-CreateVolumesFromImageTest-843695759 None] Created reservations ['6f0733a0-fe8a-4098-8632-7bf70923cd07', '3f68e38f-ea9b-4e44-af8e-8b1e33bc039e', '46d580e8-8b85-46d5-bdef-a6d21c1b027d', 'a091ff94-f114-48ae-8fee-674556b4f198'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:58:02 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-04480767-6368-4026-8610-192ff8750832 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9370698c-189a-428f-a594-f064db863774" returned: 0 in 0.265s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-04480767-6368-4026-8610-192ff8750832 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-04480767-6368-4026-8610-192ff8750832 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-265e2c0f-9d9b-4676-8601-4be84a8ad951 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.375s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-265e2c0f-9d9b-4676-8601-4be84a8ad951 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1538212365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=378b568d-168b-40d1-a3f0-3961f6ccb2d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651df1d6352e47aea56922d5c2943021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:57Z,use_quota=True,user_id='d3c7ff82f0594964b586230ee61e09ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-265e2c0f-9d9b-4676-8601-4be84a8ad951 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Creating volume 378b568d-168b-40d1-a3f0-3961f6ccb2d1 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-265e2c0f-9d9b-4676-8601-4be84a8ad951 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-265e2c0f-9d9b-4676-8601-4be84a8ad951 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-265e2c0f-9d9b-4676-8601-4be84a8ad951 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-265e2c0f-9d9b-4676-8601-4be84a8ad951 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-265e2c0f-9d9b-4676-8601-4be84a8ad951 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-265e2c0f-9d9b-4676-8601-4be84a8ad951 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:58:02 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-265e2c0f-9d9b-4676-8601-4be84a8ad951 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-265e2c0f-9d9b-4676-8601-4be84a8ad951 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-378b568d-168b-40d1-a3f0-3961f6ccb2d1 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-04480767-6368-4026-8610-192ff8750832 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (971d46f8-09a3-4f58-9dd7-88898019aa71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9370698c-189a-428f-a594-f064db863774', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:02 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-378b568d-168b-40d1-a3f0-3961f6ccb2d1 1073741824 Sep 10 16:58:02 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-04480767-6368-4026-8610-192ff8750832 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b27c992a-e02a-434e-9629-b214e61cf6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ed31150f-9efc-41a7-8137-ad1d8a257f78 tempest-CreateVolumesFromImageTest-843695759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ed31150f-9efc-41a7-8137-ad1d8a257f78 tempest-CreateVolumesFromImageTest-843695759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ed31150f-9efc-41a7-8137-ad1d8a257f78 tempest-CreateVolumesFromImageTest-843695759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ed31150f-9efc-41a7-8137-ad1d8a257f78 tempest-CreateVolumesFromImageTest-843695759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ed31150f-9efc-41a7-8137-ad1d8a257f78 tempest-CreateVolumesFromImageTest-843695759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed31150f-9efc-41a7-8137-ad1d8a257f78 tempest-CreateVolumesFromImageTest-843695759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:02 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-04480767-6368-4026-8610-192ff8750832 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Volume volume-9370698c-189a-428f-a594-f064db863774 (9370698c-189a-428f-a594-f064db863774): created successfully Sep 10 16:58:02 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-04480767-6368-4026-8610-192ff8750832 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b27c992a-e02a-434e-9629-b214e61cf6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:03 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:58:03 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:03 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-04480767-6368-4026-8610-192ff8750832 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Flow 'volume_create_manager' (f3436d41-1cd9-40de-9c18-f8cc75e5c7d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:03 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-04480767-6368-4026-8610-192ff8750832 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Created volume successfully. Sep 10 16:58:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-32b599ad-fcc7-47dc-97c9-d4cc23bfab3e tempest-CreateVolumesFromImageTest-843695759 None] Acquiring lock "cinder-5eb474d8-9d18-460f-8bbd-a4ff0eb74d76-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-32b599ad-fcc7-47dc-97c9-d4cc23bfab3e tempest-CreateVolumesFromImageTest-843695759 None] Lock "cinder-5eb474d8-9d18-460f-8bbd-a4ff0eb74d76-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-32b599ad-fcc7-47dc-97c9-d4cc23bfab3e tempest-CreateVolumesFromImageTest-843695759 None] Acquiring lock "cinder-quobyte-5eb474d8-9d18-460f-8bbd-a4ff0eb74d76" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-32b599ad-fcc7-47dc-97c9-d4cc23bfab3e tempest-CreateVolumesFromImageTest-843695759 None] Lock "cinder-quobyte-5eb474d8-9d18-460f-8bbd-a4ff0eb74d76" acquired by "delete_volume" :: waited 0.018s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:03 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2b5686-d361-4e9b-9cac-c8d8f69dce86]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:03 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-32b599ad-fcc7-47dc-97c9-d4cc23bfab3e tempest-CreateVolumesFromImageTest-843695759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5eb474d8-9d18-460f-8bbd-a4ff0eb74d76 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed31150f-9efc-41a7-8137-ad1d8a257f78 tempest-CreateVolumesFromImageTest-843695759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.365s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:03 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-ed31150f-9efc-41a7-8137-ad1d8a257f78 tempest-CreateVolumesFromImageTest-843695759 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:58:03 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-ed31150f-9efc-41a7-8137-ad1d8a257f78 tempest-CreateVolumesFromImageTest-843695759 None] Deleted volume successfully. Sep 10 16:58:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-ed31150f-9efc-41a7-8137-ad1d8a257f78 tempest-CreateVolumesFromImageTest-843695759 None] Lock "cinder-7cab3e7b-fc26-41bd-961d-4336b781b1ed-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:03 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5eb474d8-9d18-460f-8bbd-a4ff0eb74d76 Sep 10 16:58:03 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:03 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-265e2c0f-9d9b-4676-8601-4be84a8ad951 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-378b568d-168b-40d1-a3f0-3961f6ccb2d1 1073741824" returned: 0 in 0.564s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-265e2c0f-9d9b-4676-8601-4be84a8ad951 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-378b568d-168b-40d1-a3f0-3961f6ccb2d1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:03 devstack sudo[107909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-378b568d-168b-40d1-a3f0-3961f6ccb2d1 Sep 10 16:58:03 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:03 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-32b599ad-fcc7-47dc-97c9-d4cc23bfab3e tempest-CreateVolumesFromImageTest-843695759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5eb474d8-9d18-460f-8bbd-a4ff0eb74d76" returned: 0 in 0.387s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-32b599ad-fcc7-47dc-97c9-d4cc23bfab3e tempest-CreateVolumesFromImageTest-843695759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5eb474d8-9d18-460f-8bbd-a4ff0eb74d76 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:03 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5eb474d8-9d18-460f-8bbd-a4ff0eb74d76 Sep 10 16:58:03 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:03 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-265e2c0f-9d9b-4676-8601-4be84a8ad951 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-378b568d-168b-40d1-a3f0-3961f6ccb2d1" returned: 0 in 0.280s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:03 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-265e2c0f-9d9b-4676-8601-4be84a8ad951 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:58:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-265e2c0f-9d9b-4676-8601-4be84a8ad951 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-33bfbb33-60e5-4717-9fe1-525bb382080b tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.865s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:03 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-33bfbb33-60e5-4717-9fe1-525bb382080b tempest-CreateVolumesFromSourceVolumeTest-738548049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1526123002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ed48b7b-1722-4eff-a1cf-6ad1d85835f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651df1d6352e47aea56922d5c2943021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:58Z,use_quota=True,user_id='d3c7ff82f0594964b586230ee61e09ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:58:03 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-33bfbb33-60e5-4717-9fe1-525bb382080b tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Creating volume 2ed48b7b-1722-4eff-a1cf-6ad1d85835f1 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:58:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-33bfbb33-60e5-4717-9fe1-525bb382080b tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-33bfbb33-60e5-4717-9fe1-525bb382080b tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:03 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-33bfbb33-60e5-4717-9fe1-525bb382080b tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:03 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-33bfbb33-60e5-4717-9fe1-525bb382080b tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-33bfbb33-60e5-4717-9fe1-525bb382080b tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:03 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-33bfbb33-60e5-4717-9fe1-525bb382080b tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:58:03 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-33bfbb33-60e5-4717-9fe1-525bb382080b tempest-CreateVolumesFromSourceVolumeTest-738548049 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:58:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-33bfbb33-60e5-4717-9fe1-525bb382080b tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2ed48b7b-1722-4eff-a1cf-6ad1d85835f1 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:03 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-265e2c0f-9d9b-4676-8601-4be84a8ad951 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e64c41ef-05b6-4eeb-a0a6-58adf39e6bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-378b568d-168b-40d1-a3f0-3961f6ccb2d1', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:03 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-265e2c0f-9d9b-4676-8601-4be84a8ad951 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (445fce1a-7c8f-43b1-b843-60b031897b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:03 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2ed48b7b-1722-4eff-a1cf-6ad1d85835f1 1073741824 Sep 10 16:58:03 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:03 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-265e2c0f-9d9b-4676-8601-4be84a8ad951 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Volume volume-378b568d-168b-40d1-a3f0-3961f6ccb2d1 (378b568d-168b-40d1-a3f0-3961f6ccb2d1): created successfully Sep 10 16:58:03 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-265e2c0f-9d9b-4676-8601-4be84a8ad951 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (445fce1a-7c8f-43b1-b843-60b031897b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:03 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-265e2c0f-9d9b-4676-8601-4be84a8ad951 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Flow 'volume_create_manager' (fc80ff6a-afcc-4110-85d6-9196cbbba3ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:03 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-265e2c0f-9d9b-4676-8601-4be84a8ad951 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Created volume successfully. Sep 10 16:58:03 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-32b599ad-fcc7-47dc-97c9-d4cc23bfab3e tempest-CreateVolumesFromImageTest-843695759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-5eb474d8-9d18-460f-8bbd-a4ff0eb74d76" returned: 0 in 0.266s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-32b599ad-fcc7-47dc-97c9-d4cc23bfab3e tempest-CreateVolumesFromImageTest-843695759 None] Lock "cinder-quobyte-5eb474d8-9d18-460f-8bbd-a4ff0eb74d76" released by "delete_volume" :: held 0.699s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:04 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-32b599ad-fcc7-47dc-97c9-d4cc23bfab3e tempest-CreateVolumesFromImageTest-843695759 None] Created reservations ['658584de-f8c7-4c9f-9122-a09755836862', 'f96e66ed-7539-4373-84b2-7d2017863940', '572ad84b-ea5f-4ef8-9390-51bf8271b210', '34d4f714-b539-4180-8a0b-1aaea8df9b25'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:58:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-32b599ad-fcc7-47dc-97c9-d4cc23bfab3e tempest-CreateVolumesFromImageTest-843695759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-32b599ad-fcc7-47dc-97c9-d4cc23bfab3e tempest-CreateVolumesFromImageTest-843695759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-32b599ad-fcc7-47dc-97c9-d4cc23bfab3e tempest-CreateVolumesFromImageTest-843695759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-32b599ad-fcc7-47dc-97c9-d4cc23bfab3e tempest-CreateVolumesFromImageTest-843695759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-32b599ad-fcc7-47dc-97c9-d4cc23bfab3e tempest-CreateVolumesFromImageTest-843695759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-32b599ad-fcc7-47dc-97c9-d4cc23bfab3e tempest-CreateVolumesFromImageTest-843695759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:04 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:58:04 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:04 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-33bfbb33-60e5-4717-9fe1-525bb382080b tempest-CreateVolumesFromSourceVolumeTest-738548049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2ed48b7b-1722-4eff-a1cf-6ad1d85835f1 1073741824" returned: 0 in 0.448s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-33bfbb33-60e5-4717-9fe1-525bb382080b tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2ed48b7b-1722-4eff-a1cf-6ad1d85835f1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:04 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2ed48b7b-1722-4eff-a1cf-6ad1d85835f1 Sep 10 16:58:04 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:04 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-32b599ad-fcc7-47dc-97c9-d4cc23bfab3e tempest-CreateVolumesFromImageTest-843695759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.289s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:04 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-32b599ad-fcc7-47dc-97c9-d4cc23bfab3e tempest-CreateVolumesFromImageTest-843695759 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:58:04 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-32b599ad-fcc7-47dc-97c9-d4cc23bfab3e tempest-CreateVolumesFromImageTest-843695759 None] Deleted volume successfully. Sep 10 16:58:04 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-32b599ad-fcc7-47dc-97c9-d4cc23bfab3e tempest-CreateVolumesFromImageTest-843695759 None] Lock "cinder-5eb474d8-9d18-460f-8bbd-a4ff0eb74d76-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:04 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-33bfbb33-60e5-4717-9fe1-525bb382080b tempest-CreateVolumesFromSourceVolumeTest-738548049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2ed48b7b-1722-4eff-a1cf-6ad1d85835f1" returned: 0 in 0.303s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-33bfbb33-60e5-4717-9fe1-525bb382080b tempest-CreateVolumesFromSourceVolumeTest-738548049 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:58:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-33bfbb33-60e5-4717-9fe1-525bb382080b tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.676s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6323f669-ab6a-4a99-9c1f-fece1c0597f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50cf4050ca5644f0afa5039ef3a4c48a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:57:56Z,use_quota=True,user_id='32e2041bd4434cbfb3ecc1ab2a32e1b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e507d436-e8d6-4076-aa8d-2c269f6f3fc7),volume_type_id=e507d436-e8d6-4076-aa8d-2c269f6f3fc7)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:58:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Creating volume 6323f669-ab6a-4a99-9c1f-fece1c0597f2 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:58:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:58:04 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:58:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6323f669-ab6a-4a99-9c1f-fece1c0597f2 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:04 devstack sudo[107930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6323f669-ab6a-4a99-9c1f-fece1c0597f2 1073741824 Sep 10 16:58:04 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:04 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-33bfbb33-60e5-4717-9fe1-525bb382080b tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a697a03-0215-4f66-8895-38cab505770c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ed48b7b-1722-4eff-a1cf-6ad1d85835f1', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:04 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-33bfbb33-60e5-4717-9fe1-525bb382080b tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db9572b1-0062-4240-9a9b-6d84db2e5655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:04 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-33bfbb33-60e5-4717-9fe1-525bb382080b tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Volume volume-2ed48b7b-1722-4eff-a1cf-6ad1d85835f1 (2ed48b7b-1722-4eff-a1cf-6ad1d85835f1): created successfully Sep 10 16:58:04 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-33bfbb33-60e5-4717-9fe1-525bb382080b tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db9572b1-0062-4240-9a9b-6d84db2e5655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:04 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-33bfbb33-60e5-4717-9fe1-525bb382080b tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Flow 'volume_create_manager' (a8b2cb96-c764-4bb7-b748-3daf23ffccab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:04 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-33bfbb33-60e5-4717-9fe1-525bb382080b tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Created volume successfully. Sep 10 16:58:05 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6323f669-ab6a-4a99-9c1f-fece1c0597f2 1073741824" returned: 0 in 0.463s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6323f669-ab6a-4a99-9c1f-fece1c0597f2 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:05 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6323f669-ab6a-4a99-9c1f-fece1c0597f2 Sep 10 16:58:05 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:05 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6323f669-ab6a-4a99-9c1f-fece1c0597f2" returned: 0 in 0.268s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:58:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.066s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:05 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Acquiring lock "cinder-quobyte-e73cb5d4-cec6-46ad-9eab-2ed1f28c5262-98efc725-c418-4a35-88bd-c8e4f00d2389" by "_create_volume_from_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:05 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Lock "cinder-quobyte-e73cb5d4-cec6-46ad-9eab-2ed1f28c5262-98efc725-c418-4a35-88bd-c8e4f00d2389" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Creating volume 98efc725-c418-4a35-88bd-c8e4f00d2389 from snapshot e73cb5d4-cec6-46ad-9eab-2ed1f28c5262 {{(pid=88189) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 10 16:58:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:58:05 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Acquiring lock "cinder-quobyte-98efc725-c418-4a35-88bd-c8e4f00d2389" by "_copy_volume_from_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:05 devstack cinder-volume[88189]: DEBUG cinder.volume.volume_utils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Attempting download of a7f1d7fb-66a4-4376-a07f-79b134b81983 ((None, [{'url': 'file:///opt/stack/data/glance/images/a7f1d7fb-66a4-4376-a07f-79b134b81983', 'metadata': {}}])) to volume 6323f669-ab6a-4a99-9c1f-fece1c0597f2. {{(pid=88189) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 16:58:05 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Lock "cinder-quobyte-98efc725-c418-4a35-88bd-c8e4f00d2389" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] snapshot: e73cb5d4-cec6-46ad-9eab-2ed1f28c5262, volume: 98efc725-c418-4a35-88bd-c8e4f00d2389, {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 16:58:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:05 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f170bc0b-9a74-4ccf-af9d-48a8acfd2b63]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337.e73cb5d4-cec6-46ad-9eab-2ed1f28c5262 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:05 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d35e29-0283-4c78-b4cd-efc31aa02176]: (4, 'raw') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7f1d7fb-66a4-4376-a07f-79b134b81983_j93xtpjh {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:05 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d3b77678-26a5-4ec0-9d01-32e2a85a5394 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Acquiring lock "cinder-2ed48b7b-1722-4eff-a1cf-6ad1d85835f1-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:05 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d3b77678-26a5-4ec0-9d01-32e2a85a5394 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "cinder-2ed48b7b-1722-4eff-a1cf-6ad1d85835f1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:05 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337.e73cb5d4-cec6-46ad-9eab-2ed1f28c5262 Sep 10 16:58:05 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:05 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7f1d7fb-66a4-4376-a07f-79b134b81983_j93xtpjh Sep 10 16:58:05 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:05 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d3b77678-26a5-4ec0-9d01-32e2a85a5394 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Acquiring lock "cinder-quobyte-2ed48b7b-1722-4eff-a1cf-6ad1d85835f1" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:05 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d3b77678-26a5-4ec0-9d01-32e2a85a5394 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "cinder-quobyte-2ed48b7b-1722-4eff-a1cf-6ad1d85835f1" acquired by "delete_volume" :: waited 0.016s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:05 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce88029-c390-4ab8-b962-f498adbbe025]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d3b77678-26a5-4ec0-9d01-32e2a85a5394 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2ed48b7b-1722-4eff-a1cf-6ad1d85835f1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:05 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2ed48b7b-1722-4eff-a1cf-6ad1d85835f1 Sep 10 16:58:05 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:06 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7f1d7fb-66a4-4376-a07f-79b134b81983_j93xtpjh" returned: 0 in 0.491s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7f1d7fb-66a4-4376-a07f-79b134b81983_j93xtpjh {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:06 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337.e73cb5d4-cec6-46ad-9eab-2ed1f28c5262" returned: 0 in 0.561s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:06 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94917c13-8ff3-4652-a116-abe3a2e80337(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:58:06 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e73ad6-19a0-42c1-9507-4433127f4d48]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:06 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7f1d7fb-66a4-4376-a07f-79b134b81983_j93xtpjh Sep 10 16:58:06 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:06 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d3b77678-26a5-4ec0-9d01-32e2a85a5394 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2ed48b7b-1722-4eff-a1cf-6ad1d85835f1" returned: 0 in 0.436s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d3b77678-26a5-4ec0-9d01-32e2a85a5394 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2ed48b7b-1722-4eff-a1cf-6ad1d85835f1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:06 devstack sudo[107951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337 Sep 10 16:58:06 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:06 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2ed48b7b-1722-4eff-a1cf-6ad1d85835f1 Sep 10 16:58:06 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:06 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7f1d7fb-66a4-4376-a07f-79b134b81983_j93xtpjh" returned: 1 in 0.397s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7f1d7fb-66a4-4376-a07f-79b134b81983_j93xtpjh' failed. Not Retrying. {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 16:58:06 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98fa7e5-41ed-43a7-97ff-2f7b1a4b120c]: (4, 'raw') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f1d7fb-66a4-4376-a07f-79b134b81983_gy3rgfijdevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:06 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337" returned: 0 in 0.455s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:06 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] will copy from snapshot at /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337 {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 16:58:06 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Creating direct copy from snapshot {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 16:58:06 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:06 devstack cinder-volume[88189]: DEBUG cinder.utils [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Path /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-98efc725-c418-4a35-88bd-c8e4f00d2389 not found in is_blk_device check {{(pid=88189) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 16:58:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-98efc725-c418-4a35-88bd-c8e4f00d2389 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d3b77678-26a5-4ec0-9d01-32e2a85a5394 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2ed48b7b-1722-4eff-a1cf-6ad1d85835f1" returned: 0 in 0.335s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:06 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f1d7fb-66a4-4376-a07f-79b134b81983_gy3rgfijdevstack@QuobyteHD Sep 10 16:58:06 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:06 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d3b77678-26a5-4ec0-9d01-32e2a85a5394 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "cinder-quobyte-2ed48b7b-1722-4eff-a1cf-6ad1d85835f1" released by "delete_volume" :: held 0.830s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:06 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-98efc725-c418-4a35-88bd-c8e4f00d2389 Sep 10 16:58:06 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:06 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-d3b77678-26a5-4ec0-9d01-32e2a85a5394 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Created reservations ['1ff40b14-7239-4646-aaa6-fbfcd2ef65fe', '21d940ad-2b88-47b3-b14d-73fa907635b4', '32deb9d8-c3b8-44c6-8096-b90b6e91dace', 'd2e79ae3-b4ce-404f-8037-874c9bcba0fa'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:58:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d3b77678-26a5-4ec0-9d01-32e2a85a5394 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d3b77678-26a5-4ec0-9d01-32e2a85a5394 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:06 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d3b77678-26a5-4ec0-9d01-32e2a85a5394 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:06 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d3b77678-26a5-4ec0-9d01-32e2a85a5394 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d3b77678-26a5-4ec0-9d01-32e2a85a5394 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d3b77678-26a5-4ec0-9d01-32e2a85a5394 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:06 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:58:06 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:06 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f1d7fb-66a4-4376-a07f-79b134b81983_gy3rgfijdevstack@QuobyteHD" returned: 0 in 0.439s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f1d7fb-66a4-4376-a07f-79b134b81983_gy3rgfijdevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:06 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-dbdc34a0-5716-41b4-95dd-84c071bf2982 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Acquiring lock "cinder-378b568d-168b-40d1-a3f0-3961f6ccb2d1-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:07 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-dbdc34a0-5716-41b4-95dd-84c071bf2982 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "cinder-378b568d-168b-40d1-a3f0-3961f6ccb2d1-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:07 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-dbdc34a0-5716-41b4-95dd-84c071bf2982 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Acquiring lock "cinder-quobyte-378b568d-168b-40d1-a3f0-3961f6ccb2d1" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:07 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-dbdc34a0-5716-41b4-95dd-84c071bf2982 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "cinder-quobyte-378b568d-168b-40d1-a3f0-3961f6ccb2d1" acquired by "delete_volume" :: waited 0.016s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:07 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b524bed-4199-437a-8e84-4398a2532be2]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dbdc34a0-5716-41b4-95dd-84c071bf2982 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-378b568d-168b-40d1-a3f0-3961f6ccb2d1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:07 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f1d7fb-66a4-4376-a07f-79b134b81983_gy3rgfijdevstack@QuobyteHD Sep 10 16:58:07 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:07 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d3b77678-26a5-4ec0-9d01-32e2a85a5394 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.375s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:07 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-d3b77678-26a5-4ec0-9d01-32e2a85a5394 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:58:07 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-d3b77678-26a5-4ec0-9d01-32e2a85a5394 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Deleted volume successfully. Sep 10 16:58:07 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d3b77678-26a5-4ec0-9d01-32e2a85a5394 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "cinder-2ed48b7b-1722-4eff-a1cf-6ad1d85835f1-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:07 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-378b568d-168b-40d1-a3f0-3961f6ccb2d1 Sep 10 16:58:07 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:07 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f1d7fb-66a4-4376-a07f-79b134b81983_gy3rgfijdevstack@QuobyteHD" returned: 1 in 0.759s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f1d7fb-66a4-4376-a07f-79b134b81983_gy3rgfijdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 16:58:07 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] a7f1d7fb-66a4-4376-a07f-79b134b81983 was raw, converting to qcow2 {{(pid=88189) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 16:58:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a7f1d7fb-66a4-4376-a07f-79b134b81983_gy3rgfijdevstack@QuobyteHD /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6323f669-ab6a-4a99-9c1f-fece1c0597f2 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:07 devstack sudo[107992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a7f1d7fb-66a4-4376-a07f-79b134b81983_gy3rgfijdevstack@QuobyteHD /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6323f669-ab6a-4a99-9c1f-fece1c0597f2 Sep 10 16:58:07 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:08 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dbdc34a0-5716-41b4-95dd-84c071bf2982 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-378b568d-168b-40d1-a3f0-3961f6ccb2d1" returned: 0 in 1.106s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dbdc34a0-5716-41b4-95dd-84c071bf2982 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-378b568d-168b-40d1-a3f0-3961f6ccb2d1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:08 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-378b568d-168b-40d1-a3f0-3961f6ccb2d1 Sep 10 16:58:08 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:08 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa2955a6-a43e-47a6-84ff-5317df6c98dc tempest-CinderUnicodeTest-1241636539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:58:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-aa2955a6-a43e-47a6-84ff-5317df6c98dc tempest-CinderUnicodeTest-1241636539 None] Flow 'volume_create_manager' (1a8f2654-7fd9-4ba9-ac2e-da32880f4c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-aa2955a6-a43e-47a6-84ff-5317df6c98dc tempest-CinderUnicodeTest-1241636539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfcfb605-61eb-4eb0-8bf6-c9ad8b381251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-aa2955a6-a43e-47a6-84ff-5317df6c98dc tempest-CinderUnicodeTest-1241636539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfcfb605-61eb-4eb0-8bf6-c9ad8b381251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aa40b81-6e49-4d03-a295-1b5d959607f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95bbdde6250f4c67b56d98bae8c19836',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:09Z,use_quota=True,user_id='83e6db207843492d86eddafe8b7f9305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-aa2955a6-a43e-47a6-84ff-5317df6c98dc tempest-CinderUnicodeTest-1241636539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002c01eb-6a37-49d8-9e54-caaf18898049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-aa2955a6-a43e-47a6-84ff-5317df6c98dc tempest-CinderUnicodeTest-1241636539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002c01eb-6a37-49d8-9e54-caaf18898049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-aa2955a6-a43e-47a6-84ff-5317df6c98dc tempest-CinderUnicodeTest-1241636539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e13a728a-6bde-40a7-b603-e0cf8f82e663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:08 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-aa2955a6-a43e-47a6-84ff-5317df6c98dc tempest-CinderUnicodeTest-1241636539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e13a728a-6bde-40a7-b603-e0cf8f82e663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7aa40b81-6e49-4d03-a295-1b5d959607f1', 'volume_name': 'volume-7aa40b81-6e49-4d03-a295-1b5d959607f1', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-aa2955a6-a43e-47a6-84ff-5317df6c98dc tempest-CinderUnicodeTest-1241636539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2fc55b0-16de-44dc-9c79-77f3e114f026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-aa2955a6-a43e-47a6-84ff-5317df6c98dc tempest-CinderUnicodeTest-1241636539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2fc55b0-16de-44dc-9c79-77f3e114f026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-aa2955a6-a43e-47a6-84ff-5317df6c98dc tempest-CinderUnicodeTest-1241636539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c94762e-9503-4672-898d-adbbb139f13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:08 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-aa2955a6-a43e-47a6-84ff-5317df6c98dc tempest-CinderUnicodeTest-1241636539 None] Volume 7aa40b81-6e49-4d03-a295-1b5d959607f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7aa40b81-6e49-4d03-a295-1b5d959607f1', 'volume_size': 1} Sep 10 16:58:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-aa2955a6-a43e-47a6-84ff-5317df6c98dc tempest-CinderUnicodeTest-1241636539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dbdc34a0-5716-41b4-95dd-84c071bf2982 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-378b568d-168b-40d1-a3f0-3961f6ccb2d1" returned: 0 in 0.693s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:08 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-dbdc34a0-5716-41b4-95dd-84c071bf2982 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "cinder-quobyte-378b568d-168b-40d1-a3f0-3961f6ccb2d1" released by "delete_volume" :: held 1.855s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:08 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a7f1d7fb-66a4-4376-a07f-79b134b81983_gy3rgfijdevstack@QuobyteHD /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6323f669-ab6a-4a99-9c1f-fece1c0597f2" returned: 0 in 1.304s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:09 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a7f1d7fb-66a4-4376-a07f-79b134b81983_gy3rgfijdevstack@QuobyteHD, size 0.00 MB, duration 1.31 sec, destination /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6323f669-ab6a-4a99-9c1f-fece1c0597f2 {{(pid=88189) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 16:58:09 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Converted 0.00 MB image at 0.00 MB/s Sep 10 16:58:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6323f669-ab6a-4a99-9c1f-fece1c0597f2 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:09 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-dbdc34a0-5716-41b4-95dd-84c071bf2982 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Created reservations ['1abfd9cb-e9a4-4cc4-9b06-8f2e858a034a', 'e08b214c-91de-4e81-80b8-00bfd8442152', '58e97628-55e3-4165-851b-8d9bdbb0406b', 'a69e83e6-4ae6-4c0f-b030-c7901cb8001f'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:58:09 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6323f669-ab6a-4a99-9c1f-fece1c0597f2 1G Sep 10 16:58:09 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-dbdc34a0-5716-41b4-95dd-84c071bf2982 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-dbdc34a0-5716-41b4-95dd-84c071bf2982 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:09 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-dbdc34a0-5716-41b4-95dd-84c071bf2982 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:09 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-dbdc34a0-5716-41b4-95dd-84c071bf2982 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-dbdc34a0-5716-41b4-95dd-84c071bf2982 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dbdc34a0-5716-41b4-95dd-84c071bf2982 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:09 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:58:09 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:09 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6872a101-7e2f-43f9-a428-7c24481d9063 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Acquiring lock "cinder-9370698c-189a-428f-a594-f064db863774-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:09 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6872a101-7e2f-43f9-a428-7c24481d9063 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "cinder-9370698c-189a-428f-a594-f064db863774-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:09 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6872a101-7e2f-43f9-a428-7c24481d9063 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Acquiring lock "cinder-quobyte-9370698c-189a-428f-a594-f064db863774" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:09 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:09 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6872a101-7e2f-43f9-a428-7c24481d9063 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "cinder-quobyte-9370698c-189a-428f-a594-f064db863774" acquired by "delete_volume" :: waited 0.083s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-dbdc34a0-5716-41b4-95dd-84c071bf2982 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.571s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:09 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-dbdc34a0-5716-41b4-95dd-84c071bf2982 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:58:09 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be3474b-1def-4939-bd02-742c992dcf09]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:09 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-dbdc34a0-5716-41b4-95dd-84c071bf2982 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Deleted volume successfully. Sep 10 16:58:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6872a101-7e2f-43f9-a428-7c24481d9063 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9370698c-189a-428f-a594-f064db863774 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:09 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6323f669-ab6a-4a99-9c1f-fece1c0597f2 1G" returned: 0 in 1.018s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:10 devstack cinder-volume[88189]: DEBUG cinder.volume.volume_utils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Downloaded image a7f1d7fb-66a4-4376-a07f-79b134b81983 ((None, [{'url': 'file:///opt/stack/data/glance/images/a7f1d7fb-66a4-4376-a07f-79b134b81983', 'metadata': {}}])) to volume 6323f669-ab6a-4a99-9c1f-fece1c0597f2 successfully. {{(pid=88189) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 16:58:10 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Temporary image a7f1d7fb-66a4-4376-a07f-79b134b81983 for user 32e2041bd4434cbfb3ecc1ab2a32e1b9 is deleted. {{(pid=88189) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 16:58:10 devstack cinder-volume[88189]: DEBUG cinder.volume.volume_utils [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Marking volume 6323f669-ab6a-4a99-9c1f-fece1c0597f2 as bootable. {{(pid=88189) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 16:58:10 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-dbdc34a0-5716-41b4-95dd-84c071bf2982 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "cinder-378b568d-168b-40d1-a3f0-3961f6ccb2d1-delete_volume" released by "delete_volume" :: held 3.079s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:10 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Copying metadata from image a7f1d7fb-66a4-4376-a07f-79b134b81983 to 6323f669-ab6a-4a99-9c1f-fece1c0597f2. {{(pid=88189) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 16:58:10 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Creating volume glance metadata for volume 6323f669-ab6a-4a99-9c1f-fece1c0597f2 backed by image a7f1d7fb-66a4-4376-a07f-79b134b81983 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a7f1d7fb-66a4-4376-a07f-79b134b81983', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e8f8e8e6b4a39d8f9ca9f7a090b924d9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88189) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 16:58:10 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9370698c-189a-428f-a594-f064db863774 Sep 10 16:58:10 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:10 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a7fe3c-285e-46a5-ac34-d8e31b5052c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6323f669-ab6a-4a99-9c1f-fece1c0597f2', 'volume_size': 1, 'image_id': 'a7f1d7fb-66a4-4376-a07f-79b134b81983', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7f1d7fb-66a4-4376-a07f-79b134b81983', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e8f8e8e6b4a39d8f9ca9f7a090b924d9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '50cf4050ca5644f0afa5039ef3a4c48a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c46585de935df7e0d199b588bea0d633ab464d39b3f18bb975368f3b27b0503519e793ccf53225cd9df2b89e50d84ed2e1634655f9d381f49f1cd0d4e25bef37', 'id': 'a7f1d7fb-66a4-4376-a07f-79b134b81983', 'created_at': datetime.datetime(2026, 9, 10, 14, 57, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 14, 57, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7f1d7fb-66a4-4376-a07f-79b134b81983/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:10 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f654d3-c415-41b5-96ee-43139b1219d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:10 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Volume volume-6323f669-ab6a-4a99-9c1f-fece1c0597f2 (6323f669-ab6a-4a99-9c1f-fece1c0597f2): created successfully Sep 10 16:58:10 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f654d3-c415-41b5-96ee-43139b1219d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:10 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Flow 'volume_create_manager' (9b40b168-1534-4669-a86f-1d9923116978) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:10 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-35cdf015-7e1e-4fb0-8ff1-55dbdcd1710c tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Created volume successfully. Sep 10 16:58:10 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6872a101-7e2f-43f9-a428-7c24481d9063 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9370698c-189a-428f-a594-f064db863774" returned: 0 in 0.983s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6872a101-7e2f-43f9-a428-7c24481d9063 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9370698c-189a-428f-a594-f064db863774 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:10 devstack sudo[108019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9370698c-189a-428f-a594-f064db863774 Sep 10 16:58:10 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:11 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6872a101-7e2f-43f9-a428-7c24481d9063 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-9370698c-189a-428f-a594-f064db863774" returned: 0 in 0.440s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:11 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6872a101-7e2f-43f9-a428-7c24481d9063 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "cinder-quobyte-9370698c-189a-428f-a594-f064db863774" released by "delete_volume" :: held 1.559s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:11 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-6872a101-7e2f-43f9-a428-7c24481d9063 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Created reservations ['d4840c37-3bc6-4fc4-8e72-ac45da6c50d0', '0b9aa8d8-e167-4eaf-ae8d-7ac3f16a8482', 'f9030c51-60be-4cd7-be3c-32315d248776', '2e81a64b-823e-4895-b80e-4bab48b30918'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:58:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6872a101-7e2f-43f9-a428-7c24481d9063 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6872a101-7e2f-43f9-a428-7c24481d9063 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:11 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6872a101-7e2f-43f9-a428-7c24481d9063 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:11 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6872a101-7e2f-43f9-a428-7c24481d9063 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6872a101-7e2f-43f9-a428-7c24481d9063 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6872a101-7e2f-43f9-a428-7c24481d9063 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:11 devstack sudo[108022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:58:11 devstack sudo[108022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6f9ca201-b22f-4054-b337-ceea1a6c0a5e tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Acquiring lock "cinder-6323f669-ab6a-4a99-9c1f-fece1c0597f2-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6f9ca201-b22f-4054-b337-ceea1a6c0a5e tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Lock "cinder-6323f669-ab6a-4a99-9c1f-fece1c0597f2-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-672f173c-73f4-4ee8-be07-9ce479ae5631 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Acquiring lock "cinder-0d3c579f-de68-4b47-aaaf-f6dd7fb1e969-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-672f173c-73f4-4ee8-be07-9ce479ae5631 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "cinder-0d3c579f-de68-4b47-aaaf-f6dd7fb1e969-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:12 devstack sudo[108022]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6f9ca201-b22f-4054-b337-ceea1a6c0a5e tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Acquiring lock "cinder-quobyte-6323f669-ab6a-4a99-9c1f-fece1c0597f2" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6872a101-7e2f-43f9-a428-7c24481d9063 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.661s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-6872a101-7e2f-43f9-a428-7c24481d9063 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:58:12 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-6872a101-7e2f-43f9-a428-7c24481d9063 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Deleted volume successfully. Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6f9ca201-b22f-4054-b337-ceea1a6c0a5e tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Lock "cinder-quobyte-6323f669-ab6a-4a99-9c1f-fece1c0597f2" acquired by "delete_volume" :: waited 0.114s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7aeabe-3530-4ee7-a703-7a739e16eb47]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6f9ca201-b22f-4054-b337-ceea1a6c0a5e tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6323f669-ab6a-4a99-9c1f-fece1c0597f2 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6872a101-7e2f-43f9-a428-7c24481d9063 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "cinder-9370698c-189a-428f-a594-f064db863774-delete_volume" released by "delete_volume" :: held 2.862s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-672f173c-73f4-4ee8-be07-9ce479ae5631 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Acquiring lock "cinder-quobyte-0d3c579f-de68-4b47-aaaf-f6dd7fb1e969" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-672f173c-73f4-4ee8-be07-9ce479ae5631 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "cinder-quobyte-0d3c579f-de68-4b47-aaaf-f6dd7fb1e969" acquired by "delete_volume" :: waited 0.018s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:12 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-98efc725-c418-4a35-88bd-c8e4f00d2389" returned: 0 in 5.953s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Image conversion details: src /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337, size 1024.00 MB, duration 5.95 sec, destination /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-98efc725-c418-4a35-88bd-c8e4f00d2389 {{(pid=88189) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 16:58:12 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Converted 1024.00 MB image at 172.00 MB/s Sep 10 16:58:12 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-98efc725-c418-4a35-88bd-c8e4f00d2389 is being set with open permissions: ugo+rw Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-98efc725-c418-4a35-88bd-c8e4f00d2389 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9683b493-7235-4fa6-bc44-593bd6f5529d]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-672f173c-73f4-4ee8-be07-9ce479ae5631 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0d3c579f-de68-4b47-aaaf-f6dd7fb1e969 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:12 devstack sudo[108026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-98efc725-c418-4a35-88bd-c8e4f00d2389 Sep 10 16:58:12 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:12 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6323f669-ab6a-4a99-9c1f-fece1c0597f2 Sep 10 16:58:12 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:12 devstack sudo[108027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0d3c579f-de68-4b47-aaaf-f6dd7fb1e969 Sep 10 16:58:12 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:12 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-98efc725-c418-4a35-88bd-c8e4f00d2389" returned: 0 in 0.253s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Lock "cinder-quobyte-98efc725-c418-4a35-88bd-c8e4f00d2389" released by "_copy_volume_from_snapshot" :: held 7.343s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:12 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Lock "cinder-quobyte-e73cb5d4-cec6-46ad-9eab-2ed1f28c5262-98efc725-c418-4a35-88bd-c8e4f00d2389" released by "_create_volume_from_snapshot" :: held 7.413s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.447s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-aa2955a6-a43e-47a6-84ff-5317df6c98dc tempest-CinderUnicodeTest-1241636539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.945s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-aa2955a6-a43e-47a6-84ff-5317df6c98dc tempest-CinderUnicodeTest-1241636539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aa40b81-6e49-4d03-a295-1b5d959607f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95bbdde6250f4c67b56d98bae8c19836',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:09Z,use_quota=True,user_id='83e6db207843492d86eddafe8b7f9305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-aa2955a6-a43e-47a6-84ff-5317df6c98dc tempest-CinderUnicodeTest-1241636539 None] Creating volume 7aa40b81-6e49-4d03-a295-1b5d959607f1 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-aa2955a6-a43e-47a6-84ff-5317df6c98dc tempest-CinderUnicodeTest-1241636539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-aa2955a6-a43e-47a6-84ff-5317df6c98dc tempest-CinderUnicodeTest-1241636539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-aa2955a6-a43e-47a6-84ff-5317df6c98dc tempest-CinderUnicodeTest-1241636539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-aa2955a6-a43e-47a6-84ff-5317df6c98dc tempest-CinderUnicodeTest-1241636539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-aa2955a6-a43e-47a6-84ff-5317df6c98dc tempest-CinderUnicodeTest-1241636539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-aa2955a6-a43e-47a6-84ff-5317df6c98dc tempest-CinderUnicodeTest-1241636539 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:58:12 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-aa2955a6-a43e-47a6-84ff-5317df6c98dc tempest-CinderUnicodeTest-1241636539 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-aa2955a6-a43e-47a6-84ff-5317df6c98dc tempest-CinderUnicodeTest-1241636539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7aa40b81-6e49-4d03-a295-1b5d959607f1 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6f9ca201-b22f-4054-b337-ceea1a6c0a5e tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6323f669-ab6a-4a99-9c1f-fece1c0597f2" returned: 0 in 0.425s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6f9ca201-b22f-4054-b337-ceea1a6c0a5e tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6323f669-ab6a-4a99-9c1f-fece1c0597f2 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:12 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7aa40b81-6e49-4d03-a295-1b5d959607f1 1073741824 Sep 10 16:58:12 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:12 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6323f669-ab6a-4a99-9c1f-fece1c0597f2 Sep 10 16:58:12 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ad17fb-e4d1-46b5-bcaf-29eec2c2d050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98efc725-c418-4a35-88bd-c8e4f00d2389', 'volume_size': 1, 'snapshot_id': 'e73cb5d4-cec6-46ad-9eab-2ed1f28c5262'}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef52d3c1-01b1-4ed1-9d2e-7a6eec770fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:12 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Volume volume-98efc725-c418-4a35-88bd-c8e4f00d2389 (98efc725-c418-4a35-88bd-c8e4f00d2389): created successfully Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef52d3c1-01b1-4ed1-9d2e-7a6eec770fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:12 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Flow 'volume_create_manager' (5d877c81-70d7-4d99-a2ee-23e339aa3dc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:12 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-74a0bc6e-1cf2-4fd1-9d05-d77d103d250a tempest-VolumeDependencyTests-1552907241 None] Created volume successfully. Sep 10 16:58:13 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-672f173c-73f4-4ee8-be07-9ce479ae5631 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0d3c579f-de68-4b47-aaaf-f6dd7fb1e969" returned: 0 in 0.448s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-672f173c-73f4-4ee8-be07-9ce479ae5631 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0d3c579f-de68-4b47-aaaf-f6dd7fb1e969 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:13 devstack sudo[108042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0d3c579f-de68-4b47-aaaf-f6dd7fb1e969 Sep 10 16:58:13 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:13 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6f9ca201-b22f-4054-b337-ceea1a6c0a5e tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-6323f669-ab6a-4a99-9c1f-fece1c0597f2" returned: 0 in 0.271s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6f9ca201-b22f-4054-b337-ceea1a6c0a5e tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Lock "cinder-quobyte-6323f669-ab6a-4a99-9c1f-fece1c0597f2" released by "delete_volume" :: held 0.785s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-6f9ca201-b22f-4054-b337-ceea1a6c0a5e tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Created reservations ['5b676a8e-0b03-44fe-82f4-6448263767c0', 'ea08aa9d-505a-4591-8b84-3350f7c985f4', 'd5389e35-a7f8-4996-bef5-b0ef23c70f6f', '07663516-83f5-4451-aa63-210942e93d82'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:58:13 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-672f173c-73f4-4ee8-be07-9ce479ae5631 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-0d3c579f-de68-4b47-aaaf-f6dd7fb1e969" returned: 0 in 0.289s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-672f173c-73f4-4ee8-be07-9ce479ae5631 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "cinder-quobyte-0d3c579f-de68-4b47-aaaf-f6dd7fb1e969" released by "delete_volume" :: held 0.810s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6f9ca201-b22f-4054-b337-ceea1a6c0a5e tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6f9ca201-b22f-4054-b337-ceea1a6c0a5e tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6f9ca201-b22f-4054-b337-ceea1a6c0a5e tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6f9ca201-b22f-4054-b337-ceea1a6c0a5e tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6f9ca201-b22f-4054-b337-ceea1a6c0a5e tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6f9ca201-b22f-4054-b337-ceea1a6c0a5e tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:13 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:58:13 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-672f173c-73f4-4ee8-be07-9ce479ae5631 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Created reservations ['30f89f6b-1015-479a-88c5-eac06f884bd6', '2051094a-30bc-45b6-b7ac-35757fd3725e', 'df72a327-db62-41ad-88a7-0ddbd40af8ac', '3f383758-b591-4c85-8591-0fd65f11674d'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:58:13 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-aa2955a6-a43e-47a6-84ff-5317df6c98dc tempest-CinderUnicodeTest-1241636539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7aa40b81-6e49-4d03-a295-1b5d959607f1 1073741824" returned: 0 in 0.579s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-aa2955a6-a43e-47a6-84ff-5317df6c98dc tempest-CinderUnicodeTest-1241636539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7aa40b81-6e49-4d03-a295-1b5d959607f1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:13 devstack sudo[108052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7aa40b81-6e49-4d03-a295-1b5d959607f1 Sep 10 16:58:13 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-672f173c-73f4-4ee8-be07-9ce479ae5631 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-672f173c-73f4-4ee8-be07-9ce479ae5631 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-672f173c-73f4-4ee8-be07-9ce479ae5631 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-672f173c-73f4-4ee8-be07-9ce479ae5631 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-672f173c-73f4-4ee8-be07-9ce479ae5631 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-672f173c-73f4-4ee8-be07-9ce479ae5631 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:13 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:58:13 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2e8e6841-5806-42f0-845f-8457742199df tempest-VolumeDependencyTests-1552907241 None] Acquiring lock "cinder-e73cb5d4-cec6-46ad-9eab-2ed1f28c5262-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2e8e6841-5806-42f0-845f-8457742199df tempest-VolumeDependencyTests-1552907241 None] Lock "cinder-e73cb5d4-cec6-46ad-9eab-2ed1f28c5262-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2e8e6841-5806-42f0-845f-8457742199df tempest-VolumeDependencyTests-1552907241 None] Acquiring lock "cinder-quobyte-94917c13-8ff3-4652-a116-abe3a2e80337" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2e8e6841-5806-42f0-845f-8457742199df tempest-VolumeDependencyTests-1552907241 None] Lock "cinder-quobyte-94917c13-8ff3-4652-a116-abe3a2e80337" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2e8e6841-5806-42f0-845f-8457742199df tempest-VolumeDependencyTests-1552907241 None] Acquiring lock "cinder-quobyte-e73cb5d4-cec6-46ad-9eab-2ed1f28c5262" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2e8e6841-5806-42f0-845f-8457742199df tempest-VolumeDependencyTests-1552907241 None] Lock "cinder-quobyte-e73cb5d4-cec6-46ad-9eab-2ed1f28c5262" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-2e8e6841-5806-42f0-845f-8457742199df tempest-VolumeDependencyTests-1552907241 None] Deleting offline snapshot e73cb5d4-cec6-46ad-9eab-2ed1f28c5262 of volume 94917c13-8ff3-4652-a116-abe3a2e80337 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:58:13 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-2e8e6841-5806-42f0-845f-8457742199df tempest-VolumeDependencyTests-1552907241 None] snapshot_file for this snap is: volume-94917c13-8ff3-4652-a116-abe3a2e80337.e73cb5d4-cec6-46ad-9eab-2ed1f28c5262 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6f9ca201-b22f-4054-b337-ceea1a6c0a5e tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.417s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-6f9ca201-b22f-4054-b337-ceea1a6c0a5e tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:58:13 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-6f9ca201-b22f-4054-b337-ceea1a6c0a5e tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Deleted volume successfully. Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45eccde-f063-45e9-967e-37b6d596036c]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2e8e6841-5806-42f0-845f-8457742199df tempest-VolumeDependencyTests-1552907241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337.e73cb5d4-cec6-46ad-9eab-2ed1f28c5262 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:13 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-aa2955a6-a43e-47a6-84ff-5317df6c98dc tempest-CinderUnicodeTest-1241636539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7aa40b81-6e49-4d03-a295-1b5d959607f1" returned: 0 in 0.337s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-aa2955a6-a43e-47a6-84ff-5317df6c98dc tempest-CinderUnicodeTest-1241636539 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-aa2955a6-a43e-47a6-84ff-5317df6c98dc tempest-CinderUnicodeTest-1241636539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6f9ca201-b22f-4054-b337-ceea1a6c0a5e tempest-VolumeAndVolumeTypeFromImageTest-1744883185 None] Lock "cinder-6323f669-ab6a-4a99-9c1f-fece1c0597f2-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-aa2955a6-a43e-47a6-84ff-5317df6c98dc tempest-CinderUnicodeTest-1241636539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c94762e-9503-4672-898d-adbbb139f13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aa40b81-6e49-4d03-a295-1b5d959607f1', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-aa2955a6-a43e-47a6-84ff-5317df6c98dc tempest-CinderUnicodeTest-1241636539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ee31e7-6200-410b-b762-2a674d0d07ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:13 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-aa2955a6-a43e-47a6-84ff-5317df6c98dc tempest-CinderUnicodeTest-1241636539 None] Volume volume-7aa40b81-6e49-4d03-a295-1b5d959607f1 (7aa40b81-6e49-4d03-a295-1b5d959607f1): created successfully Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-aa2955a6-a43e-47a6-84ff-5317df6c98dc tempest-CinderUnicodeTest-1241636539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ee31e7-6200-410b-b762-2a674d0d07ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-aa2955a6-a43e-47a6-84ff-5317df6c98dc tempest-CinderUnicodeTest-1241636539 None] Flow 'volume_create_manager' (1a8f2654-7fd9-4ba9-ac2e-da32880f4c66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:13 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-aa2955a6-a43e-47a6-84ff-5317df6c98dc tempest-CinderUnicodeTest-1241636539 None] Created volume successfully. Sep 10 16:58:13 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337.e73cb5d4-cec6-46ad-9eab-2ed1f28c5262 Sep 10 16:58:13 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:13 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-672f173c-73f4-4ee8-be07-9ce479ae5631 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.398s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:13 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-672f173c-73f4-4ee8-be07-9ce479ae5631 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:58:13 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-672f173c-73f4-4ee8-be07-9ce479ae5631 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Deleted volume successfully. Sep 10 16:58:14 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-672f173c-73f4-4ee8-be07-9ce479ae5631 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "cinder-0d3c579f-de68-4b47-aaaf-f6dd7fb1e969-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:14 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2e8e6841-5806-42f0-845f-8457742199df tempest-VolumeDependencyTests-1552907241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337.e73cb5d4-cec6-46ad-9eab-2ed1f28c5262" returned: 0 in 0.398s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:14 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-2e8e6841-5806-42f0-845f-8457742199df tempest-VolumeDependencyTests-1552907241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94917c13-8ff3-4652-a116-abe3a2e80337(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:58:14 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ec519a-844f-4928-b482-b3d0b2cd569a]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2e8e6841-5806-42f0-845f-8457742199df tempest-VolumeDependencyTests-1552907241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:14 devstack sudo[108064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337 Sep 10 16:58:14 devstack sudo[108064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:14 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c9d9fa81-5ce9-4b5a-82be-194240535338 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Acquiring lock "cinder-4588285a-3aa8-41a0-ab81-d4ad83a31583-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:14 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c9d9fa81-5ce9-4b5a-82be-194240535338 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "cinder-4588285a-3aa8-41a0-ab81-d4ad83a31583-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:14 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c9d9fa81-5ce9-4b5a-82be-194240535338 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Acquiring lock "cinder-quobyte-4588285a-3aa8-41a0-ab81-d4ad83a31583" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:14 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c9d9fa81-5ce9-4b5a-82be-194240535338 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "cinder-quobyte-4588285a-3aa8-41a0-ab81-d4ad83a31583" acquired by "delete_volume" :: waited 0.027s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:14 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dad352-1f3c-4bee-a896-1ddad79859b4]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c9d9fa81-5ce9-4b5a-82be-194240535338 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4588285a-3aa8-41a0-ab81-d4ad83a31583 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:14 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1be58d9-991b-42f6-81ea-650a937a7ce7 tempest-CinderUnicodeTest-1241636539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:58:14 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d1be58d9-991b-42f6-81ea-650a937a7ce7 tempest-CinderUnicodeTest-1241636539 None] Flow 'volume_create_manager' (e421b313-a3e0-46c3-9d61-c7f4697f155c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:14 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d1be58d9-991b-42f6-81ea-650a937a7ce7 tempest-CinderUnicodeTest-1241636539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8bee709-5559-4c57-81de-4f7db0dcc9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:14 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d1be58d9-991b-42f6-81ea-650a937a7ce7 tempest-CinderUnicodeTest-1241636539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8bee709-5559-4c57-81de-4f7db0dcc9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-480291719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a544b99-f327-41d7-b39e-08aa5362e6a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95bbdde6250f4c67b56d98bae8c19836',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:15Z,use_quota=True,user_id='83e6db207843492d86eddafe8b7f9305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:14 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d1be58d9-991b-42f6-81ea-650a937a7ce7 tempest-CinderUnicodeTest-1241636539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (959dc752-8bc3-488c-9e1d-904b9f35f426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:14 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d1be58d9-991b-42f6-81ea-650a937a7ce7 tempest-CinderUnicodeTest-1241636539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (959dc752-8bc3-488c-9e1d-904b9f35f426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:14 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d1be58d9-991b-42f6-81ea-650a937a7ce7 tempest-CinderUnicodeTest-1241636539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c93bc2e-4d89-47a5-a284-4c0350c886f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:14 devstack sudo[108068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4588285a-3aa8-41a0-ab81-d4ad83a31583 Sep 10 16:58:14 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:14 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d1be58d9-991b-42f6-81ea-650a937a7ce7 tempest-CinderUnicodeTest-1241636539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c93bc2e-4d89-47a5-a284-4c0350c886f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a544b99-f327-41d7-b39e-08aa5362e6a6', 'volume_name': 'volume-8a544b99-f327-41d7-b39e-08aa5362e6a6', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:14 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d1be58d9-991b-42f6-81ea-650a937a7ce7 tempest-CinderUnicodeTest-1241636539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99b6f60-2faf-491d-a88b-bf2735b40160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:14 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d1be58d9-991b-42f6-81ea-650a937a7ce7 tempest-CinderUnicodeTest-1241636539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99b6f60-2faf-491d-a88b-bf2735b40160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:14 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d1be58d9-991b-42f6-81ea-650a937a7ce7 tempest-CinderUnicodeTest-1241636539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af5bb689-0135-47ac-aef9-65f12157e093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:14 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-d1be58d9-991b-42f6-81ea-650a937a7ce7 tempest-CinderUnicodeTest-1241636539 None] Volume 8a544b99-f327-41d7-b39e-08aa5362e6a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a544b99-f327-41d7-b39e-08aa5362e6a6', 'volume_size': 1} Sep 10 16:58:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d1be58d9-991b-42f6-81ea-650a937a7ce7 tempest-CinderUnicodeTest-1241636539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d1be58d9-991b-42f6-81ea-650a937a7ce7 tempest-CinderUnicodeTest-1241636539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:14 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d1be58d9-991b-42f6-81ea-650a937a7ce7 tempest-CinderUnicodeTest-1241636539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-480291719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a544b99-f327-41d7-b39e-08aa5362e6a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95bbdde6250f4c67b56d98bae8c19836',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:15Z,use_quota=True,user_id='83e6db207843492d86eddafe8b7f9305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:58:14 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-d1be58d9-991b-42f6-81ea-650a937a7ce7 tempest-CinderUnicodeTest-1241636539 None] Creating volume 8a544b99-f327-41d7-b39e-08aa5362e6a6 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:58:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d1be58d9-991b-42f6-81ea-650a937a7ce7 tempest-CinderUnicodeTest-1241636539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d1be58d9-991b-42f6-81ea-650a937a7ce7 tempest-CinderUnicodeTest-1241636539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:14 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d1be58d9-991b-42f6-81ea-650a937a7ce7 tempest-CinderUnicodeTest-1241636539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:14 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d1be58d9-991b-42f6-81ea-650a937a7ce7 tempest-CinderUnicodeTest-1241636539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d1be58d9-991b-42f6-81ea-650a937a7ce7 tempest-CinderUnicodeTest-1241636539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:14 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d1be58d9-991b-42f6-81ea-650a937a7ce7 tempest-CinderUnicodeTest-1241636539 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:58:14 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-d1be58d9-991b-42f6-81ea-650a937a7ce7 tempest-CinderUnicodeTest-1241636539 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:58:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d1be58d9-991b-42f6-81ea-650a937a7ce7 tempest-CinderUnicodeTest-1241636539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:14 devstack sudo[108064]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:14 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6 1073741824 Sep 10 16:58:14 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2e8e6841-5806-42f0-845f-8457742199df tempest-VolumeDependencyTests-1552907241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337" returned: 0 in 0.704s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2e8e6841-5806-42f0-845f-8457742199df tempest-VolumeDependencyTests-1552907241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337.e73cb5d4-cec6-46ad-9eab-2ed1f28c5262 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:15 devstack sudo[108073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337.e73cb5d4-cec6-46ad-9eab-2ed1f28c5262 Sep 10 16:58:15 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:15 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c9d9fa81-5ce9-4b5a-82be-194240535338 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4588285a-3aa8-41a0-ab81-d4ad83a31583" returned: 0 in 0.494s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c9d9fa81-5ce9-4b5a-82be-194240535338 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4588285a-3aa8-41a0-ab81-d4ad83a31583 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:15 devstack sudo[108081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4588285a-3aa8-41a0-ab81-d4ad83a31583 Sep 10 16:58:15 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:15 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2e8e6841-5806-42f0-845f-8457742199df tempest-VolumeDependencyTests-1552907241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337.e73cb5d4-cec6-46ad-9eab-2ed1f28c5262" returned: 0 in 0.485s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2e8e6841-5806-42f0-845f-8457742199df tempest-VolumeDependencyTests-1552907241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337.e73cb5d4-cec6-46ad-9eab-2ed1f28c5262 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:15 devstack sudo[108087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337.e73cb5d4-cec6-46ad-9eab-2ed1f28c5262 Sep 10 16:58:15 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:15 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d1be58d9-991b-42f6-81ea-650a937a7ce7 tempest-CinderUnicodeTest-1241636539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6 1073741824" returned: 0 in 0.572s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d1be58d9-991b-42f6-81ea-650a937a7ce7 tempest-CinderUnicodeTest-1241636539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:15 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6 Sep 10 16:58:15 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:15 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c9d9fa81-5ce9-4b5a-82be-194240535338 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4588285a-3aa8-41a0-ab81-d4ad83a31583" returned: 0 in 0.395s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:15 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c9d9fa81-5ce9-4b5a-82be-194240535338 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "cinder-quobyte-4588285a-3aa8-41a0-ab81-d4ad83a31583" released by "delete_volume" :: held 0.956s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:15 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-c9d9fa81-5ce9-4b5a-82be-194240535338 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Created reservations ['6844dd13-7cf8-41f7-8736-f8379dc236b4', '4ddc59df-96c6-443a-81e6-101ee88acd0d', '9a7b3593-c461-4eeb-8142-18268dcda0d2', '090900ff-836f-4909-93c3-1f01f8d934ac'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:58:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c9d9fa81-5ce9-4b5a-82be-194240535338 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c9d9fa81-5ce9-4b5a-82be-194240535338 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c9d9fa81-5ce9-4b5a-82be-194240535338 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c9d9fa81-5ce9-4b5a-82be-194240535338 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c9d9fa81-5ce9-4b5a-82be-194240535338 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c9d9fa81-5ce9-4b5a-82be-194240535338 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:15 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-2e8e6841-5806-42f0-845f-8457742199df tempest-VolumeDependencyTests-1552907241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337.e73cb5d4-cec6-46ad-9eab-2ed1f28c5262" returned: 0 in 0.398s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:15 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:58:15 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:15 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2e8e6841-5806-42f0-845f-8457742199df tempest-VolumeDependencyTests-1552907241 None] Lock "cinder-quobyte-e73cb5d4-cec6-46ad-9eab-2ed1f28c5262" released by "_delete_snapshot" :: held 2.128s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:15 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2e8e6841-5806-42f0-845f-8457742199df tempest-VolumeDependencyTests-1552907241 None] Lock "cinder-quobyte-94917c13-8ff3-4652-a116-abe3a2e80337" released by "delete_snapshot" :: held 2.154s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:15 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d1be58d9-991b-42f6-81ea-650a937a7ce7 tempest-CinderUnicodeTest-1241636539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6" returned: 0 in 0.391s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d1be58d9-991b-42f6-81ea-650a937a7ce7 tempest-CinderUnicodeTest-1241636539 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:58:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d1be58d9-991b-42f6-81ea-650a937a7ce7 tempest-CinderUnicodeTest-1241636539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d1be58d9-991b-42f6-81ea-650a937a7ce7 tempest-CinderUnicodeTest-1241636539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af5bb689-0135-47ac-aef9-65f12157e093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a544b99-f327-41d7-b39e-08aa5362e6a6', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d1be58d9-991b-42f6-81ea-650a937a7ce7 tempest-CinderUnicodeTest-1241636539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9275896d-42f5-4c24-b255-57456c8eff71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:15 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-d1be58d9-991b-42f6-81ea-650a937a7ce7 tempest-CinderUnicodeTest-1241636539 None] Volume volume-8a544b99-f327-41d7-b39e-08aa5362e6a6 (8a544b99-f327-41d7-b39e-08aa5362e6a6): created successfully Sep 10 16:58:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d1be58d9-991b-42f6-81ea-650a937a7ce7 tempest-CinderUnicodeTest-1241636539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9275896d-42f5-4c24-b255-57456c8eff71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d1be58d9-991b-42f6-81ea-650a937a7ce7 tempest-CinderUnicodeTest-1241636539 None] Flow 'volume_create_manager' (e421b313-a3e0-46c3-9d61-c7f4697f155c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:15 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-2e8e6841-5806-42f0-845f-8457742199df tempest-VolumeDependencyTests-1552907241 None] Created reservations ['5a4e8567-ad92-4376-a4de-df316a0846bc', '04580dba-c057-417f-8d92-ba3637295b6b', '6b5ea62e-269a-447f-8bad-babecb3109de', 'ecd1d584-f6cd-43a3-9e67-3ca9c1602f93'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:58:16 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-d1be58d9-991b-42f6-81ea-650a937a7ce7 tempest-CinderUnicodeTest-1241636539 None] Created volume successfully. Sep 10 16:58:16 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-2e8e6841-5806-42f0-845f-8457742199df tempest-VolumeDependencyTests-1552907241 None] Delete snapshot completed successfully. Sep 10 16:58:16 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-2e8e6841-5806-42f0-845f-8457742199df tempest-VolumeDependencyTests-1552907241 None] Lock "cinder-e73cb5d4-cec6-46ad-9eab-2ed1f28c5262-delete_snapshot" released by "delete_snapshot" :: held 2.371s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:16 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c9d9fa81-5ce9-4b5a-82be-194240535338 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.283s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:16 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-c9d9fa81-5ce9-4b5a-82be-194240535338 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:58:16 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-c9d9fa81-5ce9-4b5a-82be-194240535338 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Deleted volume successfully. Sep 10 16:58:16 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c9d9fa81-5ce9-4b5a-82be-194240535338 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "cinder-4588285a-3aa8-41a0-ab81-d4ad83a31583-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:16 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-36420652-870a-4724-8d97-72c42784fb77 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Acquiring lock "cinder-7bac3796-3390-43ae-bd98-da4a71c40083-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:16 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-36420652-870a-4724-8d97-72c42784fb77 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "cinder-7bac3796-3390-43ae-bd98-da4a71c40083-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:16 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-36420652-870a-4724-8d97-72c42784fb77 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Acquiring lock "cinder-quobyte-7bac3796-3390-43ae-bd98-da4a71c40083" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:16 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-72202f80-e4a6-4a84-a427-6c28df04f6e5 tempest-VolumeDependencyTests-1552907241 None] Acquiring lock "cinder-94917c13-8ff3-4652-a116-abe3a2e80337-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:17 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-72202f80-e4a6-4a84-a427-6c28df04f6e5 tempest-VolumeDependencyTests-1552907241 None] Lock "cinder-94917c13-8ff3-4652-a116-abe3a2e80337-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:17 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-36420652-870a-4724-8d97-72c42784fb77 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "cinder-quobyte-7bac3796-3390-43ae-bd98-da4a71c40083" acquired by "delete_volume" :: waited 0.045s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:17 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cd79c5-bbfc-4077-8d60-e007fd01f4d5]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-36420652-870a-4724-8d97-72c42784fb77 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7bac3796-3390-43ae-bd98-da4a71c40083 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:17 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-72202f80-e4a6-4a84-a427-6c28df04f6e5 tempest-VolumeDependencyTests-1552907241 None] Acquiring lock "cinder-quobyte-94917c13-8ff3-4652-a116-abe3a2e80337" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:17 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-72202f80-e4a6-4a84-a427-6c28df04f6e5 tempest-VolumeDependencyTests-1552907241 None] Lock "cinder-quobyte-94917c13-8ff3-4652-a116-abe3a2e80337" acquired by "delete_volume" :: waited 0.023s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:17 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee6948e-e2d7-4143-a390-4a9230c07eec]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-72202f80-e4a6-4a84-a427-6c28df04f6e5 tempest-VolumeDependencyTests-1552907241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:17 devstack sudo[108097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7bac3796-3390-43ae-bd98-da4a71c40083 Sep 10 16:58:17 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-29f142df-b314-4ca2-93b0-573803518c75 tempest-CinderUnicodeTest-1241636539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-29f142df-b314-4ca2-93b0-573803518c75 tempest-CinderUnicodeTest-1241636539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-29f142df-b314-4ca2-93b0-573803518c75 tempest-CinderUnicodeTest-1241636539 None] Creating offline snapshot 4503d317-4a67-4ce6-96c6-b3c27393abc0 of volume 8a544b99-f327-41d7-b39e-08aa5362e6a6 {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:58:17 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f38056-e2e9-49f8-8407-d9887e026ad5]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-29f142df-b314-4ca2-93b0-573803518c75 tempest-CinderUnicodeTest-1241636539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:17 devstack sudo[108098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337 Sep 10 16:58:17 devstack sudo[108098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:17 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6 Sep 10 16:58:17 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:17 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-36420652-870a-4724-8d97-72c42784fb77 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7bac3796-3390-43ae-bd98-da4a71c40083" returned: 0 in 0.492s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-36420652-870a-4724-8d97-72c42784fb77 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7bac3796-3390-43ae-bd98-da4a71c40083 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:17 devstack sudo[108109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7bac3796-3390-43ae-bd98-da4a71c40083 Sep 10 16:58:17 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:17 devstack sudo[108098]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-72202f80-e4a6-4a84-a427-6c28df04f6e5 tempest-VolumeDependencyTests-1552907241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337" returned: 0 in 0.446s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-72202f80-e4a6-4a84-a427-6c28df04f6e5 tempest-VolumeDependencyTests-1552907241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:17 devstack sudo[108112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337 Sep 10 16:58:17 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:17 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-29f142df-b314-4ca2-93b0-573803518c75 tempest-CinderUnicodeTest-1241636539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6" returned: 0 in 0.529s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-29f142df-b314-4ca2-93b0-573803518c75 tempest-CinderUnicodeTest-1241636539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6.4503d317-4a67-4ce6-96c6-b3c27393abc0 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:17 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6.4503d317-4a67-4ce6-96c6-b3c27393abc0 1G Sep 10 16:58:17 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:17 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-36420652-870a-4724-8d97-72c42784fb77 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7bac3796-3390-43ae-bd98-da4a71c40083" returned: 0 in 0.346s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:17 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-36420652-870a-4724-8d97-72c42784fb77 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "cinder-quobyte-7bac3796-3390-43ae-bd98-da4a71c40083" released by "delete_volume" :: held 0.908s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:17 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-36420652-870a-4724-8d97-72c42784fb77 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Created reservations ['6989cdfc-23e8-4803-bab2-5d27f33a42ff', '808de2de-8edd-481b-9f75-a5f2a6fb06e9', 'b75ccf89-6153-413e-84ce-9e2cf228db90', '445559ee-53a0-40ed-87a9-a7e3d8d77e90'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:58:18 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-72202f80-e4a6-4a84-a427-6c28df04f6e5 tempest-VolumeDependencyTests-1552907241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-94917c13-8ff3-4652-a116-abe3a2e80337" returned: 0 in 0.376s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:18 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-72202f80-e4a6-4a84-a427-6c28df04f6e5 tempest-VolumeDependencyTests-1552907241 None] Lock "cinder-quobyte-94917c13-8ff3-4652-a116-abe3a2e80337" released by "delete_volume" :: held 0.923s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-36420652-870a-4724-8d97-72c42784fb77 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-36420652-870a-4724-8d97-72c42784fb77 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:18 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-36420652-870a-4724-8d97-72c42784fb77 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:18 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-36420652-870a-4724-8d97-72c42784fb77 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-36420652-870a-4724-8d97-72c42784fb77 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-36420652-870a-4724-8d97-72c42784fb77 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:18 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-72202f80-e4a6-4a84-a427-6c28df04f6e5 tempest-VolumeDependencyTests-1552907241 None] Created reservations ['917fbefc-5f5f-4f78-b692-6192e4ef09e8', '70235145-0100-44d0-b2a7-c07cea8a76c4', '3debbaf3-36d2-4a29-a1d9-b0704b5b7e3d', 'ef17c42d-03f5-453b-a0ad-634871ff39de'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:58:18 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:58:18 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-72202f80-e4a6-4a84-a427-6c28df04f6e5 tempest-VolumeDependencyTests-1552907241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-72202f80-e4a6-4a84-a427-6c28df04f6e5 tempest-VolumeDependencyTests-1552907241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:18 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-72202f80-e4a6-4a84-a427-6c28df04f6e5 tempest-VolumeDependencyTests-1552907241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:18 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-72202f80-e4a6-4a84-a427-6c28df04f6e5 tempest-VolumeDependencyTests-1552907241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-72202f80-e4a6-4a84-a427-6c28df04f6e5 tempest-VolumeDependencyTests-1552907241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-72202f80-e4a6-4a84-a427-6c28df04f6e5 tempest-VolumeDependencyTests-1552907241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:18 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:58:18 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:18 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-29f142df-b314-4ca2-93b0-573803518c75 tempest-CinderUnicodeTest-1241636539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6.4503d317-4a67-4ce6-96c6-b3c27393abc0 1G" returned: 0 in 0.632s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-29f142df-b314-4ca2-93b0-573803518c75 tempest-CinderUnicodeTest-1241636539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a544b99-f327-41d7-b39e-08aa5362e6a6 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6.4503d317-4a67-4ce6-96c6-b3c27393abc0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:18 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a544b99-f327-41d7-b39e-08aa5362e6a6 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6.4503d317-4a67-4ce6-96c6-b3c27393abc0 Sep 10 16:58:18 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:18 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:18 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-36420652-870a-4724-8d97-72c42784fb77 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.530s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:18 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-36420652-870a-4724-8d97-72c42784fb77 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:58:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-72202f80-e4a6-4a84-a427-6c28df04f6e5 tempest-VolumeDependencyTests-1552907241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.319s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:18 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-72202f80-e4a6-4a84-a427-6c28df04f6e5 tempest-VolumeDependencyTests-1552907241 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:58:18 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-36420652-870a-4724-8d97-72c42784fb77 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Deleted volume successfully. Sep 10 16:58:18 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-36420652-870a-4724-8d97-72c42784fb77 tempest-CreateVolumesFromSourceVolumeTest-738548049 None] Lock "cinder-7bac3796-3390-43ae-bd98-da4a71c40083-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:18 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-72202f80-e4a6-4a84-a427-6c28df04f6e5 tempest-VolumeDependencyTests-1552907241 None] Deleted volume successfully. Sep 10 16:58:18 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-72202f80-e4a6-4a84-a427-6c28df04f6e5 tempest-VolumeDependencyTests-1552907241 None] Lock "cinder-94917c13-8ff3-4652-a116-abe3a2e80337-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:18 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-29f142df-b314-4ca2-93b0-573803518c75 tempest-CinderUnicodeTest-1241636539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a544b99-f327-41d7-b39e-08aa5362e6a6 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6.4503d317-4a67-4ce6-96c6-b3c27393abc0" returned: 0 in 0.354s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:18 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-29f142df-b314-4ca2-93b0-573803518c75 tempest-CinderUnicodeTest-1241636539 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6.4503d317-4a67-4ce6-96c6-b3c27393abc0 is being set with open permissions: ugo+rw Sep 10 16:58:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-29f142df-b314-4ca2-93b0-573803518c75 tempest-CinderUnicodeTest-1241636539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6.4503d317-4a67-4ce6-96c6-b3c27393abc0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:18 devstack sudo[108138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6.4503d317-4a67-4ce6-96c6-b3c27393abc0 Sep 10 16:58:18 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:19 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-29f142df-b314-4ca2-93b0-573803518c75 tempest-CinderUnicodeTest-1241636539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6.4503d317-4a67-4ce6-96c6-b3c27393abc0" returned: 0 in 0.299s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-29f142df-b314-4ca2-93b0-573803518c75 tempest-CinderUnicodeTest-1241636539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:19 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6.info Sep 10 16:58:19 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:19 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d9362e2-7c6e-4fcf-973c-39f9a7a24115 tempest-CreateVolumesFromSnapshotTest-266358743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:58:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8d9362e2-7c6e-4fcf-973c-39f9a7a24115 tempest-CreateVolumesFromSnapshotTest-266358743 None] Flow 'volume_create_manager' (f2a2f2c0-56b7-4bef-8a68-6983f52ae07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8d9362e2-7c6e-4fcf-973c-39f9a7a24115 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa9035d4-afe4-45a4-a954-e48ae9df9eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8d9362e2-7c6e-4fcf-973c-39f9a7a24115 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa9035d4-afe4-45a4-a954-e48ae9df9eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-240622581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3291b7b5-deca-40ee-ba7f-2c5042c7caf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15fb9f1c7b3b4c04813959ba68cd66b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:19Z,use_quota=True,user_id='b0c203c3917c473a95c020b65ef44103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8d9362e2-7c6e-4fcf-973c-39f9a7a24115 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b6c9320-0405-4f30-aae4-f03b6daee25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8d9362e2-7c6e-4fcf-973c-39f9a7a24115 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b6c9320-0405-4f30-aae4-f03b6daee25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8d9362e2-7c6e-4fcf-973c-39f9a7a24115 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104d4925-abc8-4caa-be9d-777f7e913603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8d9362e2-7c6e-4fcf-973c-39f9a7a24115 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104d4925-abc8-4caa-be9d-777f7e913603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3291b7b5-deca-40ee-ba7f-2c5042c7caf4', 'volume_name': 'volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8d9362e2-7c6e-4fcf-973c-39f9a7a24115 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e58c2033-de8d-4598-bec9-858f09efa4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8d9362e2-7c6e-4fcf-973c-39f9a7a24115 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e58c2033-de8d-4598-bec9-858f09efa4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8d9362e2-7c6e-4fcf-973c-39f9a7a24115 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0768238-81b6-412e-8e0f-5e985d52be4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:19 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-8d9362e2-7c6e-4fcf-973c-39f9a7a24115 tempest-CreateVolumesFromSnapshotTest-266358743 None] Volume 3291b7b5-deca-40ee-ba7f-2c5042c7caf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4', 'volume_size': 1} Sep 10 16:58:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8d9362e2-7c6e-4fcf-973c-39f9a7a24115 tempest-CreateVolumesFromSnapshotTest-266358743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:19 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a76d1f5e-ee32-4b25-8405-60fc13637637 tempest-VolumeDependencyTests-1552907241 None] Acquiring lock "cinder-98efc725-c418-4a35-88bd-c8e4f00d2389-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:19 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a76d1f5e-ee32-4b25-8405-60fc13637637 tempest-VolumeDependencyTests-1552907241 None] Lock "cinder-98efc725-c418-4a35-88bd-c8e4f00d2389-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:19 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a76d1f5e-ee32-4b25-8405-60fc13637637 tempest-VolumeDependencyTests-1552907241 None] Acquiring lock "cinder-quobyte-98efc725-c418-4a35-88bd-c8e4f00d2389" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:19 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a76d1f5e-ee32-4b25-8405-60fc13637637 tempest-VolumeDependencyTests-1552907241 None] Lock "cinder-quobyte-98efc725-c418-4a35-88bd-c8e4f00d2389" acquired by "delete_volume" :: waited 0.026s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:19 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-29f142df-b314-4ca2-93b0-573803518c75 tempest-CinderUnicodeTest-1241636539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6.info" returned: 0 in 0.337s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:19 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-29f142df-b314-4ca2-93b0-573803518c75 tempest-CinderUnicodeTest-1241636539 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6.info is being set with open permissions: ugo+rw Sep 10 16:58:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-29f142df-b314-4ca2-93b0-573803518c75 tempest-CinderUnicodeTest-1241636539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:19 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8476cd53-02ba-4e72-b295-0ae043584a1c]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a76d1f5e-ee32-4b25-8405-60fc13637637 tempest-VolumeDependencyTests-1552907241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-98efc725-c418-4a35-88bd-c8e4f00d2389 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:19 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6.info Sep 10 16:58:19 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:19 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-98efc725-c418-4a35-88bd-c8e4f00d2389 Sep 10 16:58:19 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:19 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-29f142df-b314-4ca2-93b0-573803518c75 tempest-CinderUnicodeTest-1241636539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6.info" returned: 0 in 0.302s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-29f142df-b314-4ca2-93b0-573803518c75 tempest-CinderUnicodeTest-1241636539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.588s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8d9362e2-7c6e-4fcf-973c-39f9a7a24115 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.454s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:19 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8d9362e2-7c6e-4fcf-973c-39f9a7a24115 tempest-CreateVolumesFromSnapshotTest-266358743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-240622581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3291b7b5-deca-40ee-ba7f-2c5042c7caf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15fb9f1c7b3b4c04813959ba68cd66b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:19Z,use_quota=True,user_id='b0c203c3917c473a95c020b65ef44103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:58:19 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-8d9362e2-7c6e-4fcf-973c-39f9a7a24115 tempest-CreateVolumesFromSnapshotTest-266358743 None] Creating volume 3291b7b5-deca-40ee-ba7f-2c5042c7caf4 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:58:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8d9362e2-7c6e-4fcf-973c-39f9a7a24115 tempest-CreateVolumesFromSnapshotTest-266358743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8d9362e2-7c6e-4fcf-973c-39f9a7a24115 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:19 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8d9362e2-7c6e-4fcf-973c-39f9a7a24115 tempest-CreateVolumesFromSnapshotTest-266358743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:19 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8d9362e2-7c6e-4fcf-973c-39f9a7a24115 tempest-CreateVolumesFromSnapshotTest-266358743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8d9362e2-7c6e-4fcf-973c-39f9a7a24115 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:19 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8d9362e2-7c6e-4fcf-973c-39f9a7a24115 tempest-CreateVolumesFromSnapshotTest-266358743 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:58:19 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-8d9362e2-7c6e-4fcf-973c-39f9a7a24115 tempest-CreateVolumesFromSnapshotTest-266358743 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:58:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8d9362e2-7c6e-4fcf-973c-39f9a7a24115 tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:19 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4 1073741824 Sep 10 16:58:19 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:19 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-29f142df-b314-4ca2-93b0-573803518c75 tempest-CinderUnicodeTest-1241636539 None] Create snapshot completed successfully Sep 10 16:58:20 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a76d1f5e-ee32-4b25-8405-60fc13637637 tempest-VolumeDependencyTests-1552907241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-98efc725-c418-4a35-88bd-c8e4f00d2389" returned: 0 in 0.476s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a76d1f5e-ee32-4b25-8405-60fc13637637 tempest-VolumeDependencyTests-1552907241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-98efc725-c418-4a35-88bd-c8e4f00d2389 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:20 devstack sudo[108190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-98efc725-c418-4a35-88bd-c8e4f00d2389 Sep 10 16:58:20 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:20 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a76d1f5e-ee32-4b25-8405-60fc13637637 tempest-VolumeDependencyTests-1552907241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-98efc725-c418-4a35-88bd-c8e4f00d2389" returned: 0 in 0.360s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:20 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a76d1f5e-ee32-4b25-8405-60fc13637637 tempest-VolumeDependencyTests-1552907241 None] Lock "cinder-quobyte-98efc725-c418-4a35-88bd-c8e4f00d2389" released by "delete_volume" :: held 0.907s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:20 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8d9362e2-7c6e-4fcf-973c-39f9a7a24115 tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4 1073741824" returned: 0 in 0.549s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8d9362e2-7c6e-4fcf-973c-39f9a7a24115 tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:20 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9fca85b3-130a-4e24-9af0-1b145fe80a3e tempest-CinderUnicodeTest-1241636539 None] Acquiring lock "cinder-4503d317-4a67-4ce6-96c6-b3c27393abc0-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:20 devstack sudo[108197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4 Sep 10 16:58:20 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:20 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-a76d1f5e-ee32-4b25-8405-60fc13637637 tempest-VolumeDependencyTests-1552907241 None] Created reservations ['d9039bcc-2727-4a26-9ac3-64f024eabf78', '74d15a02-d2aa-49e9-ac43-79ab443b0457', 'ebff4938-7953-420b-8f38-97efa925ef27', '4050f7a8-2356-4a57-ba25-4d6689b80bfb'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:58:20 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9fca85b3-130a-4e24-9af0-1b145fe80a3e tempest-CinderUnicodeTest-1241636539 None] Lock "cinder-4503d317-4a67-4ce6-96c6-b3c27393abc0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:20 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9fca85b3-130a-4e24-9af0-1b145fe80a3e tempest-CinderUnicodeTest-1241636539 None] Acquiring lock "cinder-quobyte-8a544b99-f327-41d7-b39e-08aa5362e6a6" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:20 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9fca85b3-130a-4e24-9af0-1b145fe80a3e tempest-CinderUnicodeTest-1241636539 None] Lock "cinder-quobyte-8a544b99-f327-41d7-b39e-08aa5362e6a6" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:20 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9fca85b3-130a-4e24-9af0-1b145fe80a3e tempest-CinderUnicodeTest-1241636539 None] Acquiring lock "cinder-quobyte-4503d317-4a67-4ce6-96c6-b3c27393abc0" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:20 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9fca85b3-130a-4e24-9af0-1b145fe80a3e tempest-CinderUnicodeTest-1241636539 None] Lock "cinder-quobyte-4503d317-4a67-4ce6-96c6-b3c27393abc0" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:20 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-9fca85b3-130a-4e24-9af0-1b145fe80a3e tempest-CinderUnicodeTest-1241636539 None] Deleting offline snapshot 4503d317-4a67-4ce6-96c6-b3c27393abc0 of volume 8a544b99-f327-41d7-b39e-08aa5362e6a6 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:58:20 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-9fca85b3-130a-4e24-9af0-1b145fe80a3e tempest-CinderUnicodeTest-1241636539 None] snapshot_file for this snap is: volume-8a544b99-f327-41d7-b39e-08aa5362e6a6.4503d317-4a67-4ce6-96c6-b3c27393abc0 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:58:20 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ead70b-243c-43f9-a2cb-efeb350522d3]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9fca85b3-130a-4e24-9af0-1b145fe80a3e tempest-CinderUnicodeTest-1241636539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6.4503d317-4a67-4ce6-96c6-b3c27393abc0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a76d1f5e-ee32-4b25-8405-60fc13637637 tempest-VolumeDependencyTests-1552907241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a76d1f5e-ee32-4b25-8405-60fc13637637 tempest-VolumeDependencyTests-1552907241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:20 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-a76d1f5e-ee32-4b25-8405-60fc13637637 tempest-VolumeDependencyTests-1552907241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:20 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-a76d1f5e-ee32-4b25-8405-60fc13637637 tempest-VolumeDependencyTests-1552907241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a76d1f5e-ee32-4b25-8405-60fc13637637 tempest-VolumeDependencyTests-1552907241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a76d1f5e-ee32-4b25-8405-60fc13637637 tempest-VolumeDependencyTests-1552907241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:20 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:58:20 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:20 devstack sudo[108199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6.4503d317-4a67-4ce6-96c6-b3c27393abc0 Sep 10 16:58:20 devstack sudo[108199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:20 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8d9362e2-7c6e-4fcf-973c-39f9a7a24115 tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4" returned: 0 in 0.319s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:20 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8d9362e2-7c6e-4fcf-973c-39f9a7a24115 tempest-CreateVolumesFromSnapshotTest-266358743 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:58:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8d9362e2-7c6e-4fcf-973c-39f9a7a24115 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:20 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8d9362e2-7c6e-4fcf-973c-39f9a7a24115 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0768238-81b6-412e-8e0f-5e985d52be4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:20 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8d9362e2-7c6e-4fcf-973c-39f9a7a24115 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77687460-39cc-44dd-9760-314dc00d2611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:20 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-8d9362e2-7c6e-4fcf-973c-39f9a7a24115 tempest-CreateVolumesFromSnapshotTest-266358743 None] Volume volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4 (3291b7b5-deca-40ee-ba7f-2c5042c7caf4): created successfully Sep 10 16:58:20 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8d9362e2-7c6e-4fcf-973c-39f9a7a24115 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77687460-39cc-44dd-9760-314dc00d2611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:20 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8d9362e2-7c6e-4fcf-973c-39f9a7a24115 tempest-CreateVolumesFromSnapshotTest-266358743 None] Flow 'volume_create_manager' (f2a2f2c0-56b7-4bef-8a68-6983f52ae07b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:20 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-8d9362e2-7c6e-4fcf-973c-39f9a7a24115 tempest-CreateVolumesFromSnapshotTest-266358743 None] Created volume successfully. Sep 10 16:58:21 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a76d1f5e-ee32-4b25-8405-60fc13637637 tempest-VolumeDependencyTests-1552907241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.285s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:21 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-a76d1f5e-ee32-4b25-8405-60fc13637637 tempest-VolumeDependencyTests-1552907241 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:58:21 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-a76d1f5e-ee32-4b25-8405-60fc13637637 tempest-VolumeDependencyTests-1552907241 None] Deleted volume successfully. Sep 10 16:58:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a76d1f5e-ee32-4b25-8405-60fc13637637 tempest-VolumeDependencyTests-1552907241 None] Lock "cinder-98efc725-c418-4a35-88bd-c8e4f00d2389-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:21 devstack sudo[108199]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9fca85b3-130a-4e24-9af0-1b145fe80a3e tempest-CinderUnicodeTest-1241636539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6.4503d317-4a67-4ce6-96c6-b3c27393abc0" returned: 0 in 0.425s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:21 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-9fca85b3-130a-4e24-9af0-1b145fe80a3e tempest-CinderUnicodeTest-1241636539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a544b99-f327-41d7-b39e-08aa5362e6a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:58:21 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d05990c-7c54-4b86-abff-9c3ac63dc982]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9fca85b3-130a-4e24-9af0-1b145fe80a3e tempest-CinderUnicodeTest-1241636539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:21 devstack sudo[108209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6 Sep 10 16:58:21 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:21 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9fca85b3-130a-4e24-9af0-1b145fe80a3e tempest-CinderUnicodeTest-1241636539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6" returned: 0 in 0.411s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9fca85b3-130a-4e24-9af0-1b145fe80a3e tempest-CinderUnicodeTest-1241636539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6.4503d317-4a67-4ce6-96c6-b3c27393abc0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:21 devstack sudo[108215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6.4503d317-4a67-4ce6-96c6-b3c27393abc0 Sep 10 16:58:21 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0be806d9-5981-452d-8053-32927279d21a tempest-CreateVolumesFromSnapshotTest-266358743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0be806d9-5981-452d-8053-32927279d21a tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:21 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-0be806d9-5981-452d-8053-32927279d21a tempest-CreateVolumesFromSnapshotTest-266358743 None] Creating offline snapshot d707112d-5046-400c-8332-76af4fa76beb of volume 3291b7b5-deca-40ee-ba7f-2c5042c7caf4 {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:58:21 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f5e088-d1f9-4cc9-aa5c-391da1c363d1]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0be806d9-5981-452d-8053-32927279d21a tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:21 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4 Sep 10 16:58:21 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:21 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9fca85b3-130a-4e24-9af0-1b145fe80a3e tempest-CinderUnicodeTest-1241636539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6.4503d317-4a67-4ce6-96c6-b3c27393abc0" returned: 0 in 0.441s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9fca85b3-130a-4e24-9af0-1b145fe80a3e tempest-CinderUnicodeTest-1241636539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6.4503d317-4a67-4ce6-96c6-b3c27393abc0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:21 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6.4503d317-4a67-4ce6-96c6-b3c27393abc0 Sep 10 16:58:21 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:22 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0be806d9-5981-452d-8053-32927279d21a tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4" returned: 0 in 0.457s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0be806d9-5981-452d-8053-32927279d21a tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4.d707112d-5046-400c-8332-76af4fa76beb 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:22 devstack sudo[108228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4.d707112d-5046-400c-8332-76af4fa76beb 1G Sep 10 16:58:22 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:22 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9fca85b3-130a-4e24-9af0-1b145fe80a3e tempest-CinderUnicodeTest-1241636539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6.4503d317-4a67-4ce6-96c6-b3c27393abc0" returned: 0 in 0.299s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:22 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9fca85b3-130a-4e24-9af0-1b145fe80a3e tempest-CinderUnicodeTest-1241636539 None] Lock "cinder-quobyte-4503d317-4a67-4ce6-96c6-b3c27393abc0" released by "_delete_snapshot" :: held 1.712s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:22 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9fca85b3-130a-4e24-9af0-1b145fe80a3e tempest-CinderUnicodeTest-1241636539 None] Lock "cinder-quobyte-8a544b99-f327-41d7-b39e-08aa5362e6a6" released by "delete_snapshot" :: held 1.746s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:22 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-9fca85b3-130a-4e24-9af0-1b145fe80a3e tempest-CinderUnicodeTest-1241636539 None] Created reservations ['85a8d6bb-3e2d-440c-88be-21b941875cb6', 'bd806290-8227-40d1-bfc2-912651fa8ba8', '11728826-711f-486e-895a-e3196706d7a5', 'b3bc7299-0ec3-4cd8-84f4-d863d70cb236'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:58:22 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-9fca85b3-130a-4e24-9af0-1b145fe80a3e tempest-CinderUnicodeTest-1241636539 None] Delete snapshot completed successfully. Sep 10 16:58:22 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9fca85b3-130a-4e24-9af0-1b145fe80a3e tempest-CinderUnicodeTest-1241636539 None] Lock "cinder-4503d317-4a67-4ce6-96c6-b3c27393abc0-delete_snapshot" released by "delete_snapshot" :: held 1.932s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:22 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0be806d9-5981-452d-8053-32927279d21a tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4.d707112d-5046-400c-8332-76af4fa76beb 1G" returned: 0 in 0.513s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0be806d9-5981-452d-8053-32927279d21a tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4.d707112d-5046-400c-8332-76af4fa76beb {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:22 devstack sudo[108235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4.d707112d-5046-400c-8332-76af4fa76beb Sep 10 16:58:22 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:22 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b4cb4ea4-9b45-43cc-962e-8f2ba37c6a23 tempest-CinderUnicodeTest-1241636539 None] Acquiring lock "cinder-8a544b99-f327-41d7-b39e-08aa5362e6a6-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:22 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b4cb4ea4-9b45-43cc-962e-8f2ba37c6a23 tempest-CinderUnicodeTest-1241636539 None] Lock "cinder-8a544b99-f327-41d7-b39e-08aa5362e6a6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:22 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b4cb4ea4-9b45-43cc-962e-8f2ba37c6a23 tempest-CinderUnicodeTest-1241636539 None] Acquiring lock "cinder-quobyte-8a544b99-f327-41d7-b39e-08aa5362e6a6" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:22 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b4cb4ea4-9b45-43cc-962e-8f2ba37c6a23 tempest-CinderUnicodeTest-1241636539 None] Lock "cinder-quobyte-8a544b99-f327-41d7-b39e-08aa5362e6a6" acquired by "delete_volume" :: waited 0.020s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:22 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[68071551-5235-4938-b115-e367f56a23c3]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b4cb4ea4-9b45-43cc-962e-8f2ba37c6a23 tempest-CinderUnicodeTest-1241636539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:23 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0be806d9-5981-452d-8053-32927279d21a tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4.d707112d-5046-400c-8332-76af4fa76beb" returned: 0 in 0.451s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:23 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-0be806d9-5981-452d-8053-32927279d21a tempest-CreateVolumesFromSnapshotTest-266358743 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4.d707112d-5046-400c-8332-76af4fa76beb is being set with open permissions: ugo+rw Sep 10 16:58:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0be806d9-5981-452d-8053-32927279d21a tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4.d707112d-5046-400c-8332-76af4fa76beb {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:23 devstack sudo[108237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6 Sep 10 16:58:23 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:23 devstack sudo[108242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4.d707112d-5046-400c-8332-76af4fa76beb Sep 10 16:58:23 devstack sudo[108242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:23 devstack sudo[108242]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0be806d9-5981-452d-8053-32927279d21a tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4.d707112d-5046-400c-8332-76af4fa76beb" returned: 0 in 0.283s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:23 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b4cb4ea4-9b45-43cc-962e-8f2ba37c6a23 tempest-CinderUnicodeTest-1241636539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6" returned: 0 in 0.440s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b4cb4ea4-9b45-43cc-962e-8f2ba37c6a23 tempest-CinderUnicodeTest-1241636539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0be806d9-5981-452d-8053-32927279d21a tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:23 devstack sudo[108250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6 Sep 10 16:58:23 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:23 devstack sudo[108252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4.info Sep 10 16:58:23 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:23 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b4cb4ea4-9b45-43cc-962e-8f2ba37c6a23 tempest-CinderUnicodeTest-1241636539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8a544b99-f327-41d7-b39e-08aa5362e6a6" returned: 0 in 0.304s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:23 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b4cb4ea4-9b45-43cc-962e-8f2ba37c6a23 tempest-CinderUnicodeTest-1241636539 None] Lock "cinder-quobyte-8a544b99-f327-41d7-b39e-08aa5362e6a6" released by "delete_volume" :: held 0.828s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:23 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:23 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-b4cb4ea4-9b45-43cc-962e-8f2ba37c6a23 tempest-CinderUnicodeTest-1241636539 None] Created reservations ['47372c6d-9497-47f9-a684-2125d3947344', '2147061f-9d77-4c97-93ca-1210593407a2', '4d246890-5658-40f3-92f7-e7678d730897', '3caf85ce-2356-4099-addf-230a061d6a64'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:58:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0be806d9-5981-452d-8053-32927279d21a tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4.info" returned: 0 in 0.368s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:23 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-0be806d9-5981-452d-8053-32927279d21a tempest-CreateVolumesFromSnapshotTest-266358743 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4.info is being set with open permissions: ugo+rw Sep 10 16:58:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0be806d9-5981-452d-8053-32927279d21a tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:23 devstack sudo[108256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4.info Sep 10 16:58:23 devstack sudo[108256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b4cb4ea4-9b45-43cc-962e-8f2ba37c6a23 tempest-CinderUnicodeTest-1241636539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b4cb4ea4-9b45-43cc-962e-8f2ba37c6a23 tempest-CinderUnicodeTest-1241636539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:23 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b4cb4ea4-9b45-43cc-962e-8f2ba37c6a23 tempest-CinderUnicodeTest-1241636539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:23 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b4cb4ea4-9b45-43cc-962e-8f2ba37c6a23 tempest-CinderUnicodeTest-1241636539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b4cb4ea4-9b45-43cc-962e-8f2ba37c6a23 tempest-CinderUnicodeTest-1241636539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b4cb4ea4-9b45-43cc-962e-8f2ba37c6a23 tempest-CinderUnicodeTest-1241636539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:23 devstack sudo[108258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:58:23 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:23 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-288adfdb-3c5f-4871-9b99-5d1b638149b2 tempest-CinderUnicodeTest-1241636539 None] Acquiring lock "cinder-7aa40b81-6e49-4d03-a295-1b5d959607f1-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:24 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-288adfdb-3c5f-4871-9b99-5d1b638149b2 tempest-CinderUnicodeTest-1241636539 None] Lock "cinder-7aa40b81-6e49-4d03-a295-1b5d959607f1-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:24 devstack sudo[108256]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0be806d9-5981-452d-8053-32927279d21a tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4.info" returned: 0 in 0.292s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-0be806d9-5981-452d-8053-32927279d21a tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.522s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:24 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-0be806d9-5981-452d-8053-32927279d21a tempest-CreateVolumesFromSnapshotTest-266358743 None] Create snapshot completed successfully Sep 10 16:58:24 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-288adfdb-3c5f-4871-9b99-5d1b638149b2 tempest-CinderUnicodeTest-1241636539 None] Acquiring lock "cinder-quobyte-7aa40b81-6e49-4d03-a295-1b5d959607f1" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:24 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-288adfdb-3c5f-4871-9b99-5d1b638149b2 tempest-CinderUnicodeTest-1241636539 None] Lock "cinder-quobyte-7aa40b81-6e49-4d03-a295-1b5d959607f1" acquired by "delete_volume" :: waited 0.020s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:24 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c264929-9f1c-47bb-ba63-68b99d6bb51d]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-288adfdb-3c5f-4871-9b99-5d1b638149b2 tempest-CinderUnicodeTest-1241636539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7aa40b81-6e49-4d03-a295-1b5d959607f1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:24 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b4cb4ea4-9b45-43cc-962e-8f2ba37c6a23 tempest-CinderUnicodeTest-1241636539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.346s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:24 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-b4cb4ea4-9b45-43cc-962e-8f2ba37c6a23 tempest-CinderUnicodeTest-1241636539 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:58:24 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-b4cb4ea4-9b45-43cc-962e-8f2ba37c6a23 tempest-CinderUnicodeTest-1241636539 None] Deleted volume successfully. Sep 10 16:58:24 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b4cb4ea4-9b45-43cc-962e-8f2ba37c6a23 tempest-CinderUnicodeTest-1241636539 None] Lock "cinder-8a544b99-f327-41d7-b39e-08aa5362e6a6-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:24 devstack sudo[108262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7aa40b81-6e49-4d03-a295-1b5d959607f1 Sep 10 16:58:24 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:24 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-288adfdb-3c5f-4871-9b99-5d1b638149b2 tempest-CinderUnicodeTest-1241636539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7aa40b81-6e49-4d03-a295-1b5d959607f1" returned: 0 in 0.428s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-288adfdb-3c5f-4871-9b99-5d1b638149b2 tempest-CinderUnicodeTest-1241636539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7aa40b81-6e49-4d03-a295-1b5d959607f1 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:24 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7aa40b81-6e49-4d03-a295-1b5d959607f1 Sep 10 16:58:24 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:24 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-288adfdb-3c5f-4871-9b99-5d1b638149b2 tempest-CinderUnicodeTest-1241636539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-7aa40b81-6e49-4d03-a295-1b5d959607f1" returned: 0 in 0.303s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:24 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-288adfdb-3c5f-4871-9b99-5d1b638149b2 tempest-CinderUnicodeTest-1241636539 None] Lock "cinder-quobyte-7aa40b81-6e49-4d03-a295-1b5d959607f1" released by "delete_volume" :: held 0.795s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:25 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-288adfdb-3c5f-4871-9b99-5d1b638149b2 tempest-CinderUnicodeTest-1241636539 None] Created reservations ['847f3b65-bb1a-4a9f-bb8c-1b2980dff709', 'e1f0428b-bc3d-4d5e-aa60-151442bb77b4', '6f26784b-49c2-47fb-ba9a-f7f3c4b72204', 'da0ce12f-0cd8-486b-84f8-ab22d051a094'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:58:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-288adfdb-3c5f-4871-9b99-5d1b638149b2 tempest-CinderUnicodeTest-1241636539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-288adfdb-3c5f-4871-9b99-5d1b638149b2 tempest-CinderUnicodeTest-1241636539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-288adfdb-3c5f-4871-9b99-5d1b638149b2 tempest-CinderUnicodeTest-1241636539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-288adfdb-3c5f-4871-9b99-5d1b638149b2 tempest-CinderUnicodeTest-1241636539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-288adfdb-3c5f-4871-9b99-5d1b638149b2 tempest-CinderUnicodeTest-1241636539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-288adfdb-3c5f-4871-9b99-5d1b638149b2 tempest-CinderUnicodeTest-1241636539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:25 devstack sudo[108270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:58:25 devstack sudo[108270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:25 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-37e3c862-67ea-426f-8207-b9dcb7f97d0d tempest-CreateVolumesFromSnapshotTest-266358743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:58:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-37e3c862-67ea-426f-8207-b9dcb7f97d0d tempest-CreateVolumesFromSnapshotTest-266358743 None] Flow 'volume_create_manager' (9dcecf91-d6c5-407d-839c-5c933f8f9213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-37e3c862-67ea-426f-8207-b9dcb7f97d0d tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5c1b94-1991-46ee-bc91-5e88fa94f1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-37e3c862-67ea-426f-8207-b9dcb7f97d0d tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5c1b94-1991-46ee-bc91-5e88fa94f1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1640389084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b93e8329-969c-470e-b30d-85b32e942ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15fb9f1c7b3b4c04813959ba68cd66b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:25Z,use_quota=True,user_id='b0c203c3917c473a95c020b65ef44103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-37e3c862-67ea-426f-8207-b9dcb7f97d0d tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce999ff-6a2c-4e3b-a8f8-b110001d9d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-37e3c862-67ea-426f-8207-b9dcb7f97d0d tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce999ff-6a2c-4e3b-a8f8-b110001d9d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-37e3c862-67ea-426f-8207-b9dcb7f97d0d tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e759d6b4-be2f-4b79-b583-95ae4a132fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-37e3c862-67ea-426f-8207-b9dcb7f97d0d tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e759d6b4-be2f-4b79-b583-95ae4a132fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b93e8329-969c-470e-b30d-85b32e942ceb', 'volume_name': 'volume-b93e8329-969c-470e-b30d-85b32e942ceb', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-37e3c862-67ea-426f-8207-b9dcb7f97d0d tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d802d990-d074-4686-b0bb-453f9af6a4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-37e3c862-67ea-426f-8207-b9dcb7f97d0d tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d802d990-d074-4686-b0bb-453f9af6a4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:25 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-37e3c862-67ea-426f-8207-b9dcb7f97d0d tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d99c7fb-a7aa-4b19-a12e-27568bfb9835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:25 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-37e3c862-67ea-426f-8207-b9dcb7f97d0d tempest-CreateVolumesFromSnapshotTest-266358743 None] Volume b93e8329-969c-470e-b30d-85b32e942ceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b93e8329-969c-470e-b30d-85b32e942ceb', 'volume_size': 1} Sep 10 16:58:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-37e3c862-67ea-426f-8207-b9dcb7f97d0d tempest-CreateVolumesFromSnapshotTest-266358743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-37e3c862-67ea-426f-8207-b9dcb7f97d0d tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-37e3c862-67ea-426f-8207-b9dcb7f97d0d tempest-CreateVolumesFromSnapshotTest-266358743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1640389084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b93e8329-969c-470e-b30d-85b32e942ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15fb9f1c7b3b4c04813959ba68cd66b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:25Z,use_quota=True,user_id='b0c203c3917c473a95c020b65ef44103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:58:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-37e3c862-67ea-426f-8207-b9dcb7f97d0d tempest-CreateVolumesFromSnapshotTest-266358743 None] Creating volume b93e8329-969c-470e-b30d-85b32e942ceb {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:58:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-37e3c862-67ea-426f-8207-b9dcb7f97d0d tempest-CreateVolumesFromSnapshotTest-266358743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-37e3c862-67ea-426f-8207-b9dcb7f97d0d tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-37e3c862-67ea-426f-8207-b9dcb7f97d0d tempest-CreateVolumesFromSnapshotTest-266358743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-37e3c862-67ea-426f-8207-b9dcb7f97d0d tempest-CreateVolumesFromSnapshotTest-266358743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:25 devstack sudo[108270]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-37e3c862-67ea-426f-8207-b9dcb7f97d0d tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-37e3c862-67ea-426f-8207-b9dcb7f97d0d tempest-CreateVolumesFromSnapshotTest-266358743 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:58:25 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-37e3c862-67ea-426f-8207-b9dcb7f97d0d tempest-CreateVolumesFromSnapshotTest-266358743 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:58:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-37e3c862-67ea-426f-8207-b9dcb7f97d0d tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b93e8329-969c-470e-b30d-85b32e942ceb 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-288adfdb-3c5f-4871-9b99-5d1b638149b2 tempest-CinderUnicodeTest-1241636539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.488s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:25 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-288adfdb-3c5f-4871-9b99-5d1b638149b2 tempest-CinderUnicodeTest-1241636539 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:58:25 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-288adfdb-3c5f-4871-9b99-5d1b638149b2 tempest-CinderUnicodeTest-1241636539 None] Deleted volume successfully. Sep 10 16:58:25 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b93e8329-969c-470e-b30d-85b32e942ceb 1073741824 Sep 10 16:58:25 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:25 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-288adfdb-3c5f-4871-9b99-5d1b638149b2 tempest-CinderUnicodeTest-1241636539 None] Lock "cinder-7aa40b81-6e49-4d03-a295-1b5d959607f1-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0496748-bc96-4b24-ae7b-19914184ed56 tempest-CreateVolumesFromSnapshotTest-266358743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b0496748-bc96-4b24-ae7b-19914184ed56 tempest-CreateVolumesFromSnapshotTest-266358743 None] Flow 'volume_create_manager' (ef21b7d8-c93e-4d85-bb6d-a388bbba2da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b0496748-bc96-4b24-ae7b-19914184ed56 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e69198d-ca6c-4d32-b14c-d04c1c17e21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b0496748-bc96-4b24-ae7b-19914184ed56 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e69198d-ca6c-4d32-b14c-d04c1c17e21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-157174982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df5793c-a7f7-4003-8462-cd69b36f84c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15fb9f1c7b3b4c04813959ba68cd66b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:26Z,use_quota=True,user_id='b0c203c3917c473a95c020b65ef44103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b0496748-bc96-4b24-ae7b-19914184ed56 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a41b8c-c4cc-4e11-90bf-6878e37528b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b0496748-bc96-4b24-ae7b-19914184ed56 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a41b8c-c4cc-4e11-90bf-6878e37528b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b0496748-bc96-4b24-ae7b-19914184ed56 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5b501d-cbcc-40ac-848f-f42054aa04b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b0496748-bc96-4b24-ae7b-19914184ed56 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5b501d-cbcc-40ac-848f-f42054aa04b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4df5793c-a7f7-4003-8462-cd69b36f84c2', 'volume_name': 'volume-4df5793c-a7f7-4003-8462-cd69b36f84c2', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b0496748-bc96-4b24-ae7b-19914184ed56 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64d16b65-6b83-4729-b5e0-03a3dbe9c5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b0496748-bc96-4b24-ae7b-19914184ed56 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64d16b65-6b83-4729-b5e0-03a3dbe9c5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b0496748-bc96-4b24-ae7b-19914184ed56 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5efc879-acce-4dd0-b0f0-bc479bdca593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:26 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-b0496748-bc96-4b24-ae7b-19914184ed56 tempest-CreateVolumesFromSnapshotTest-266358743 None] Volume 4df5793c-a7f7-4003-8462-cd69b36f84c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4df5793c-a7f7-4003-8462-cd69b36f84c2', 'volume_size': 1} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b0496748-bc96-4b24-ae7b-19914184ed56 tempest-CreateVolumesFromSnapshotTest-266358743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:26 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-37e3c862-67ea-426f-8207-b9dcb7f97d0d tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b93e8329-969c-470e-b30d-85b32e942ceb 1073741824" returned: 0 in 0.593s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-37e3c862-67ea-426f-8207-b9dcb7f97d0d tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b93e8329-969c-470e-b30d-85b32e942ceb {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:26 devstack sudo[108285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b93e8329-969c-470e-b30d-85b32e942ceb Sep 10 16:58:26 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-738e0b87-b917-46cb-85c6-48ea4ca389f2 tempest-CreateVolumesFromSnapshotTest-266358743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-738e0b87-b917-46cb-85c6-48ea4ca389f2 tempest-CreateVolumesFromSnapshotTest-266358743 None] Flow 'volume_create_manager' (a48a2971-7286-4f49-bf6f-fe8a6141cfdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-738e0b87-b917-46cb-85c6-48ea4ca389f2 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4bcaa60-84f4-465f-95a5-119ec8aa0bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-738e0b87-b917-46cb-85c6-48ea4ca389f2 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4bcaa60-84f4-465f-95a5-119ec8aa0bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-323682623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2492d7c-c3b1-4ee3-b712-657e5e78ca49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15fb9f1c7b3b4c04813959ba68cd66b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:26Z,use_quota=True,user_id='b0c203c3917c473a95c020b65ef44103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-738e0b87-b917-46cb-85c6-48ea4ca389f2 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9b30185-8ca7-4880-a319-d80c0326f343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-738e0b87-b917-46cb-85c6-48ea4ca389f2 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9b30185-8ca7-4880-a319-d80c0326f343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-738e0b87-b917-46cb-85c6-48ea4ca389f2 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f583985e-da9d-42e7-8588-d706ad5d61e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-738e0b87-b917-46cb-85c6-48ea4ca389f2 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f583985e-da9d-42e7-8588-d706ad5d61e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2492d7c-c3b1-4ee3-b712-657e5e78ca49', 'volume_name': 'volume-c2492d7c-c3b1-4ee3-b712-657e5e78ca49', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-738e0b87-b917-46cb-85c6-48ea4ca389f2 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb8347dc-5312-48f1-a1fa-83ec7505b079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-738e0b87-b917-46cb-85c6-48ea4ca389f2 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb8347dc-5312-48f1-a1fa-83ec7505b079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-738e0b87-b917-46cb-85c6-48ea4ca389f2 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (641ad424-998e-49d9-8590-5416baf58fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:26 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-738e0b87-b917-46cb-85c6-48ea4ca389f2 tempest-CreateVolumesFromSnapshotTest-266358743 None] Volume c2492d7c-c3b1-4ee3-b712-657e5e78ca49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2492d7c-c3b1-4ee3-b712-657e5e78ca49', 'volume_size': 1} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-738e0b87-b917-46cb-85c6-48ea4ca389f2 tempest-CreateVolumesFromSnapshotTest-266358743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:26 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-37e3c862-67ea-426f-8207-b9dcb7f97d0d tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b93e8329-969c-470e-b30d-85b32e942ceb" returned: 0 in 0.372s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-37e3c862-67ea-426f-8207-b9dcb7f97d0d tempest-CreateVolumesFromSnapshotTest-266358743 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-37e3c862-67ea-426f-8207-b9dcb7f97d0d tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b0496748-bc96-4b24-ae7b-19914184ed56 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.485s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b0496748-bc96-4b24-ae7b-19914184ed56 tempest-CreateVolumesFromSnapshotTest-266358743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-157174982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df5793c-a7f7-4003-8462-cd69b36f84c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15fb9f1c7b3b4c04813959ba68cd66b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:26Z,use_quota=True,user_id='b0c203c3917c473a95c020b65ef44103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-b0496748-bc96-4b24-ae7b-19914184ed56 tempest-CreateVolumesFromSnapshotTest-266358743 None] Creating volume 4df5793c-a7f7-4003-8462-cd69b36f84c2 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b0496748-bc96-4b24-ae7b-19914184ed56 tempest-CreateVolumesFromSnapshotTest-266358743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b0496748-bc96-4b24-ae7b-19914184ed56 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b0496748-bc96-4b24-ae7b-19914184ed56 tempest-CreateVolumesFromSnapshotTest-266358743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b0496748-bc96-4b24-ae7b-19914184ed56 tempest-CreateVolumesFromSnapshotTest-266358743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b0496748-bc96-4b24-ae7b-19914184ed56 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b0496748-bc96-4b24-ae7b-19914184ed56 tempest-CreateVolumesFromSnapshotTest-266358743 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:58:26 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-b0496748-bc96-4b24-ae7b-19914184ed56 tempest-CreateVolumesFromSnapshotTest-266358743 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b0496748-bc96-4b24-ae7b-19914184ed56 tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4df5793c-a7f7-4003-8462-cd69b36f84c2 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:26 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4df5793c-a7f7-4003-8462-cd69b36f84c2 1073741824 Sep 10 16:58:26 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-37e3c862-67ea-426f-8207-b9dcb7f97d0d tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d99c7fb-a7aa-4b19-a12e-27568bfb9835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b93e8329-969c-470e-b30d-85b32e942ceb', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-37e3c862-67ea-426f-8207-b9dcb7f97d0d tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f73403a1-24e4-4a50-be95-d2140e079d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:26 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-37e3c862-67ea-426f-8207-b9dcb7f97d0d tempest-CreateVolumesFromSnapshotTest-266358743 None] Volume volume-b93e8329-969c-470e-b30d-85b32e942ceb (b93e8329-969c-470e-b30d-85b32e942ceb): created successfully Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-37e3c862-67ea-426f-8207-b9dcb7f97d0d tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f73403a1-24e4-4a50-be95-d2140e079d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-37e3c862-67ea-426f-8207-b9dcb7f97d0d tempest-CreateVolumesFromSnapshotTest-266358743 None] Flow 'volume_create_manager' (9dcecf91-d6c5-407d-839c-5c933f8f9213) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:26 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-37e3c862-67ea-426f-8207-b9dcb7f97d0d tempest-CreateVolumesFromSnapshotTest-266358743 None] Created volume successfully. Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b469acf-9867-437b-9245-c1dc6ea61c68 tempest-CreateVolumesFromSnapshotTest-266358743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7b469acf-9867-437b-9245-c1dc6ea61c68 tempest-CreateVolumesFromSnapshotTest-266358743 None] Flow 'volume_create_manager' (e5bff9af-e75b-48a0-a68a-1ee7a27d4f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7b469acf-9867-437b-9245-c1dc6ea61c68 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5265841-cdf2-40e1-a567-21e97ed93e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7b469acf-9867-437b-9245-c1dc6ea61c68 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5265841-cdf2-40e1-a567-21e97ed93e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2050928144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a52fe5-8781-4209-a02e-158fcf47f5cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15fb9f1c7b3b4c04813959ba68cd66b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:27Z,use_quota=True,user_id='b0c203c3917c473a95c020b65ef44103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7b469acf-9867-437b-9245-c1dc6ea61c68 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f28ed64a-441c-4c94-afcb-e8f88d779e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7b469acf-9867-437b-9245-c1dc6ea61c68 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f28ed64a-441c-4c94-afcb-e8f88d779e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7b469acf-9867-437b-9245-c1dc6ea61c68 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b24fa681-8814-421a-8969-937a04ae79f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7b469acf-9867-437b-9245-c1dc6ea61c68 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b24fa681-8814-421a-8969-937a04ae79f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08a52fe5-8781-4209-a02e-158fcf47f5cb', 'volume_name': 'volume-08a52fe5-8781-4209-a02e-158fcf47f5cb', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7b469acf-9867-437b-9245-c1dc6ea61c68 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a766358-9749-467a-91e7-bd36d86a3dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7b469acf-9867-437b-9245-c1dc6ea61c68 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a766358-9749-467a-91e7-bd36d86a3dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7b469acf-9867-437b-9245-c1dc6ea61c68 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c51735fe-85c3-40e5-aa9c-99f1ff65439f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:27 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-7b469acf-9867-437b-9245-c1dc6ea61c68 tempest-CreateVolumesFromSnapshotTest-266358743 None] Volume 08a52fe5-8781-4209-a02e-158fcf47f5cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08a52fe5-8781-4209-a02e-158fcf47f5cb', 'volume_size': 1} Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7b469acf-9867-437b-9245-c1dc6ea61c68 tempest-CreateVolumesFromSnapshotTest-266358743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:27 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b0496748-bc96-4b24-ae7b-19914184ed56 tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4df5793c-a7f7-4003-8462-cd69b36f84c2 1073741824" returned: 0 in 0.801s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-3178710d-9ebe-4cc9-89b8-159121934218 tempest-CreateVolumesFromSnapshotTest-266358743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3178710d-9ebe-4cc9-89b8-159121934218 tempest-CreateVolumesFromSnapshotTest-266358743 None] Flow 'volume_create_manager' (528861ed-e046-46db-b2bc-f1214ae7e3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3178710d-9ebe-4cc9-89b8-159121934218 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3200f96-ee80-4469-b325-45817a7411de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3178710d-9ebe-4cc9-89b8-159121934218 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3200f96-ee80-4469-b325-45817a7411de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-203152096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eca1b8b2-7d55-4516-b9f8-0661b03fee90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15fb9f1c7b3b4c04813959ba68cd66b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:27Z,use_quota=True,user_id='b0c203c3917c473a95c020b65ef44103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3178710d-9ebe-4cc9-89b8-159121934218 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b0cd59d-e113-44ff-b6be-88d6aa87bf90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3178710d-9ebe-4cc9-89b8-159121934218 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b0cd59d-e113-44ff-b6be-88d6aa87bf90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3178710d-9ebe-4cc9-89b8-159121934218 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c350ee44-2f48-4c35-a335-cb202484adff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3178710d-9ebe-4cc9-89b8-159121934218 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c350ee44-2f48-4c35-a335-cb202484adff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eca1b8b2-7d55-4516-b9f8-0661b03fee90', 'volume_name': 'volume-eca1b8b2-7d55-4516-b9f8-0661b03fee90', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3178710d-9ebe-4cc9-89b8-159121934218 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2221ec52-269e-4a26-b634-4ce1e576270e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3178710d-9ebe-4cc9-89b8-159121934218 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2221ec52-269e-4a26-b634-4ce1e576270e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3178710d-9ebe-4cc9-89b8-159121934218 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6badb34-9aaa-4077-b7ac-e59683fafb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:27 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-3178710d-9ebe-4cc9-89b8-159121934218 tempest-CreateVolumesFromSnapshotTest-266358743 None] Volume eca1b8b2-7d55-4516-b9f8-0661b03fee90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eca1b8b2-7d55-4516-b9f8-0661b03fee90', 'volume_size': 1} Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3178710d-9ebe-4cc9-89b8-159121934218 tempest-CreateVolumesFromSnapshotTest-266358743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b0496748-bc96-4b24-ae7b-19914184ed56 tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4df5793c-a7f7-4003-8462-cd69b36f84c2 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:27 devstack sudo[108294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4df5793c-a7f7-4003-8462-cd69b36f84c2 Sep 10 16:58:27 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:27 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b0496748-bc96-4b24-ae7b-19914184ed56 tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4df5793c-a7f7-4003-8462-cd69b36f84c2" returned: 0 in 0.280s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b0496748-bc96-4b24-ae7b-19914184ed56 tempest-CreateVolumesFromSnapshotTest-266358743 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b0496748-bc96-4b24-ae7b-19914184ed56 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-738e0b87-b917-46cb-85c6-48ea4ca389f2 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.422s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-738e0b87-b917-46cb-85c6-48ea4ca389f2 tempest-CreateVolumesFromSnapshotTest-266358743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-323682623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2492d7c-c3b1-4ee3-b712-657e5e78ca49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15fb9f1c7b3b4c04813959ba68cd66b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:26Z,use_quota=True,user_id='b0c203c3917c473a95c020b65ef44103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-738e0b87-b917-46cb-85c6-48ea4ca389f2 tempest-CreateVolumesFromSnapshotTest-266358743 None] Creating volume c2492d7c-c3b1-4ee3-b712-657e5e78ca49 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-738e0b87-b917-46cb-85c6-48ea4ca389f2 tempest-CreateVolumesFromSnapshotTest-266358743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-738e0b87-b917-46cb-85c6-48ea4ca389f2 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-738e0b87-b917-46cb-85c6-48ea4ca389f2 tempest-CreateVolumesFromSnapshotTest-266358743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-738e0b87-b917-46cb-85c6-48ea4ca389f2 tempest-CreateVolumesFromSnapshotTest-266358743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-738e0b87-b917-46cb-85c6-48ea4ca389f2 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-738e0b87-b917-46cb-85c6-48ea4ca389f2 tempest-CreateVolumesFromSnapshotTest-266358743 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:58:27 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-738e0b87-b917-46cb-85c6-48ea4ca389f2 tempest-CreateVolumesFromSnapshotTest-266358743 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:58:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-738e0b87-b917-46cb-85c6-48ea4ca389f2 tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c2492d7c-c3b1-4ee3-b712-657e5e78ca49 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b0496748-bc96-4b24-ae7b-19914184ed56 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5efc879-acce-4dd0-b0f0-bc479bdca593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4df5793c-a7f7-4003-8462-cd69b36f84c2', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:28 devstack sudo[108297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c2492d7c-c3b1-4ee3-b712-657e5e78ca49 1073741824 Sep 10 16:58:28 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b0496748-bc96-4b24-ae7b-19914184ed56 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd9cca2-4f02-450d-b13b-ebf5a0b7b771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:28 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-b0496748-bc96-4b24-ae7b-19914184ed56 tempest-CreateVolumesFromSnapshotTest-266358743 None] Volume volume-4df5793c-a7f7-4003-8462-cd69b36f84c2 (4df5793c-a7f7-4003-8462-cd69b36f84c2): created successfully Sep 10 16:58:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b0496748-bc96-4b24-ae7b-19914184ed56 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd9cca2-4f02-450d-b13b-ebf5a0b7b771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b0496748-bc96-4b24-ae7b-19914184ed56 tempest-CreateVolumesFromSnapshotTest-266358743 None] Flow 'volume_create_manager' (ef21b7d8-c93e-4d85-bb6d-a388bbba2da4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:28 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-b0496748-bc96-4b24-ae7b-19914184ed56 tempest-CreateVolumesFromSnapshotTest-266358743 None] Created volume successfully. Sep 10 16:58:28 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-738e0b87-b917-46cb-85c6-48ea4ca389f2 tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c2492d7c-c3b1-4ee3-b712-657e5e78ca49 1073741824" returned: 0 in 0.480s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-738e0b87-b917-46cb-85c6-48ea4ca389f2 tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c2492d7c-c3b1-4ee3-b712-657e5e78ca49 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:28 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c2492d7c-c3b1-4ee3-b712-657e5e78ca49 Sep 10 16:58:28 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:28 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-738e0b87-b917-46cb-85c6-48ea4ca389f2 tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c2492d7c-c3b1-4ee3-b712-657e5e78ca49" returned: 0 in 0.292s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:28 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-738e0b87-b917-46cb-85c6-48ea4ca389f2 tempest-CreateVolumesFromSnapshotTest-266358743 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:58:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-738e0b87-b917-46cb-85c6-48ea4ca389f2 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7b469acf-9867-437b-9245-c1dc6ea61c68 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.672s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:28 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7b469acf-9867-437b-9245-c1dc6ea61c68 tempest-CreateVolumesFromSnapshotTest-266358743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2050928144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a52fe5-8781-4209-a02e-158fcf47f5cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15fb9f1c7b3b4c04813959ba68cd66b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:27Z,use_quota=True,user_id='b0c203c3917c473a95c020b65ef44103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:58:28 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-7b469acf-9867-437b-9245-c1dc6ea61c68 tempest-CreateVolumesFromSnapshotTest-266358743 None] Creating volume 08a52fe5-8781-4209-a02e-158fcf47f5cb {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:58:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7b469acf-9867-437b-9245-c1dc6ea61c68 tempest-CreateVolumesFromSnapshotTest-266358743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7b469acf-9867-437b-9245-c1dc6ea61c68 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:28 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7b469acf-9867-437b-9245-c1dc6ea61c68 tempest-CreateVolumesFromSnapshotTest-266358743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:28 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7b469acf-9867-437b-9245-c1dc6ea61c68 tempest-CreateVolumesFromSnapshotTest-266358743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7b469acf-9867-437b-9245-c1dc6ea61c68 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:28 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7b469acf-9867-437b-9245-c1dc6ea61c68 tempest-CreateVolumesFromSnapshotTest-266358743 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:58:28 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-7b469acf-9867-437b-9245-c1dc6ea61c68 tempest-CreateVolumesFromSnapshotTest-266358743 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:58:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7b469acf-9867-437b-9245-c1dc6ea61c68 tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-08a52fe5-8781-4209-a02e-158fcf47f5cb 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-738e0b87-b917-46cb-85c6-48ea4ca389f2 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (641ad424-998e-49d9-8590-5416baf58fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2492d7c-c3b1-4ee3-b712-657e5e78ca49', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:28 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-08a52fe5-8781-4209-a02e-158fcf47f5cb 1073741824 Sep 10 16:58:28 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-738e0b87-b917-46cb-85c6-48ea4ca389f2 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b593d66e-6d18-46d3-bccb-0be9dc7b03e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:28 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-738e0b87-b917-46cb-85c6-48ea4ca389f2 tempest-CreateVolumesFromSnapshotTest-266358743 None] Volume volume-c2492d7c-c3b1-4ee3-b712-657e5e78ca49 (c2492d7c-c3b1-4ee3-b712-657e5e78ca49): created successfully Sep 10 16:58:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-738e0b87-b917-46cb-85c6-48ea4ca389f2 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b593d66e-6d18-46d3-bccb-0be9dc7b03e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:28 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-738e0b87-b917-46cb-85c6-48ea4ca389f2 tempest-CreateVolumesFromSnapshotTest-266358743 None] Flow 'volume_create_manager' (a48a2971-7286-4f49-bf6f-fe8a6141cfdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:28 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-738e0b87-b917-46cb-85c6-48ea4ca389f2 tempest-CreateVolumesFromSnapshotTest-266358743 None] Created volume successfully. Sep 10 16:58:29 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7b469acf-9867-437b-9245-c1dc6ea61c68 tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-08a52fe5-8781-4209-a02e-158fcf47f5cb 1073741824" returned: 0 in 0.507s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7b469acf-9867-437b-9245-c1dc6ea61c68 tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-08a52fe5-8781-4209-a02e-158fcf47f5cb {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:29 devstack sudo[108312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-08a52fe5-8781-4209-a02e-158fcf47f5cb Sep 10 16:58:29 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:29 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7b469acf-9867-437b-9245-c1dc6ea61c68 tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-08a52fe5-8781-4209-a02e-158fcf47f5cb" returned: 0 in 0.296s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:29 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7b469acf-9867-437b-9245-c1dc6ea61c68 tempest-CreateVolumesFromSnapshotTest-266358743 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:58:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7b469acf-9867-437b-9245-c1dc6ea61c68 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3178710d-9ebe-4cc9-89b8-159121934218 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.998s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:29 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3178710d-9ebe-4cc9-89b8-159121934218 tempest-CreateVolumesFromSnapshotTest-266358743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-203152096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eca1b8b2-7d55-4516-b9f8-0661b03fee90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15fb9f1c7b3b4c04813959ba68cd66b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:27Z,use_quota=True,user_id='b0c203c3917c473a95c020b65ef44103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:58:29 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-3178710d-9ebe-4cc9-89b8-159121934218 tempest-CreateVolumesFromSnapshotTest-266358743 None] Creating volume eca1b8b2-7d55-4516-b9f8-0661b03fee90 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:58:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3178710d-9ebe-4cc9-89b8-159121934218 tempest-CreateVolumesFromSnapshotTest-266358743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3178710d-9ebe-4cc9-89b8-159121934218 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:29 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3178710d-9ebe-4cc9-89b8-159121934218 tempest-CreateVolumesFromSnapshotTest-266358743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:29 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3178710d-9ebe-4cc9-89b8-159121934218 tempest-CreateVolumesFromSnapshotTest-266358743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3178710d-9ebe-4cc9-89b8-159121934218 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:29 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3178710d-9ebe-4cc9-89b8-159121934218 tempest-CreateVolumesFromSnapshotTest-266358743 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:58:29 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-3178710d-9ebe-4cc9-89b8-159121934218 tempest-CreateVolumesFromSnapshotTest-266358743 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:58:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3178710d-9ebe-4cc9-89b8-159121934218 tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-eca1b8b2-7d55-4516-b9f8-0661b03fee90 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:29 devstack sudo[108315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-eca1b8b2-7d55-4516-b9f8-0661b03fee90 1073741824 Sep 10 16:58:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7b469acf-9867-437b-9245-c1dc6ea61c68 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c51735fe-85c3-40e5-aa9c-99f1ff65439f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08a52fe5-8781-4209-a02e-158fcf47f5cb', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:29 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7b469acf-9867-437b-9245-c1dc6ea61c68 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984b4cd4-deb4-48e8-a0a4-36d2614c3f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:29 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-7b469acf-9867-437b-9245-c1dc6ea61c68 tempest-CreateVolumesFromSnapshotTest-266358743 None] Volume volume-08a52fe5-8781-4209-a02e-158fcf47f5cb (08a52fe5-8781-4209-a02e-158fcf47f5cb): created successfully Sep 10 16:58:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7b469acf-9867-437b-9245-c1dc6ea61c68 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984b4cd4-deb4-48e8-a0a4-36d2614c3f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7b469acf-9867-437b-9245-c1dc6ea61c68 tempest-CreateVolumesFromSnapshotTest-266358743 None] Flow 'volume_create_manager' (e5bff9af-e75b-48a0-a68a-1ee7a27d4f3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:29 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-7b469acf-9867-437b-9245-c1dc6ea61c68 tempest-CreateVolumesFromSnapshotTest-266358743 None] Created volume successfully. Sep 10 16:58:30 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a22e30a-ad33-43ec-aa99-f537057a60e4 tempest-ProjectMemberTests-1654965068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:58:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a22e30a-ad33-43ec-aa99-f537057a60e4 tempest-ProjectMemberTests-1654965068 None] Flow 'volume_create_manager' (86421656-5dd2-41a3-8668-13eda39888af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a22e30a-ad33-43ec-aa99-f537057a60e4 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7fe0f87-f5d3-4b88-8dae-4759c0a32a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a22e30a-ad33-43ec-aa99-f537057a60e4 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7fe0f87-f5d3-4b88-8dae-4759c0a32a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1992889513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa6446a-e9cb-4b64-be25-302f41be938b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fdc4b0dbad645d8bc3672158e8e45da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:30Z,use_quota=True,user_id='4d7a8be540c54a1e9a03d51feae99641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:30 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a22e30a-ad33-43ec-aa99-f537057a60e4 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f5accb1-237c-4990-a96c-ceb56edce73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a22e30a-ad33-43ec-aa99-f537057a60e4 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f5accb1-237c-4990-a96c-ceb56edce73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a22e30a-ad33-43ec-aa99-f537057a60e4 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4a1077f-1fd7-4f42-9fd6-0ba992c18e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a22e30a-ad33-43ec-aa99-f537057a60e4 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4a1077f-1fd7-4f42-9fd6-0ba992c18e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fa6446a-e9cb-4b64-be25-302f41be938b', 'volume_name': 'volume-2fa6446a-e9cb-4b64-be25-302f41be938b', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a22e30a-ad33-43ec-aa99-f537057a60e4 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (787c626e-210c-418d-82e4-a5b72dedf6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a22e30a-ad33-43ec-aa99-f537057a60e4 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (787c626e-210c-418d-82e4-a5b72dedf6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a22e30a-ad33-43ec-aa99-f537057a60e4 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (193de313-d4eb-4b80-b2db-676ff8a06378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:30 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-8a22e30a-ad33-43ec-aa99-f537057a60e4 tempest-ProjectMemberTests-1654965068 None] Volume 2fa6446a-e9cb-4b64-be25-302f41be938b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fa6446a-e9cb-4b64-be25-302f41be938b', 'volume_size': 1} Sep 10 16:58:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8a22e30a-ad33-43ec-aa99-f537057a60e4 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3178710d-9ebe-4cc9-89b8-159121934218 tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-eca1b8b2-7d55-4516-b9f8-0661b03fee90 1073741824" returned: 0 in 0.712s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3178710d-9ebe-4cc9-89b8-159121934218 tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-eca1b8b2-7d55-4516-b9f8-0661b03fee90 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:30 devstack sudo[108321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-eca1b8b2-7d55-4516-b9f8-0661b03fee90 Sep 10 16:58:30 devstack sudo[108321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:30 devstack sudo[108321]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3178710d-9ebe-4cc9-89b8-159121934218 tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-eca1b8b2-7d55-4516-b9f8-0661b03fee90" returned: 0 in 0.300s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d342cadc-fbb0-4daf-9621-194cef9110e7 tempest-ProjectAdminTests-177445258 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1032371520996, 'free_capacity_gb': 1773.1032371520996, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88189) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 10 16:58:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3178710d-9ebe-4cc9-89b8-159121934218 tempest-CreateVolumesFromSnapshotTest-266358743 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:58:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3178710d-9ebe-4cc9-89b8-159121934218 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8a22e30a-ad33-43ec-aa99-f537057a60e4 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.359s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8a22e30a-ad33-43ec-aa99-f537057a60e4 tempest-ProjectMemberTests-1654965068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1992889513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa6446a-e9cb-4b64-be25-302f41be938b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fdc4b0dbad645d8bc3672158e8e45da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:30Z,use_quota=True,user_id='4d7a8be540c54a1e9a03d51feae99641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:58:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-8a22e30a-ad33-43ec-aa99-f537057a60e4 tempest-ProjectMemberTests-1654965068 None] Creating volume 2fa6446a-e9cb-4b64-be25-302f41be938b {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:58:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8a22e30a-ad33-43ec-aa99-f537057a60e4 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8a22e30a-ad33-43ec-aa99-f537057a60e4 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8a22e30a-ad33-43ec-aa99-f537057a60e4 tempest-ProjectMemberTests-1654965068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8a22e30a-ad33-43ec-aa99-f537057a60e4 tempest-ProjectMemberTests-1654965068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8a22e30a-ad33-43ec-aa99-f537057a60e4 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8a22e30a-ad33-43ec-aa99-f537057a60e4 tempest-ProjectMemberTests-1654965068 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:58:30 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-8a22e30a-ad33-43ec-aa99-f537057a60e4 tempest-ProjectMemberTests-1654965068 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:58:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8a22e30a-ad33-43ec-aa99-f537057a60e4 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:30 devstack sudo[108325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b 1073741824 Sep 10 16:58:30 devstack sudo[108325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3178710d-9ebe-4cc9-89b8-159121934218 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6badb34-9aaa-4077-b7ac-e59683fafb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eca1b8b2-7d55-4516-b9f8-0661b03fee90', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3178710d-9ebe-4cc9-89b8-159121934218 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9251ee81-011e-4335-b407-89e54a248999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:30 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-3178710d-9ebe-4cc9-89b8-159121934218 tempest-CreateVolumesFromSnapshotTest-266358743 None] Volume volume-eca1b8b2-7d55-4516-b9f8-0661b03fee90 (eca1b8b2-7d55-4516-b9f8-0661b03fee90): created successfully Sep 10 16:58:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3178710d-9ebe-4cc9-89b8-159121934218 tempest-CreateVolumesFromSnapshotTest-266358743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9251ee81-011e-4335-b407-89e54a248999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3178710d-9ebe-4cc9-89b8-159121934218 tempest-CreateVolumesFromSnapshotTest-266358743 None] Flow 'volume_create_manager' (528861ed-e046-46db-b2bc-f1214ae7e3ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:30 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-3178710d-9ebe-4cc9-89b8-159121934218 tempest-CreateVolumesFromSnapshotTest-266358743 None] Created volume successfully. Sep 10 16:58:31 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:58:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Flow 'volume_create_manager' (d710a933-d324-4970-8835-00c2e9ec5374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc09cf2c-2052-49cc-b20e-d0b27ae0d68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc09cf2c-2052-49cc-b20e-d0b27ae0d68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16d37f72-04a1-4657-96a0-f9578ec22be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31d1c73687024a8a9cfe99fd7e8860c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:31Z,use_quota=True,user_id='0202a293690f409399e7492cb60fe796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ddf1608-97e5-46f6-8a3f-17217ad66966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ddf1608-97e5-46f6-8a3f-17217ad66966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7613eb48-2346-48a7-b3f5-019b7af9cc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:31 devstack cinder-volume[88189]: DEBUG cinder.image.glance [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Creating Keystone auth plugin from conf {{(pid=88189) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 16:58:31 devstack sudo[108325]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8a22e30a-ad33-43ec-aa99-f537057a60e4 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b 1073741824" returned: 0 in 0.518s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8a22e30a-ad33-43ec-aa99-f537057a60e4 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:31 devstack sudo[108331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b Sep 10 16:58:31 devstack sudo[108331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:31 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-369df696-2b4e-4071-89b1-4a0d6412ebf6 tempest-CreateVolumesFromSnapshotTest-266358743 None] Acquiring lock "cinder-eca1b8b2-7d55-4516-b9f8-0661b03fee90-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:31 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-369df696-2b4e-4071-89b1-4a0d6412ebf6 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "cinder-eca1b8b2-7d55-4516-b9f8-0661b03fee90-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:31 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-369df696-2b4e-4071-89b1-4a0d6412ebf6 tempest-CreateVolumesFromSnapshotTest-266358743 None] Acquiring lock "cinder-quobyte-eca1b8b2-7d55-4516-b9f8-0661b03fee90" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:31 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-369df696-2b4e-4071-89b1-4a0d6412ebf6 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "cinder-quobyte-eca1b8b2-7d55-4516-b9f8-0661b03fee90" acquired by "delete_volume" :: waited 0.021s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:31 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e46d4f-1de0-45e2-93b4-1ed89aca4e34]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-369df696-2b4e-4071-89b1-4a0d6412ebf6 tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-eca1b8b2-7d55-4516-b9f8-0661b03fee90 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:31 devstack sudo[108331]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8a22e30a-ad33-43ec-aa99-f537057a60e4 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b" returned: 0 in 0.372s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:31 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8a22e30a-ad33-43ec-aa99-f537057a60e4 tempest-ProjectMemberTests-1654965068 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:58:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8a22e30a-ad33-43ec-aa99-f537057a60e4 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7613eb48-2346-48a7-b3f5-019b7af9cc86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '16d37f72-04a1-4657-96a0-f9578ec22be7', 'volume_name': 'volume-16d37f72-04a1-4657-96a0-f9578ec22be7', 'volume_size': 1, 'image_id': '38128570-2c40-4cf3-b797-1f05c860ab53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/38128570-2c40-4cf3-b797-1f05c860ab53', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c4a626938ba9d7f7d11cbb241f2caaac', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '31d1c73687024a8a9cfe99fd7e8860c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e794d2afc8d7e20f9e7b29af2036801bbd181b6afc7235f7ed7dfe593709deb3d43801048a88c304dade8f9c95a9e00b4623abcb244cc4ff11d16b36ff1ed483', 'id': '38128570-2c40-4cf3-b797-1f05c860ab53', 'created_at': datetime.datetime(2026, 9, 10, 14, 58, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 14, 58, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/38128570-2c40-4cf3-b797-1f05c860ab53/file', 'properties': {}}, 'image_service': }' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b1af63a-9805-4c2e-9550-4ab9bdf39a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b1af63a-9805-4c2e-9550-4ab9bdf39a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:31 devstack sudo[108333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-eca1b8b2-7d55-4516-b9f8-0661b03fee90 Sep 10 16:58:31 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b35f1950-2c4e-4bc7-b38b-fffdedb42703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:31 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Volume 16d37f72-04a1-4657-96a0-f9578ec22be7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-16d37f72-04a1-4657-96a0-f9578ec22be7', 'volume_size': 1, 'image_id': '38128570-2c40-4cf3-b797-1f05c860ab53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/38128570-2c40-4cf3-b797-1f05c860ab53', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c4a626938ba9d7f7d11cbb241f2caaac', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '31d1c73687024a8a9cfe99fd7e8860c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e794d2afc8d7e20f9e7b29af2036801bbd181b6afc7235f7ed7dfe593709deb3d43801048a88c304dade8f9c95a9e00b4623abcb244cc4ff11d16b36ff1ed483', 'id': '38128570-2c40-4cf3-b797-1f05c860ab53', 'created_at': datetime.datetime(2026, 9, 10, 14, 58, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 14, 58, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/38128570-2c40-4cf3-b797-1f05c860ab53/file', 'properties': {}}, 'image_service': } Sep 10 16:58:31 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Trying to clone 16d37f72-04a1-4657-96a0-f9578ec22be7 from image 38128570-2c40-4cf3-b797-1f05c860ab53 at location (None, [{'url': 'file:///opt/stack/data/glance/images/38128570-2c40-4cf3-b797-1f05c860ab53', 'metadata': {}}]). {{(pid=88189) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 16:58:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a22e30a-ad33-43ec-aa99-f537057a60e4 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (193de313-d4eb-4b80-b2db-676ff8a06378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fa6446a-e9cb-4b64-be25-302f41be938b', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a22e30a-ad33-43ec-aa99-f537057a60e4 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa2a805-6f75-4693-8b84-77092ed9dd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:31 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-8a22e30a-ad33-43ec-aa99-f537057a60e4 tempest-ProjectMemberTests-1654965068 None] Volume volume-2fa6446a-e9cb-4b64-be25-302f41be938b (2fa6446a-e9cb-4b64-be25-302f41be938b): created successfully Sep 10 16:58:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a22e30a-ad33-43ec-aa99-f537057a60e4 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa2a805-6f75-4693-8b84-77092ed9dd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a22e30a-ad33-43ec-aa99-f537057a60e4 tempest-ProjectMemberTests-1654965068 None] Flow 'volume_create_manager' (86421656-5dd2-41a3-8668-13eda39888af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:31 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-8a22e30a-ad33-43ec-aa99-f537057a60e4 tempest-ProjectMemberTests-1654965068 None] Created volume successfully. Sep 10 16:58:31 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_38128570-2c40-4cf3-b797-1f05c860ab53_k3_6u41ndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88189) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 16:58:31 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Image download 0.00 MB at 0.00 MB/s Sep 10 16:58:31 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0789a115-fa88-446a-9781-7ac84f103949]: (4, 'raw') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_38128570-2c40-4cf3-b797-1f05c860ab53_k3_6u41ndevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:32 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-369df696-2b4e-4071-89b1-4a0d6412ebf6 tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-eca1b8b2-7d55-4516-b9f8-0661b03fee90" returned: 0 in 0.450s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-369df696-2b4e-4071-89b1-4a0d6412ebf6 tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-eca1b8b2-7d55-4516-b9f8-0661b03fee90 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:32 devstack sudo[108336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_38128570-2c40-4cf3-b797-1f05c860ab53_k3_6u41ndevstack@QuobyteHD Sep 10 16:58:32 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:32 devstack sudo[108340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-eca1b8b2-7d55-4516-b9f8-0661b03fee90 Sep 10 16:58:32 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:32 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_38128570-2c40-4cf3-b797-1f05c860ab53_k3_6u41ndevstack@QuobyteHD" returned: 0 in 0.388s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:32 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38128570-2c40-4cf3-b797-1f05c860ab53_k3_6u41ndevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-369df696-2b4e-4071-89b1-4a0d6412ebf6 tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-eca1b8b2-7d55-4516-b9f8-0661b03fee90" returned: 0 in 0.301s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:32 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-369df696-2b4e-4071-89b1-4a0d6412ebf6 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "cinder-quobyte-eca1b8b2-7d55-4516-b9f8-0661b03fee90" released by "delete_volume" :: held 0.819s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:32 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-369df696-2b4e-4071-89b1-4a0d6412ebf6 tempest-CreateVolumesFromSnapshotTest-266358743 None] Created reservations ['c786b5c6-b56f-423e-a108-1caee29d1bdd', '19d5e2b0-c0a1-430e-a118-2b4ebf4dcb17', '76dfb935-86b4-40e3-9497-7cf998e5ac76', 'b7aa1baa-87cb-4db1-a850-78a17ea3fb3e'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:58:32 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38128570-2c40-4cf3-b797-1f05c860ab53_k3_6u41ndevstack@QuobyteHD Sep 10 16:58:32 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-369df696-2b4e-4071-89b1-4a0d6412ebf6 tempest-CreateVolumesFromSnapshotTest-266358743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-369df696-2b4e-4071-89b1-4a0d6412ebf6 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-369df696-2b4e-4071-89b1-4a0d6412ebf6 tempest-CreateVolumesFromSnapshotTest-266358743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-369df696-2b4e-4071-89b1-4a0d6412ebf6 tempest-CreateVolumesFromSnapshotTest-266358743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-369df696-2b4e-4071-89b1-4a0d6412ebf6 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-369df696-2b4e-4071-89b1-4a0d6412ebf6 tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:32 devstack sudo[108348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:58:32 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:32 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c7bfb0aa-7814-44e6-a999-bc8a9ac42f26 tempest-CreateVolumesFromSnapshotTest-266358743 None] Acquiring lock "cinder-08a52fe5-8781-4209-a02e-158fcf47f5cb-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:32 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c7bfb0aa-7814-44e6-a999-bc8a9ac42f26 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "cinder-08a52fe5-8781-4209-a02e-158fcf47f5cb-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:32 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c7bfb0aa-7814-44e6-a999-bc8a9ac42f26 tempest-CreateVolumesFromSnapshotTest-266358743 None] Acquiring lock "cinder-quobyte-08a52fe5-8781-4209-a02e-158fcf47f5cb" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:32 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:32 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38128570-2c40-4cf3-b797-1f05c860ab53_k3_6u41ndevstack@QuobyteHD" returned: 1 in 0.525s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38128570-2c40-4cf3-b797-1f05c860ab53_k3_6u41ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 16:58:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-369df696-2b4e-4071-89b1-4a0d6412ebf6 tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.333s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:32 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Temporary image 38128570-2c40-4cf3-b797-1f05c860ab53 is fetched for user 0202a293690f409399e7492cb60fe796. {{(pid=88189) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 16:58:32 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-369df696-2b4e-4071-89b1-4a0d6412ebf6 tempest-CreateVolumesFromSnapshotTest-266358743 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:58:32 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c7bfb0aa-7814-44e6-a999-bc8a9ac42f26 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "cinder-quobyte-08a52fe5-8781-4209-a02e-158fcf47f5cb" acquired by "delete_volume" :: waited 0.046s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:32 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-369df696-2b4e-4071-89b1-4a0d6412ebf6 tempest-CreateVolumesFromSnapshotTest-266358743 None] Deleted volume successfully. Sep 10 16:58:32 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aafd989-580c-4e82-9ac8-8463a3827c30]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c7bfb0aa-7814-44e6-a999-bc8a9ac42f26 tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-08a52fe5-8781-4209-a02e-158fcf47f5cb {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:32 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-369df696-2b4e-4071-89b1-4a0d6412ebf6 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "cinder-eca1b8b2-7d55-4516-b9f8-0661b03fee90-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:33 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f295ffd4-c819-4e57-9c63-cfd93cb3d604]: (4, 'raw') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_38128570-2c40-4cf3-b797-1f05c860ab53_k3_6u41ndevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:33 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-08a52fe5-8781-4209-a02e-158fcf47f5cb Sep 10 16:58:33 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-36bdd192-e0de-47fc-bb1f-3bac317afb9e tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-36bdd192-e0de-47fc-bb1f-3bac317afb9e tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-36bdd192-e0de-47fc-bb1f-3bac317afb9e tempest-ProjectMemberTests-1654965068 None] Creating offline snapshot c04a7a24-78cd-4567-a984-8d657cadb9b9 of volume 2fa6446a-e9cb-4b64-be25-302f41be938b {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:58:33 devstack sudo[108355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_38128570-2c40-4cf3-b797-1f05c860ab53_k3_6u41ndevstack@QuobyteHD Sep 10 16:58:33 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:33 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc869d88-a806-4b7b-b141-6b8e9a87dfc9]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-36bdd192-e0de-47fc-bb1f-3bac317afb9e tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:33 devstack sudo[108358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b Sep 10 16:58:33 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:33 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c7bfb0aa-7814-44e6-a999-bc8a9ac42f26 tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-08a52fe5-8781-4209-a02e-158fcf47f5cb" returned: 0 in 0.494s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c7bfb0aa-7814-44e6-a999-bc8a9ac42f26 tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-08a52fe5-8781-4209-a02e-158fcf47f5cb {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:33 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_38128570-2c40-4cf3-b797-1f05c860ab53_k3_6u41ndevstack@QuobyteHD" returned: 0 in 0.435s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38128570-2c40-4cf3-b797-1f05c860ab53_k3_6u41ndevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:33 devstack sudo[108365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-08a52fe5-8781-4209-a02e-158fcf47f5cb Sep 10 16:58:33 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:33 devstack sudo[108366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38128570-2c40-4cf3-b797-1f05c860ab53_k3_6u41ndevstack@QuobyteHD Sep 10 16:58:33 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:33 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-36bdd192-e0de-47fc-bb1f-3bac317afb9e tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b" returned: 0 in 0.426s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-36bdd192-e0de-47fc-bb1f-3bac317afb9e tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b.c04a7a24-78cd-4567-a984-8d657cadb9b9 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:33 devstack sudo[108373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b.c04a7a24-78cd-4567-a984-8d657cadb9b9 1G Sep 10 16:58:33 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:33 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c7bfb0aa-7814-44e6-a999-bc8a9ac42f26 tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-08a52fe5-8781-4209-a02e-158fcf47f5cb" returned: 0 in 0.348s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:33 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c7bfb0aa-7814-44e6-a999-bc8a9ac42f26 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "cinder-quobyte-08a52fe5-8781-4209-a02e-158fcf47f5cb" released by "delete_volume" :: held 0.915s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:33 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38128570-2c40-4cf3-b797-1f05c860ab53_k3_6u41ndevstack@QuobyteHD" returned: 1 in 0.422s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38128570-2c40-4cf3-b797-1f05c860ab53_k3_6u41ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 16:58:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:33 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-c7bfb0aa-7814-44e6-a999-bc8a9ac42f26 tempest-CreateVolumesFromSnapshotTest-266358743 None] Created reservations ['7fc5174d-8265-4c93-acd3-8f25e60beda9', '1b67f652-0595-41a9-bac4-b9c8594565c9', 'd2ba8e8b-b934-43d7-a782-00e41717acbd', 'd79a3944-dc64-49e7-8c0f-2971bf9a4127'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:58:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c7bfb0aa-7814-44e6-a999-bc8a9ac42f26 tempest-CreateVolumesFromSnapshotTest-266358743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c7bfb0aa-7814-44e6-a999-bc8a9ac42f26 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c7bfb0aa-7814-44e6-a999-bc8a9ac42f26 tempest-CreateVolumesFromSnapshotTest-266358743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c7bfb0aa-7814-44e6-a999-bc8a9ac42f26 tempest-CreateVolumesFromSnapshotTest-266358743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c7bfb0aa-7814-44e6-a999-bc8a9ac42f26 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c7bfb0aa-7814-44e6-a999-bc8a9ac42f26 tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:33 devstack sudo[108382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:58:33 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:34 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-36bdd192-e0de-47fc-bb1f-3bac317afb9e tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b.c04a7a24-78cd-4567-a984-8d657cadb9b9 1G" returned: 0 in 0.473s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-36bdd192-e0de-47fc-bb1f-3bac317afb9e tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fa6446a-e9cb-4b64-be25-302f41be938b -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b.c04a7a24-78cd-4567-a984-8d657cadb9b9 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:34 devstack sudo[108385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fa6446a-e9cb-4b64-be25-302f41be938b -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b.c04a7a24-78cd-4567-a984-8d657cadb9b9 Sep 10 16:58:34 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:34 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c7bfb0aa-7814-44e6-a999-bc8a9ac42f26 tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.280s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:34 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-c7bfb0aa-7814-44e6-a999-bc8a9ac42f26 tempest-CreateVolumesFromSnapshotTest-266358743 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:58:34 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-c7bfb0aa-7814-44e6-a999-bc8a9ac42f26 tempest-CreateVolumesFromSnapshotTest-266358743 None] Deleted volume successfully. Sep 10 16:58:34 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c7bfb0aa-7814-44e6-a999-bc8a9ac42f26 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "cinder-08a52fe5-8781-4209-a02e-158fcf47f5cb-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:34 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-36bdd192-e0de-47fc-bb1f-3bac317afb9e tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fa6446a-e9cb-4b64-be25-302f41be938b -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b.c04a7a24-78cd-4567-a984-8d657cadb9b9" returned: 0 in 0.338s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:34 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-36bdd192-e0de-47fc-bb1f-3bac317afb9e tempest-ProjectMemberTests-1654965068 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b.c04a7a24-78cd-4567-a984-8d657cadb9b9 is being set with open permissions: ugo+rw Sep 10 16:58:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-36bdd192-e0de-47fc-bb1f-3bac317afb9e tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b.c04a7a24-78cd-4567-a984-8d657cadb9b9 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:34 devstack sudo[108391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b.c04a7a24-78cd-4567-a984-8d657cadb9b9 Sep 10 16:58:34 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:34 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-36bdd192-e0de-47fc-bb1f-3bac317afb9e tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b.c04a7a24-78cd-4567-a984-8d657cadb9b9" returned: 0 in 0.257s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-36bdd192-e0de-47fc-bb1f-3bac317afb9e tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:34 devstack sudo[108394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b.info Sep 10 16:58:34 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:34 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-36bdd192-e0de-47fc-bb1f-3bac317afb9e tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b.info" returned: 0 in 0.264s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:34 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-36bdd192-e0de-47fc-bb1f-3bac317afb9e tempest-ProjectMemberTests-1654965068 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b.info is being set with open permissions: ugo+rw Sep 10 16:58:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-36bdd192-e0de-47fc-bb1f-3bac317afb9e tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:34 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b27f41b4-7a66-4fb6-8ce5-9d5b81b34a99 tempest-CreateVolumesFromSnapshotTest-266358743 None] Acquiring lock "cinder-c2492d7c-c3b1-4ee3-b712-657e5e78ca49-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:35 devstack sudo[108397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b.info Sep 10 16:58:35 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b27f41b4-7a66-4fb6-8ce5-9d5b81b34a99 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "cinder-c2492d7c-c3b1-4ee3-b712-657e5e78ca49-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b27f41b4-7a66-4fb6-8ce5-9d5b81b34a99 tempest-CreateVolumesFromSnapshotTest-266358743 None] Acquiring lock "cinder-quobyte-c2492d7c-c3b1-4ee3-b712-657e5e78ca49" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b27f41b4-7a66-4fb6-8ce5-9d5b81b34a99 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "cinder-quobyte-c2492d7c-c3b1-4ee3-b712-657e5e78ca49" acquired by "delete_volume" :: waited 0.018s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:35 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce49677-c395-4dd8-a07c-cd738d03999f]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b27f41b4-7a66-4fb6-8ce5-9d5b81b34a99 tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c2492d7c-c3b1-4ee3-b712-657e5e78ca49 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:35 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-36bdd192-e0de-47fc-bb1f-3bac317afb9e tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b.info" returned: 0 in 0.291s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:35 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c2492d7c-c3b1-4ee3-b712-657e5e78ca49 Sep 10 16:58:35 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-36bdd192-e0de-47fc-bb1f-3bac317afb9e tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.170s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.434s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:35 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16d37f72-04a1-4657-96a0-f9578ec22be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31d1c73687024a8a9cfe99fd7e8860c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:31Z,use_quota=True,user_id='0202a293690f409399e7492cb60fe796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:58:35 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Creating volume 16d37f72-04a1-4657-96a0-f9578ec22be7 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:58:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:35 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:35 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:35 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:58:35 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:58:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-16d37f72-04a1-4657-96a0-f9578ec22be7 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:35 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-16d37f72-04a1-4657-96a0-f9578ec22be7 1073741824 Sep 10 16:58:35 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:35 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-36bdd192-e0de-47fc-bb1f-3bac317afb9e tempest-ProjectMemberTests-1654965068 None] Create snapshot completed successfully Sep 10 16:58:35 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b27f41b4-7a66-4fb6-8ce5-9d5b81b34a99 tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c2492d7c-c3b1-4ee3-b712-657e5e78ca49" returned: 0 in 0.406s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b27f41b4-7a66-4fb6-8ce5-9d5b81b34a99 tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c2492d7c-c3b1-4ee3-b712-657e5e78ca49 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:35 devstack sudo[108409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c2492d7c-c3b1-4ee3-b712-657e5e78ca49 Sep 10 16:58:35 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:35 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-16d37f72-04a1-4657-96a0-f9578ec22be7 1073741824" returned: 0 in 0.431s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-16d37f72-04a1-4657-96a0-f9578ec22be7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:35 devstack sudo[108414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-16d37f72-04a1-4657-96a0-f9578ec22be7 Sep 10 16:58:35 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:35 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b27f41b4-7a66-4fb6-8ce5-9d5b81b34a99 tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c2492d7c-c3b1-4ee3-b712-657e5e78ca49" returned: 0 in 0.274s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b27f41b4-7a66-4fb6-8ce5-9d5b81b34a99 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "cinder-quobyte-c2492d7c-c3b1-4ee3-b712-657e5e78ca49" released by "delete_volume" :: held 0.746s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:35 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-b27f41b4-7a66-4fb6-8ce5-9d5b81b34a99 tempest-CreateVolumesFromSnapshotTest-266358743 None] Created reservations ['5f193a49-e025-41ce-a7c7-798f3edd519e', '19b98627-e676-4c67-b372-7be348f78016', '0475c224-7e4c-4c9e-a6b9-a53b25566fff', 'e3effaa1-392c-4a5c-9c73-b25e02795e82'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:58:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b27f41b4-7a66-4fb6-8ce5-9d5b81b34a99 tempest-CreateVolumesFromSnapshotTest-266358743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b27f41b4-7a66-4fb6-8ce5-9d5b81b34a99 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:35 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b27f41b4-7a66-4fb6-8ce5-9d5b81b34a99 tempest-CreateVolumesFromSnapshotTest-266358743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:35 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b27f41b4-7a66-4fb6-8ce5-9d5b81b34a99 tempest-CreateVolumesFromSnapshotTest-266358743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b27f41b4-7a66-4fb6-8ce5-9d5b81b34a99 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b27f41b4-7a66-4fb6-8ce5-9d5b81b34a99 tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:35 devstack sudo[108416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:58:35 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:36 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-16d37f72-04a1-4657-96a0-f9578ec22be7" returned: 0 in 0.257s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:36 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:58:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:36 devstack cinder-volume[88189]: DEBUG cinder.volume.volume_utils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Attempting download of 38128570-2c40-4cf3-b797-1f05c860ab53 ((None, [{'url': 'file:///opt/stack/data/glance/images/38128570-2c40-4cf3-b797-1f05c860ab53', 'metadata': {}}])) to volume 16d37f72-04a1-4657-96a0-f9578ec22be7. {{(pid=88189) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 16:58:36 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5b9eb3-83c9-46f4-be16-ad31e7414670]: (4, 'raw') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_38128570-2c40-4cf3-b797-1f05c860ab53_6pxokow9 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b871ece3-82f2-41e5-9ddc-d5ea97290be7 tempest-CreateVolumesFromSnapshotTest-266358743 None] Acquiring lock "cinder-4df5793c-a7f7-4003-8462-cd69b36f84c2-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b871ece3-82f2-41e5-9ddc-d5ea97290be7 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "cinder-4df5793c-a7f7-4003-8462-cd69b36f84c2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b27f41b4-7a66-4fb6-8ce5-9d5b81b34a99 tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.293s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:36 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:36 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-b27f41b4-7a66-4fb6-8ce5-9d5b81b34a99 tempest-CreateVolumesFromSnapshotTest-266358743 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:58:36 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-b27f41b4-7a66-4fb6-8ce5-9d5b81b34a99 tempest-CreateVolumesFromSnapshotTest-266358743 None] Deleted volume successfully. Sep 10 16:58:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9ffc0cf4-3b9b-47ce-99ce-f4b7ab2bab50 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-c04a7a24-78cd-4567-a984-8d657cadb9b9-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:36 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_38128570-2c40-4cf3-b797-1f05c860ab53_6pxokow9 Sep 10 16:58:36 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b871ece3-82f2-41e5-9ddc-d5ea97290be7 tempest-CreateVolumesFromSnapshotTest-266358743 None] Acquiring lock "cinder-quobyte-4df5793c-a7f7-4003-8462-cd69b36f84c2" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9ffc0cf4-3b9b-47ce-99ce-f4b7ab2bab50 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-c04a7a24-78cd-4567-a984-8d657cadb9b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9ffc0cf4-3b9b-47ce-99ce-f4b7ab2bab50 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-quobyte-2fa6446a-e9cb-4b64-be25-302f41be938b" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b27f41b4-7a66-4fb6-8ce5-9d5b81b34a99 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "cinder-c2492d7c-c3b1-4ee3-b712-657e5e78ca49-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b871ece3-82f2-41e5-9ddc-d5ea97290be7 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "cinder-quobyte-4df5793c-a7f7-4003-8462-cd69b36f84c2" acquired by "delete_volume" :: waited 0.064s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9ffc0cf4-3b9b-47ce-99ce-f4b7ab2bab50 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-2fa6446a-e9cb-4b64-be25-302f41be938b" acquired by "delete_snapshot" :: waited 0.054s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9ffc0cf4-3b9b-47ce-99ce-f4b7ab2bab50 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-quobyte-c04a7a24-78cd-4567-a984-8d657cadb9b9" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:36 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebbd4d9-57dd-4de5-b5aa-2b268f7e4619]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b871ece3-82f2-41e5-9ddc-d5ea97290be7 tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4df5793c-a7f7-4003-8462-cd69b36f84c2 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9ffc0cf4-3b9b-47ce-99ce-f4b7ab2bab50 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-c04a7a24-78cd-4567-a984-8d657cadb9b9" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:36 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-9ffc0cf4-3b9b-47ce-99ce-f4b7ab2bab50 tempest-ProjectMemberTests-1654965068 None] Deleting offline snapshot c04a7a24-78cd-4567-a984-8d657cadb9b9 of volume 2fa6446a-e9cb-4b64-be25-302f41be938b {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:58:36 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-9ffc0cf4-3b9b-47ce-99ce-f4b7ab2bab50 tempest-ProjectMemberTests-1654965068 None] snapshot_file for this snap is: volume-2fa6446a-e9cb-4b64-be25-302f41be938b.c04a7a24-78cd-4567-a984-8d657cadb9b9 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:58:36 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:36 devstack sudo[108422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4df5793c-a7f7-4003-8462-cd69b36f84c2 Sep 10 16:58:36 devstack sudo[108422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:36 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e70186-529f-4281-86c9-033f938236d0]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9ffc0cf4-3b9b-47ce-99ce-f4b7ab2bab50 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b.c04a7a24-78cd-4567-a984-8d657cadb9b9 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_38128570-2c40-4cf3-b797-1f05c860ab53_6pxokow9" returned: 0 in 0.478s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_38128570-2c40-4cf3-b797-1f05c860ab53_6pxokow9 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:36 devstack sudo[108426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b.c04a7a24-78cd-4567-a984-8d657cadb9b9 Sep 10 16:58:36 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:36 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_38128570-2c40-4cf3-b797-1f05c860ab53_6pxokow9 Sep 10 16:58:36 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:36 devstack sudo[108422]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b871ece3-82f2-41e5-9ddc-d5ea97290be7 tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4df5793c-a7f7-4003-8462-cd69b36f84c2" returned: 0 in 0.494s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b871ece3-82f2-41e5-9ddc-d5ea97290be7 tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4df5793c-a7f7-4003-8462-cd69b36f84c2 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:36 devstack sudo[108434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4df5793c-a7f7-4003-8462-cd69b36f84c2 Sep 10 16:58:36 devstack sudo[108434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:37 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_38128570-2c40-4cf3-b797-1f05c860ab53_6pxokow9" returned: 1 in 0.416s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_38128570-2c40-4cf3-b797-1f05c860ab53_6pxokow9' failed. Not Retrying. {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 16:58:37 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4418f803-3f99-43b7-876a-01583f4e5411]: (4, 'raw') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_38128570-2c40-4cf3-b797-1f05c860ab53_k3_6u41ndevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:37 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9ffc0cf4-3b9b-47ce-99ce-f4b7ab2bab50 tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b.c04a7a24-78cd-4567-a984-8d657cadb9b9" returned: 0 in 0.451s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:37 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-9ffc0cf4-3b9b-47ce-99ce-f4b7ab2bab50 tempest-ProjectMemberTests-1654965068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fa6446a-e9cb-4b64-be25-302f41be938b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:58:37 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1531c9f-b0ef-413d-a133-3c760f41a21e]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9ffc0cf4-3b9b-47ce-99ce-f4b7ab2bab50 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:37 devstack sudo[108441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_38128570-2c40-4cf3-b797-1f05c860ab53_k3_6u41ndevstack@QuobyteHD Sep 10 16:58:37 devstack sudo[108441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:37 devstack sudo[108442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b Sep 10 16:58:37 devstack sudo[108442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:37 devstack sudo[108434]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b871ece3-82f2-41e5-9ddc-d5ea97290be7 tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4df5793c-a7f7-4003-8462-cd69b36f84c2" returned: 0 in 0.312s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:37 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b871ece3-82f2-41e5-9ddc-d5ea97290be7 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "cinder-quobyte-4df5793c-a7f7-4003-8462-cd69b36f84c2" released by "delete_volume" :: held 0.869s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:37 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-b871ece3-82f2-41e5-9ddc-d5ea97290be7 tempest-CreateVolumesFromSnapshotTest-266358743 None] Created reservations ['151db407-3487-46ad-8563-3a57d7934ec9', 'c9fe2053-2892-456e-9e2b-20b9c7ead397', 'd2d35b88-39a9-460b-af98-a39b72b61045', '6fb79e0e-bb03-4e06-8c04-66b868409c9e'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:58:37 devstack sudo[108441]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_38128570-2c40-4cf3-b797-1f05c860ab53_k3_6u41ndevstack@QuobyteHD" returned: 0 in 0.444s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38128570-2c40-4cf3-b797-1f05c860ab53_k3_6u41ndevstack@QuobyteHD {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b871ece3-82f2-41e5-9ddc-d5ea97290be7 tempest-CreateVolumesFromSnapshotTest-266358743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b871ece3-82f2-41e5-9ddc-d5ea97290be7 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:37 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b871ece3-82f2-41e5-9ddc-d5ea97290be7 tempest-CreateVolumesFromSnapshotTest-266358743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:37 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b871ece3-82f2-41e5-9ddc-d5ea97290be7 tempest-CreateVolumesFromSnapshotTest-266358743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b871ece3-82f2-41e5-9ddc-d5ea97290be7 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b871ece3-82f2-41e5-9ddc-d5ea97290be7 tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:37 devstack sudo[108452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:58:37 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:37 devstack sudo[108442]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9ffc0cf4-3b9b-47ce-99ce-f4b7ab2bab50 tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b" returned: 0 in 0.493s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9ffc0cf4-3b9b-47ce-99ce-f4b7ab2bab50 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b.c04a7a24-78cd-4567-a984-8d657cadb9b9 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:37 devstack sudo[108454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b.c04a7a24-78cd-4567-a984-8d657cadb9b9 Sep 10 16:58:37 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:37 devstack sudo[108450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38128570-2c40-4cf3-b797-1f05c860ab53_k3_6u41ndevstack@QuobyteHD Sep 10 16:58:37 devstack sudo[108450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:37 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b871ece3-82f2-41e5-9ddc-d5ea97290be7 tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.283s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:37 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-b871ece3-82f2-41e5-9ddc-d5ea97290be7 tempest-CreateVolumesFromSnapshotTest-266358743 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:58:37 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-b871ece3-82f2-41e5-9ddc-d5ea97290be7 tempest-CreateVolumesFromSnapshotTest-266358743 None] Deleted volume successfully. Sep 10 16:58:37 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-b871ece3-82f2-41e5-9ddc-d5ea97290be7 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "cinder-4df5793c-a7f7-4003-8462-cd69b36f84c2-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:37 devstack sudo[108450]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38128570-2c40-4cf3-b797-1f05c860ab53_k3_6u41ndevstack@QuobyteHD" returned: 1 in 0.404s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38128570-2c40-4cf3-b797-1f05c860ab53_k3_6u41ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 16:58:37 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] 38128570-2c40-4cf3-b797-1f05c860ab53 was raw, converting to qcow2 {{(pid=88189) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 16:58:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_38128570-2c40-4cf3-b797-1f05c860ab53_k3_6u41ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-16d37f72-04a1-4657-96a0-f9578ec22be7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:37 devstack sudo[108464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_38128570-2c40-4cf3-b797-1f05c860ab53_k3_6u41ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-16d37f72-04a1-4657-96a0-f9578ec22be7 Sep 10 16:58:37 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:37 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9ffc0cf4-3b9b-47ce-99ce-f4b7ab2bab50 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b.c04a7a24-78cd-4567-a984-8d657cadb9b9" returned: 0 in 0.376s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9ffc0cf4-3b9b-47ce-99ce-f4b7ab2bab50 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b.c04a7a24-78cd-4567-a984-8d657cadb9b9 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:37 devstack sudo[108466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b.c04a7a24-78cd-4567-a984-8d657cadb9b9 Sep 10 16:58:37 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:38 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9ffc0cf4-3b9b-47ce-99ce-f4b7ab2bab50 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b.c04a7a24-78cd-4567-a984-8d657cadb9b9" returned: 0 in 0.274s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:38 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9ffc0cf4-3b9b-47ce-99ce-f4b7ab2bab50 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-c04a7a24-78cd-4567-a984-8d657cadb9b9" released by "_delete_snapshot" :: held 1.818s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:38 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9ffc0cf4-3b9b-47ce-99ce-f4b7ab2bab50 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-2fa6446a-e9cb-4b64-be25-302f41be938b" released by "delete_snapshot" :: held 1.866s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:38 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_38128570-2c40-4cf3-b797-1f05c860ab53_k3_6u41ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-16d37f72-04a1-4657-96a0-f9578ec22be7" returned: 0 in 0.463s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:38 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_38128570-2c40-4cf3-b797-1f05c860ab53_k3_6u41ndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-16d37f72-04a1-4657-96a0-f9578ec22be7 {{(pid=88189) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 16:58:38 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Converted 0.00 MB image at 0.00 MB/s Sep 10 16:58:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-16d37f72-04a1-4657-96a0-f9578ec22be7 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:38 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-9ffc0cf4-3b9b-47ce-99ce-f4b7ab2bab50 tempest-ProjectMemberTests-1654965068 None] Created reservations ['bbeb10d1-5cf9-46c5-8cab-03d07c054ce7', 'd815acf5-e3ae-497b-9d20-f8d0aa568ef8', '23f7139c-d3fd-4bc5-85b8-cf03bf612163', '50e62b70-bdb9-42f5-b2e4-d29dc892d280'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:58:38 devstack sudo[108473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-16d37f72-04a1-4657-96a0-f9578ec22be7 1G Sep 10 16:58:38 devstack sudo[108473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:38 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-9ffc0cf4-3b9b-47ce-99ce-f4b7ab2bab50 tempest-ProjectMemberTests-1654965068 None] Delete snapshot completed successfully. Sep 10 16:58:38 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9ffc0cf4-3b9b-47ce-99ce-f4b7ab2bab50 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-c04a7a24-78cd-4567-a984-8d657cadb9b9-delete_snapshot" released by "delete_snapshot" :: held 2.098s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:38 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-edabeae9-acca-4a8e-8911-9afd6dcb5b65 tempest-CreateVolumesFromSnapshotTest-266358743 None] Acquiring lock "cinder-b93e8329-969c-470e-b30d-85b32e942ceb-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:38 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-edabeae9-acca-4a8e-8911-9afd6dcb5b65 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "cinder-b93e8329-969c-470e-b30d-85b32e942ceb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:38 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-edabeae9-acca-4a8e-8911-9afd6dcb5b65 tempest-CreateVolumesFromSnapshotTest-266358743 None] Acquiring lock "cinder-quobyte-b93e8329-969c-470e-b30d-85b32e942ceb" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:38 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-edabeae9-acca-4a8e-8911-9afd6dcb5b65 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "cinder-quobyte-b93e8329-969c-470e-b30d-85b32e942ceb" acquired by "delete_volume" :: waited 0.022s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:38 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b50b17a-843f-4304-aed6-4f0832ab3976]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-edabeae9-acca-4a8e-8911-9afd6dcb5b65 tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b93e8329-969c-470e-b30d-85b32e942ceb {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:38 devstack sudo[108473]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-16d37f72-04a1-4657-96a0-f9578ec22be7 1G" returned: 0 in 0.356s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:38 devstack cinder-volume[88189]: DEBUG cinder.volume.volume_utils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Downloaded image 38128570-2c40-4cf3-b797-1f05c860ab53 ((None, [{'url': 'file:///opt/stack/data/glance/images/38128570-2c40-4cf3-b797-1f05c860ab53', 'metadata': {}}])) to volume 16d37f72-04a1-4657-96a0-f9578ec22be7 successfully. {{(pid=88189) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 16:58:38 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Temporary image 38128570-2c40-4cf3-b797-1f05c860ab53 for user 0202a293690f409399e7492cb60fe796 is deleted. {{(pid=88189) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 16:58:38 devstack cinder-volume[88189]: DEBUG cinder.volume.volume_utils [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Marking volume 16d37f72-04a1-4657-96a0-f9578ec22be7 as bootable. {{(pid=88189) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 16:58:38 devstack sudo[108477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b93e8329-969c-470e-b30d-85b32e942ceb Sep 10 16:58:38 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:38 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Copying metadata from image 38128570-2c40-4cf3-b797-1f05c860ab53 to 16d37f72-04a1-4657-96a0-f9578ec22be7. {{(pid=88189) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 16:58:38 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Creating volume glance metadata for volume 16d37f72-04a1-4657-96a0-f9578ec22be7 backed by image 38128570-2c40-4cf3-b797-1f05c860ab53 with: {'image_id': '38128570-2c40-4cf3-b797-1f05c860ab53', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c4a626938ba9d7f7d11cbb241f2caaac', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88189) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 16:58:38 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b35f1950-2c4e-4bc7-b38b-fffdedb42703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16d37f72-04a1-4657-96a0-f9578ec22be7', 'volume_size': 1, 'image_id': '38128570-2c40-4cf3-b797-1f05c860ab53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/38128570-2c40-4cf3-b797-1f05c860ab53', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c4a626938ba9d7f7d11cbb241f2caaac', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '31d1c73687024a8a9cfe99fd7e8860c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e794d2afc8d7e20f9e7b29af2036801bbd181b6afc7235f7ed7dfe593709deb3d43801048a88c304dade8f9c95a9e00b4623abcb244cc4ff11d16b36ff1ed483', 'id': '38128570-2c40-4cf3-b797-1f05c860ab53', 'created_at': datetime.datetime(2026, 9, 10, 14, 58, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 14, 58, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/38128570-2c40-4cf3-b797-1f05c860ab53/file', 'properties': {}}, 'image_service': }' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:38 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a336335-976a-4517-83ce-01d33f19c7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:38 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Volume volume-16d37f72-04a1-4657-96a0-f9578ec22be7 (16d37f72-04a1-4657-96a0-f9578ec22be7): created successfully Sep 10 16:58:38 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a336335-976a-4517-83ce-01d33f19c7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:38 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Flow 'volume_create_manager' (d710a933-d324-4970-8835-00c2e9ec5374) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:38 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-02708092-e95a-418b-b02d-4a23b62468fa tempest-VolumeImageDependencyTests-1619671549 None] Created volume successfully. Sep 10 16:58:39 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-edabeae9-acca-4a8e-8911-9afd6dcb5b65 tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b93e8329-969c-470e-b30d-85b32e942ceb" returned: 0 in 0.424s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-edabeae9-acca-4a8e-8911-9afd6dcb5b65 tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b93e8329-969c-470e-b30d-85b32e942ceb {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:39 devstack sudo[108485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b93e8329-969c-470e-b30d-85b32e942ceb Sep 10 16:58:39 devstack sudo[108485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:39 devstack sudo[108485]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-edabeae9-acca-4a8e-8911-9afd6dcb5b65 tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b93e8329-969c-470e-b30d-85b32e942ceb" returned: 0 in 0.254s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:39 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-edabeae9-acca-4a8e-8911-9afd6dcb5b65 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "cinder-quobyte-b93e8329-969c-470e-b30d-85b32e942ceb" released by "delete_volume" :: held 0.742s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:39 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-edabeae9-acca-4a8e-8911-9afd6dcb5b65 tempest-CreateVolumesFromSnapshotTest-266358743 None] Created reservations ['cbb5afa9-a231-4087-a218-51e65c53e6bc', '0aa28262-af26-43cd-8d47-b8e721c9f06b', '6127b6ce-adf1-4ed0-aa06-9537803af315', '2e03b7a8-97ed-4ef4-bd43-4338db6a8041'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:58:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-edabeae9-acca-4a8e-8911-9afd6dcb5b65 tempest-CreateVolumesFromSnapshotTest-266358743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-edabeae9-acca-4a8e-8911-9afd6dcb5b65 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:39 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-edabeae9-acca-4a8e-8911-9afd6dcb5b65 tempest-CreateVolumesFromSnapshotTest-266358743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:39 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-edabeae9-acca-4a8e-8911-9afd6dcb5b65 tempest-CreateVolumesFromSnapshotTest-266358743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-edabeae9-acca-4a8e-8911-9afd6dcb5b65 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-edabeae9-acca-4a8e-8911-9afd6dcb5b65 tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:39 devstack sudo[108488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:58:39 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:39 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9a31597c-5481-4c9b-b2af-8a62aec070c3 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-2fa6446a-e9cb-4b64-be25-302f41be938b-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:39 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9a31597c-5481-4c9b-b2af-8a62aec070c3 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-2fa6446a-e9cb-4b64-be25-302f41be938b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:39 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9a31597c-5481-4c9b-b2af-8a62aec070c3 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-quobyte-2fa6446a-e9cb-4b64-be25-302f41be938b" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:39 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9a31597c-5481-4c9b-b2af-8a62aec070c3 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-2fa6446a-e9cb-4b64-be25-302f41be938b" acquired by "delete_volume" :: waited 0.038s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:39 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8fcb622a-e011-476e-ac9c-7d0583518f12 tempest-CreateVolumesFromSnapshotTest-266358743 None] Acquiring lock "cinder-d707112d-5046-400c-8332-76af4fa76beb-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:39 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3019b377-e9a9-4e91-840d-a3b15c20bdc4]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9a31597c-5481-4c9b-b2af-8a62aec070c3 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:39 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8fcb622a-e011-476e-ac9c-7d0583518f12 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "cinder-d707112d-5046-400c-8332-76af4fa76beb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:39 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8fcb622a-e011-476e-ac9c-7d0583518f12 tempest-CreateVolumesFromSnapshotTest-266358743 None] Acquiring lock "cinder-quobyte-3291b7b5-deca-40ee-ba7f-2c5042c7caf4" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:39 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8fcb622a-e011-476e-ac9c-7d0583518f12 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "cinder-quobyte-3291b7b5-deca-40ee-ba7f-2c5042c7caf4" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:39 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8fcb622a-e011-476e-ac9c-7d0583518f12 tempest-CreateVolumesFromSnapshotTest-266358743 None] Acquiring lock "cinder-quobyte-d707112d-5046-400c-8332-76af4fa76beb" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:39 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8fcb622a-e011-476e-ac9c-7d0583518f12 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "cinder-quobyte-d707112d-5046-400c-8332-76af4fa76beb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:39 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-8fcb622a-e011-476e-ac9c-7d0583518f12 tempest-CreateVolumesFromSnapshotTest-266358743 None] Deleting offline snapshot d707112d-5046-400c-8332-76af4fa76beb of volume 3291b7b5-deca-40ee-ba7f-2c5042c7caf4 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:58:39 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-8fcb622a-e011-476e-ac9c-7d0583518f12 tempest-CreateVolumesFromSnapshotTest-266358743 None] snapshot_file for this snap is: volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4.d707112d-5046-400c-8332-76af4fa76beb {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:58:39 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0555cabe-aa43-42b2-9ec7-83b97db6022c]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:39 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8fcb622a-e011-476e-ac9c-7d0583518f12 tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4.d707112d-5046-400c-8332-76af4fa76beb {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-edabeae9-acca-4a8e-8911-9afd6dcb5b65 tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.413s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:39 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-edabeae9-acca-4a8e-8911-9afd6dcb5b65 tempest-CreateVolumesFromSnapshotTest-266358743 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:58:39 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-edabeae9-acca-4a8e-8911-9afd6dcb5b65 tempest-CreateVolumesFromSnapshotTest-266358743 None] Deleted volume successfully. Sep 10 16:58:39 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-edabeae9-acca-4a8e-8911-9afd6dcb5b65 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "cinder-b93e8329-969c-470e-b30d-85b32e942ceb-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:39 devstack sudo[108490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b Sep 10 16:58:39 devstack sudo[108490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:39 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-26d6b60f-5d7d-408a-800d-adca0700397c tempest-VolumeImageDependencyTests-1619671549 None] Acquiring lock "cinder-16d37f72-04a1-4657-96a0-f9578ec22be7-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:39 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-26d6b60f-5d7d-408a-800d-adca0700397c tempest-VolumeImageDependencyTests-1619671549 None] Lock "cinder-16d37f72-04a1-4657-96a0-f9578ec22be7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:39 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-26d6b60f-5d7d-408a-800d-adca0700397c tempest-VolumeImageDependencyTests-1619671549 None] Acquiring lock "cinder-quobyte-16d37f72-04a1-4657-96a0-f9578ec22be7" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:39 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-26d6b60f-5d7d-408a-800d-adca0700397c tempest-VolumeImageDependencyTests-1619671549 None] Lock "cinder-quobyte-16d37f72-04a1-4657-96a0-f9578ec22be7" acquired by "delete_volume" :: waited 0.019s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:39 devstack sudo[108492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4.d707112d-5046-400c-8332-76af4fa76beb Sep 10 16:58:39 devstack sudo[108492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:40 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[724a89ee-17b0-49fb-8fb4-93c69cb854e1]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-26d6b60f-5d7d-408a-800d-adca0700397c tempest-VolumeImageDependencyTests-1619671549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-16d37f72-04a1-4657-96a0-f9578ec22be7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:40 devstack sudo[108495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-16d37f72-04a1-4657-96a0-f9578ec22be7 Sep 10 16:58:40 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:40 devstack sudo[108490]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9a31597c-5481-4c9b-b2af-8a62aec070c3 tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b" returned: 0 in 0.479s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9a31597c-5481-4c9b-b2af-8a62aec070c3 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:40 devstack sudo[108502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b Sep 10 16:58:40 devstack sudo[108502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:40 devstack sudo[108492]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8fcb622a-e011-476e-ac9c-7d0583518f12 tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4.d707112d-5046-400c-8332-76af4fa76beb" returned: 0 in 0.460s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:40 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-8fcb622a-e011-476e-ac9c-7d0583518f12 tempest-CreateVolumesFromSnapshotTest-266358743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:58:40 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc3e07e-db74-4932-9dc9-07f8356dd3b8]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8fcb622a-e011-476e-ac9c-7d0583518f12 tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:40 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-26d6b60f-5d7d-408a-800d-adca0700397c tempest-VolumeImageDependencyTests-1619671549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-16d37f72-04a1-4657-96a0-f9578ec22be7" returned: 0 in 0.376s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-26d6b60f-5d7d-408a-800d-adca0700397c tempest-VolumeImageDependencyTests-1619671549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-16d37f72-04a1-4657-96a0-f9578ec22be7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:40 devstack sudo[108509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-16d37f72-04a1-4657-96a0-f9578ec22be7 Sep 10 16:58:40 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:40 devstack sudo[108506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4 Sep 10 16:58:40 devstack sudo[108506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:40 devstack sudo[108502]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9a31597c-5481-4c9b-b2af-8a62aec070c3 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2fa6446a-e9cb-4b64-be25-302f41be938b" returned: 0 in 0.281s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:40 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9a31597c-5481-4c9b-b2af-8a62aec070c3 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-2fa6446a-e9cb-4b64-be25-302f41be938b" released by "delete_volume" :: held 0.850s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:40 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-9a31597c-5481-4c9b-b2af-8a62aec070c3 tempest-ProjectMemberTests-1654965068 None] Created reservations ['f554d696-5a4b-47ec-b239-9b04826c17f7', '62caa8ca-af91-40e4-b462-6737018e2753', '619e6da0-306b-4973-a2be-29978fbefcf9', '76c106cd-4afd-4447-a032-06da86fe9de4'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:58:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9a31597c-5481-4c9b-b2af-8a62aec070c3 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9a31597c-5481-4c9b-b2af-8a62aec070c3 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:40 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9a31597c-5481-4c9b-b2af-8a62aec070c3 tempest-ProjectMemberTests-1654965068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:40 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9a31597c-5481-4c9b-b2af-8a62aec070c3 tempest-ProjectMemberTests-1654965068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9a31597c-5481-4c9b-b2af-8a62aec070c3 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9a31597c-5481-4c9b-b2af-8a62aec070c3 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:40 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-26d6b60f-5d7d-408a-800d-adca0700397c tempest-VolumeImageDependencyTests-1619671549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-16d37f72-04a1-4657-96a0-f9578ec22be7" returned: 0 in 0.319s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:40 devstack sudo[108514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:58:40 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:40 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-26d6b60f-5d7d-408a-800d-adca0700397c tempest-VolumeImageDependencyTests-1619671549 None] Lock "cinder-quobyte-16d37f72-04a1-4657-96a0-f9578ec22be7" released by "delete_volume" :: held 0.756s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:40 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-26d6b60f-5d7d-408a-800d-adca0700397c tempest-VolumeImageDependencyTests-1619671549 None] Created reservations ['2cb930c4-818d-43f5-af96-111a8da9f931', '125ed273-a038-4600-8e54-6fb954a07489', 'ea4ecff4-9fc8-4df2-81cb-e9af73ae3826', '16d7da0a-5103-4697-9da9-35ae349c9f72'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:58:40 devstack sudo[108506]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8fcb622a-e011-476e-ac9c-7d0583518f12 tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4" returned: 0 in 0.539s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8fcb622a-e011-476e-ac9c-7d0583518f12 tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4.d707112d-5046-400c-8332-76af4fa76beb {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:40 devstack sudo[108520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4.d707112d-5046-400c-8332-76af4fa76beb Sep 10 16:58:40 devstack sudo[108520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-26d6b60f-5d7d-408a-800d-adca0700397c tempest-VolumeImageDependencyTests-1619671549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-26d6b60f-5d7d-408a-800d-adca0700397c tempest-VolumeImageDependencyTests-1619671549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:40 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-26d6b60f-5d7d-408a-800d-adca0700397c tempest-VolumeImageDependencyTests-1619671549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:40 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-26d6b60f-5d7d-408a-800d-adca0700397c tempest-VolumeImageDependencyTests-1619671549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-26d6b60f-5d7d-408a-800d-adca0700397c tempest-VolumeImageDependencyTests-1619671549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-26d6b60f-5d7d-408a-800d-adca0700397c tempest-VolumeImageDependencyTests-1619671549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:40 devstack sudo[108522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:58:40 devstack sudo[108522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:41 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9a31597c-5481-4c9b-b2af-8a62aec070c3 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.430s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-9a31597c-5481-4c9b-b2af-8a62aec070c3 tempest-ProjectMemberTests-1654965068 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:58:41 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-9a31597c-5481-4c9b-b2af-8a62aec070c3 tempest-ProjectMemberTests-1654965068 None] Deleted volume successfully. Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9a31597c-5481-4c9b-b2af-8a62aec070c3 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-2fa6446a-e9cb-4b64-be25-302f41be938b-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:41 devstack sudo[108520]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8fcb622a-e011-476e-ac9c-7d0583518f12 tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4.d707112d-5046-400c-8332-76af4fa76beb" returned: 0 in 0.568s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8fcb622a-e011-476e-ac9c-7d0583518f12 tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4.d707112d-5046-400c-8332-76af4fa76beb {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:41 devstack sudo[108529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4.d707112d-5046-400c-8332-76af4fa76beb Sep 10 16:58:41 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:41 devstack sudo[108522]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-26d6b60f-5d7d-408a-800d-adca0700397c tempest-VolumeImageDependencyTests-1619671549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.524s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-26d6b60f-5d7d-408a-800d-adca0700397c tempest-VolumeImageDependencyTests-1619671549 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:58:41 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-26d6b60f-5d7d-408a-800d-adca0700397c tempest-VolumeImageDependencyTests-1619671549 None] Deleted volume successfully. Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=208,cinder:UPDATE=302,cinder:DELETE=29,cinder:INSERT=75 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-26d6b60f-5d7d-408a-800d-adca0700397c tempest-VolumeImageDependencyTests-1619671549 None] Lock "cinder-16d37f72-04a1-4657-96a0-f9578ec22be7-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:UPDATE=263,cinder:SELECT=206,cinder:INSERT=76,cinder:DELETE=22 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-f84b58d6-df98-47d7-a131-81b22e83c2fc tempest-ProjectMemberTests-1654965068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f84b58d6-df98-47d7-a131-81b22e83c2fc tempest-ProjectMemberTests-1654965068 None] Flow 'volume_create_manager' (957d8712-1992-4b0f-b750-dd39aa95ba96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f84b58d6-df98-47d7-a131-81b22e83c2fc tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3fa71cd-49dd-4db8-ae2d-f302cc25bc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f84b58d6-df98-47d7-a131-81b22e83c2fc tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3fa71cd-49dd-4db8-ae2d-f302cc25bc76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1273467408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e9f8c7-3cac-4576-b656-c4202a96021d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fdc4b0dbad645d8bc3672158e8e45da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:42Z,use_quota=True,user_id='4d7a8be540c54a1e9a03d51feae99641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f84b58d6-df98-47d7-a131-81b22e83c2fc tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16969ec0-6ea4-4b14-87d2-47280140cc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f84b58d6-df98-47d7-a131-81b22e83c2fc tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16969ec0-6ea4-4b14-87d2-47280140cc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f84b58d6-df98-47d7-a131-81b22e83c2fc tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e0bb91-cef5-4353-ac95-a52fd549217c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f84b58d6-df98-47d7-a131-81b22e83c2fc tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e0bb91-cef5-4353-ac95-a52fd549217c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48e9f8c7-3cac-4576-b656-c4202a96021d', 'volume_name': 'volume-48e9f8c7-3cac-4576-b656-c4202a96021d', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f84b58d6-df98-47d7-a131-81b22e83c2fc tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97375cc1-a5fb-4850-adc3-00039e605955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f84b58d6-df98-47d7-a131-81b22e83c2fc tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97375cc1-a5fb-4850-adc3-00039e605955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f84b58d6-df98-47d7-a131-81b22e83c2fc tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ba30af-4b3d-4b93-ab8f-39f9abfd4961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:41 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-f84b58d6-df98-47d7-a131-81b22e83c2fc tempest-ProjectMemberTests-1654965068 None] Volume 48e9f8c7-3cac-4576-b656-c4202a96021d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48e9f8c7-3cac-4576-b656-c4202a96021d', 'volume_size': 1} Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f84b58d6-df98-47d7-a131-81b22e83c2fc tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f84b58d6-df98-47d7-a131-81b22e83c2fc tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f84b58d6-df98-47d7-a131-81b22e83c2fc tempest-ProjectMemberTests-1654965068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1273467408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e9f8c7-3cac-4576-b656-c4202a96021d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fdc4b0dbad645d8bc3672158e8e45da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:42Z,use_quota=True,user_id='4d7a8be540c54a1e9a03d51feae99641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-f84b58d6-df98-47d7-a131-81b22e83c2fc tempest-ProjectMemberTests-1654965068 None] Creating volume 48e9f8c7-3cac-4576-b656-c4202a96021d {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f84b58d6-df98-47d7-a131-81b22e83c2fc tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f84b58d6-df98-47d7-a131-81b22e83c2fc tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f84b58d6-df98-47d7-a131-81b22e83c2fc tempest-ProjectMemberTests-1654965068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f84b58d6-df98-47d7-a131-81b22e83c2fc tempest-ProjectMemberTests-1654965068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f84b58d6-df98-47d7-a131-81b22e83c2fc tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f84b58d6-df98-47d7-a131-81b22e83c2fc tempest-ProjectMemberTests-1654965068 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:58:41 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-f84b58d6-df98-47d7-a131-81b22e83c2fc tempest-ProjectMemberTests-1654965068 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f84b58d6-df98-47d7-a131-81b22e83c2fc tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:41 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8fcb622a-e011-476e-ac9c-7d0583518f12 tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4.d707112d-5046-400c-8332-76af4fa76beb" returned: 0 in 0.357s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:41 devstack sudo[108532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d 1073741824 Sep 10 16:58:41 devstack sudo[108532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8fcb622a-e011-476e-ac9c-7d0583518f12 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "cinder-quobyte-d707112d-5046-400c-8332-76af4fa76beb" released by "_delete_snapshot" :: held 2.064s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8fcb622a-e011-476e-ac9c-7d0583518f12 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "cinder-quobyte-3291b7b5-deca-40ee-ba7f-2c5042c7caf4" released by "delete_snapshot" :: held 2.097s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:41 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-8fcb622a-e011-476e-ac9c-7d0583518f12 tempest-CreateVolumesFromSnapshotTest-266358743 None] Created reservations ['cb08c2bf-3f27-466b-a5b2-20550c4f97ea', '80f5ffeb-8c07-44a6-ae1a-b0827df5797d', '69e21183-1091-4ebb-99f9-4dbab90309b7', 'afd4634d-b7e1-40be-a22f-0a92fc467c5c'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:58:41 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-8fcb622a-e011-476e-ac9c-7d0583518f12 tempest-CreateVolumesFromSnapshotTest-266358743 None] Delete snapshot completed successfully. Sep 10 16:58:42 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-8fcb622a-e011-476e-ac9c-7d0583518f12 tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "cinder-d707112d-5046-400c-8332-76af4fa76beb-delete_snapshot" released by "delete_snapshot" :: held 2.275s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:42 devstack sudo[108532]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f84b58d6-df98-47d7-a131-81b22e83c2fc tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d 1073741824" returned: 0 in 0.567s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f84b58d6-df98-47d7-a131-81b22e83c2fc tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:42 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d Sep 10 16:58:42 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:42 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f84b58d6-df98-47d7-a131-81b22e83c2fc tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d" returned: 0 in 0.321s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:42 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f84b58d6-df98-47d7-a131-81b22e83c2fc tempest-ProjectMemberTests-1654965068 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:58:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f84b58d6-df98-47d7-a131-81b22e83c2fc tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:42 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f84b58d6-df98-47d7-a131-81b22e83c2fc tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ba30af-4b3d-4b93-ab8f-39f9abfd4961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48e9f8c7-3cac-4576-b656-c4202a96021d', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:42 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f84b58d6-df98-47d7-a131-81b22e83c2fc tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23464ed5-a92e-4c18-9a89-b7a768f0d2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:42 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-f84b58d6-df98-47d7-a131-81b22e83c2fc tempest-ProjectMemberTests-1654965068 None] Volume volume-48e9f8c7-3cac-4576-b656-c4202a96021d (48e9f8c7-3cac-4576-b656-c4202a96021d): created successfully Sep 10 16:58:42 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f84b58d6-df98-47d7-a131-81b22e83c2fc tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23464ed5-a92e-4c18-9a89-b7a768f0d2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:42 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-f84b58d6-df98-47d7-a131-81b22e83c2fc tempest-ProjectMemberTests-1654965068 None] Flow 'volume_create_manager' (957d8712-1992-4b0f-b750-dd39aa95ba96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:42 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-f84b58d6-df98-47d7-a131-81b22e83c2fc tempest-ProjectMemberTests-1654965068 None] Created volume successfully. Sep 10 16:58:43 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-fbc3eeb7-ce2a-40b0-99f3-05da99c1506d tempest-CreateVolumesFromSnapshotTest-266358743 None] Acquiring lock "cinder-3291b7b5-deca-40ee-ba7f-2c5042c7caf4-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:43 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-fbc3eeb7-ce2a-40b0-99f3-05da99c1506d tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "cinder-3291b7b5-deca-40ee-ba7f-2c5042c7caf4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:43 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-fbc3eeb7-ce2a-40b0-99f3-05da99c1506d tempest-CreateVolumesFromSnapshotTest-266358743 None] Acquiring lock "cinder-quobyte-3291b7b5-deca-40ee-ba7f-2c5042c7caf4" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:43 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-fbc3eeb7-ce2a-40b0-99f3-05da99c1506d tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "cinder-quobyte-3291b7b5-deca-40ee-ba7f-2c5042c7caf4" acquired by "delete_volume" :: waited 0.023s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:43 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8bcfbf-c469-4ade-961e-8e2d297d9d3a]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fbc3eeb7-ce2a-40b0-99f3-05da99c1506d tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:43 devstack sudo[108542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4 Sep 10 16:58:43 devstack sudo[108542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:43 devstack sudo[108542]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fbc3eeb7-ce2a-40b0-99f3-05da99c1506d tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4" returned: 0 in 0.437s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fbc3eeb7-ce2a-40b0-99f3-05da99c1506d tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:43 devstack sudo[108547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4 Sep 10 16:58:43 devstack sudo[108547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ed776285-4284-40d1-a806-280ea5ba6703 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ed776285-4284-40d1-a806-280ea5ba6703 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:43 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-ed776285-4284-40d1-a806-280ea5ba6703 tempest-ProjectMemberTests-1654965068 None] Creating offline snapshot c11478de-a92f-4005-ac58-2d636933064f of volume 48e9f8c7-3cac-4576-b656-c4202a96021d {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:58:43 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe04beb-421b-4ba9-a7e0-d8718006f3bf]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed776285-4284-40d1-a806-280ea5ba6703 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:43 devstack sudo[108547]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fbc3eeb7-ce2a-40b0-99f3-05da99c1506d tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3291b7b5-deca-40ee-ba7f-2c5042c7caf4" returned: 0 in 0.323s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:43 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-fbc3eeb7-ce2a-40b0-99f3-05da99c1506d tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "cinder-quobyte-3291b7b5-deca-40ee-ba7f-2c5042c7caf4" released by "delete_volume" :: held 0.827s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:44 devstack sudo[108549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d Sep 10 16:58:44 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:44 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-fbc3eeb7-ce2a-40b0-99f3-05da99c1506d tempest-CreateVolumesFromSnapshotTest-266358743 None] Created reservations ['0c653b61-5b30-43d2-bdb9-714471747873', '68998ab6-9218-4d0f-884a-4a5cbe07c3cd', '2ce8daae-7055-44af-822c-d72fa10cb242', '67cc683e-01e7-4aa6-aa93-bae72c0d9683'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:58:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-fbc3eeb7-ce2a-40b0-99f3-05da99c1506d tempest-CreateVolumesFromSnapshotTest-266358743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-fbc3eeb7-ce2a-40b0-99f3-05da99c1506d tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:44 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-fbc3eeb7-ce2a-40b0-99f3-05da99c1506d tempest-CreateVolumesFromSnapshotTest-266358743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:44 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-fbc3eeb7-ce2a-40b0-99f3-05da99c1506d tempest-CreateVolumesFromSnapshotTest-266358743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-fbc3eeb7-ce2a-40b0-99f3-05da99c1506d tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fbc3eeb7-ce2a-40b0-99f3-05da99c1506d tempest-CreateVolumesFromSnapshotTest-266358743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:44 devstack sudo[108552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:58:44 devstack sudo[108552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:44 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed776285-4284-40d1-a806-280ea5ba6703 tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d" returned: 0 in 0.476s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed776285-4284-40d1-a806-280ea5ba6703 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d.c11478de-a92f-4005-ac58-2d636933064f 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:44 devstack sudo[108558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d.c11478de-a92f-4005-ac58-2d636933064f 1G Sep 10 16:58:44 devstack sudo[108558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:44 devstack sudo[108552]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-fbc3eeb7-ce2a-40b0-99f3-05da99c1506d tempest-CreateVolumesFromSnapshotTest-266358743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.340s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:44 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-fbc3eeb7-ce2a-40b0-99f3-05da99c1506d tempest-CreateVolumesFromSnapshotTest-266358743 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:58:44 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-fbc3eeb7-ce2a-40b0-99f3-05da99c1506d tempest-CreateVolumesFromSnapshotTest-266358743 None] Deleted volume successfully. Sep 10 16:58:44 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-fbc3eeb7-ce2a-40b0-99f3-05da99c1506d tempest-CreateVolumesFromSnapshotTest-266358743 None] Lock "cinder-3291b7b5-deca-40ee-ba7f-2c5042c7caf4-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:44 devstack sudo[108558]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed776285-4284-40d1-a806-280ea5ba6703 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d.c11478de-a92f-4005-ac58-2d636933064f 1G" returned: 0 in 0.516s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed776285-4284-40d1-a806-280ea5ba6703 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48e9f8c7-3cac-4576-b656-c4202a96021d -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d.c11478de-a92f-4005-ac58-2d636933064f {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:44 devstack sudo[108564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48e9f8c7-3cac-4576-b656-c4202a96021d -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d.c11478de-a92f-4005-ac58-2d636933064f Sep 10 16:58:44 devstack sudo[108564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:45 devstack sudo[108564]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed776285-4284-40d1-a806-280ea5ba6703 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48e9f8c7-3cac-4576-b656-c4202a96021d -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d.c11478de-a92f-4005-ac58-2d636933064f" returned: 0 in 0.350s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:45 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-ed776285-4284-40d1-a806-280ea5ba6703 tempest-ProjectMemberTests-1654965068 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d.c11478de-a92f-4005-ac58-2d636933064f is being set with open permissions: ugo+rw Sep 10 16:58:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed776285-4284-40d1-a806-280ea5ba6703 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d.c11478de-a92f-4005-ac58-2d636933064f {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:45 devstack sudo[108569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d.c11478de-a92f-4005-ac58-2d636933064f Sep 10 16:58:45 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:45 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed776285-4284-40d1-a806-280ea5ba6703 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d.c11478de-a92f-4005-ac58-2d636933064f" returned: 0 in 0.292s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed776285-4284-40d1-a806-280ea5ba6703 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:45 devstack sudo[108572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d.info Sep 10 16:58:45 devstack sudo[108572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:45 devstack sudo[108572]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed776285-4284-40d1-a806-280ea5ba6703 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d.info" returned: 0 in 0.313s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:45 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-ed776285-4284-40d1-a806-280ea5ba6703 tempest-ProjectMemberTests-1654965068 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d.info is being set with open permissions: ugo+rw Sep 10 16:58:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed776285-4284-40d1-a806-280ea5ba6703 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:45 devstack sudo[108575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d.info Sep 10 16:58:45 devstack sudo[108575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:46 devstack sudo[108575]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ed776285-4284-40d1-a806-280ea5ba6703 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d.info" returned: 0 in 0.299s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ed776285-4284-40d1-a806-280ea5ba6703 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.356s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:46 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-ed776285-4284-40d1-a806-280ea5ba6703 tempest-ProjectMemberTests-1654965068 None] Create snapshot completed successfully Sep 10 16:58:46 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cd4d584-6079-4f92-8c9e-fef2d50f5753 tempest-ProjectReaderTests-149416441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:58:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6cd4d584-6079-4f92-8c9e-fef2d50f5753 tempest-ProjectReaderTests-149416441 None] Flow 'volume_create_manager' (486fa6b1-a2b9-40c8-b4f2-e5c2998f7802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6cd4d584-6079-4f92-8c9e-fef2d50f5753 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9b2e88c-0da3-4cbe-b5ee-6e06edbb70e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6cd4d584-6079-4f92-8c9e-fef2d50f5753 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9b2e88c-0da3-4cbe-b5ee-6e06edbb70e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-828557619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2218ee9e-a4bb-486f-bb0d-03fc7007698e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83eb3afc5ee5439bb2b9b5a142ae00c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:46Z,use_quota=True,user_id='26a94e4aa8894307aa8c1ca59b9e1250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6cd4d584-6079-4f92-8c9e-fef2d50f5753 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b85a45d5-ae18-47f8-a065-077115e8ecd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6cd4d584-6079-4f92-8c9e-fef2d50f5753 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b85a45d5-ae18-47f8-a065-077115e8ecd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6cd4d584-6079-4f92-8c9e-fef2d50f5753 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfe42f91-2937-46db-b2ba-3435bde4f38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6cd4d584-6079-4f92-8c9e-fef2d50f5753 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfe42f91-2937-46db-b2ba-3435bde4f38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2218ee9e-a4bb-486f-bb0d-03fc7007698e', 'volume_name': 'volume-2218ee9e-a4bb-486f-bb0d-03fc7007698e', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6cd4d584-6079-4f92-8c9e-fef2d50f5753 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (617925e0-9b2a-468e-a770-098e42961ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6cd4d584-6079-4f92-8c9e-fef2d50f5753 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (617925e0-9b2a-468e-a770-098e42961ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6cd4d584-6079-4f92-8c9e-fef2d50f5753 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3599553c-a844-4669-85de-b6bde447b763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:46 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-6cd4d584-6079-4f92-8c9e-fef2d50f5753 tempest-ProjectReaderTests-149416441 None] Volume 2218ee9e-a4bb-486f-bb0d-03fc7007698e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2218ee9e-a4bb-486f-bb0d-03fc7007698e', 'volume_size': 1} Sep 10 16:58:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6cd4d584-6079-4f92-8c9e-fef2d50f5753 tempest-ProjectReaderTests-149416441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6cd4d584-6079-4f92-8c9e-fef2d50f5753 tempest-ProjectReaderTests-149416441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:46 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6cd4d584-6079-4f92-8c9e-fef2d50f5753 tempest-ProjectReaderTests-149416441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-828557619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2218ee9e-a4bb-486f-bb0d-03fc7007698e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83eb3afc5ee5439bb2b9b5a142ae00c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:46Z,use_quota=True,user_id='26a94e4aa8894307aa8c1ca59b9e1250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:58:46 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-6cd4d584-6079-4f92-8c9e-fef2d50f5753 tempest-ProjectReaderTests-149416441 None] Creating volume 2218ee9e-a4bb-486f-bb0d-03fc7007698e {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:58:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6cd4d584-6079-4f92-8c9e-fef2d50f5753 tempest-ProjectReaderTests-149416441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6cd4d584-6079-4f92-8c9e-fef2d50f5753 tempest-ProjectReaderTests-149416441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:46 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6cd4d584-6079-4f92-8c9e-fef2d50f5753 tempest-ProjectReaderTests-149416441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:46 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6cd4d584-6079-4f92-8c9e-fef2d50f5753 tempest-ProjectReaderTests-149416441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6cd4d584-6079-4f92-8c9e-fef2d50f5753 tempest-ProjectReaderTests-149416441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:46 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6cd4d584-6079-4f92-8c9e-fef2d50f5753 tempest-ProjectReaderTests-149416441 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:58:46 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-6cd4d584-6079-4f92-8c9e-fef2d50f5753 tempest-ProjectReaderTests-149416441 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:58:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6cd4d584-6079-4f92-8c9e-fef2d50f5753 tempest-ProjectReaderTests-149416441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2218ee9e-a4bb-486f-bb0d-03fc7007698e 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:46 devstack sudo[108578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2218ee9e-a4bb-486f-bb0d-03fc7007698e 1073741824 Sep 10 16:58:46 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:46 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-471f405f-87ec-45f4-abdc-f1265ff44e76 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-c11478de-a92f-4005-ac58-2d636933064f-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:47 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-471f405f-87ec-45f4-abdc-f1265ff44e76 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-c11478de-a92f-4005-ac58-2d636933064f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:47 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-471f405f-87ec-45f4-abdc-f1265ff44e76 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-quobyte-48e9f8c7-3cac-4576-b656-c4202a96021d" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:47 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-471f405f-87ec-45f4-abdc-f1265ff44e76 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-48e9f8c7-3cac-4576-b656-c4202a96021d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:47 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-471f405f-87ec-45f4-abdc-f1265ff44e76 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-quobyte-c11478de-a92f-4005-ac58-2d636933064f" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:47 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-471f405f-87ec-45f4-abdc-f1265ff44e76 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-c11478de-a92f-4005-ac58-2d636933064f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:47 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-471f405f-87ec-45f4-abdc-f1265ff44e76 tempest-ProjectMemberTests-1654965068 None] Deleting offline snapshot c11478de-a92f-4005-ac58-2d636933064f of volume 48e9f8c7-3cac-4576-b656-c4202a96021d {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:58:47 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-471f405f-87ec-45f4-abdc-f1265ff44e76 tempest-ProjectMemberTests-1654965068 None] snapshot_file for this snap is: volume-48e9f8c7-3cac-4576-b656-c4202a96021d.c11478de-a92f-4005-ac58-2d636933064f {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:58:47 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[032c7c10-d320-4dd0-b735-d06269568bfa]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-471f405f-87ec-45f4-abdc-f1265ff44e76 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d.c11478de-a92f-4005-ac58-2d636933064f {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:47 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6cd4d584-6079-4f92-8c9e-fef2d50f5753 tempest-ProjectReaderTests-149416441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2218ee9e-a4bb-486f-bb0d-03fc7007698e 1073741824" returned: 0 in 0.577s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:47 devstack sudo[108584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d.c11478de-a92f-4005-ac58-2d636933064f Sep 10 16:58:47 devstack sudo[108584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6cd4d584-6079-4f92-8c9e-fef2d50f5753 tempest-ProjectReaderTests-149416441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2218ee9e-a4bb-486f-bb0d-03fc7007698e {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:47 devstack sudo[108586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2218ee9e-a4bb-486f-bb0d-03fc7007698e Sep 10 16:58:47 devstack sudo[108586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:47 devstack sudo[108584]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-471f405f-87ec-45f4-abdc-f1265ff44e76 tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d.c11478de-a92f-4005-ac58-2d636933064f" returned: 0 in 0.469s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:47 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-471f405f-87ec-45f4-abdc-f1265ff44e76 tempest-ProjectMemberTests-1654965068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48e9f8c7-3cac-4576-b656-c4202a96021d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:58:47 devstack sudo[108586]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6cd4d584-6079-4f92-8c9e-fef2d50f5753 tempest-ProjectReaderTests-149416441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2218ee9e-a4bb-486f-bb0d-03fc7007698e" returned: 0 in 0.351s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:47 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-6cd4d584-6079-4f92-8c9e-fef2d50f5753 tempest-ProjectReaderTests-149416441 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:58:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-6cd4d584-6079-4f92-8c9e-fef2d50f5753 tempest-ProjectReaderTests-149416441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:47 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc981123-b591-4c4f-92a2-74b33c5c0361]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-471f405f-87ec-45f4-abdc-f1265ff44e76 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:47 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6cd4d584-6079-4f92-8c9e-fef2d50f5753 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3599553c-a844-4669-85de-b6bde447b763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2218ee9e-a4bb-486f-bb0d-03fc7007698e', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:47 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6cd4d584-6079-4f92-8c9e-fef2d50f5753 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f78457a4-5ac8-4d32-8374-3c79adc497ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:47 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-6cd4d584-6079-4f92-8c9e-fef2d50f5753 tempest-ProjectReaderTests-149416441 None] Volume volume-2218ee9e-a4bb-486f-bb0d-03fc7007698e (2218ee9e-a4bb-486f-bb0d-03fc7007698e): created successfully Sep 10 16:58:47 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6cd4d584-6079-4f92-8c9e-fef2d50f5753 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f78457a4-5ac8-4d32-8374-3c79adc497ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:47 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-6cd4d584-6079-4f92-8c9e-fef2d50f5753 tempest-ProjectReaderTests-149416441 None] Flow 'volume_create_manager' (486fa6b1-a2b9-40c8-b4f2-e5c2998f7802) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:47 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-6cd4d584-6079-4f92-8c9e-fef2d50f5753 tempest-ProjectReaderTests-149416441 None] Created volume successfully. Sep 10 16:58:47 devstack sudo[108592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d Sep 10 16:58:47 devstack sudo[108592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:48 devstack sudo[108592]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-471f405f-87ec-45f4-abdc-f1265ff44e76 tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d" returned: 0 in 0.419s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-471f405f-87ec-45f4-abdc-f1265ff44e76 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d.c11478de-a92f-4005-ac58-2d636933064f {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:48 devstack sudo[108597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d.c11478de-a92f-4005-ac58-2d636933064f Sep 10 16:58:48 devstack sudo[108597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:48 devstack sudo[108597]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-471f405f-87ec-45f4-abdc-f1265ff44e76 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d.c11478de-a92f-4005-ac58-2d636933064f" returned: 0 in 0.416s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-471f405f-87ec-45f4-abdc-f1265ff44e76 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d.c11478de-a92f-4005-ac58-2d636933064f {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:48 devstack sudo[108604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d.c11478de-a92f-4005-ac58-2d636933064f Sep 10 16:58:48 devstack sudo[108604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:48 devstack sudo[108604]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-471f405f-87ec-45f4-abdc-f1265ff44e76 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d.c11478de-a92f-4005-ac58-2d636933064f" returned: 0 in 0.360s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:48 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-7eeead4e-d66e-4518-abeb-aa2dc492cb65 tempest-ProjectReaderTests-149416441 None] Acquiring lock "cinder-2218ee9e-a4bb-486f-bb0d-03fc7007698e-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:48 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-471f405f-87ec-45f4-abdc-f1265ff44e76 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-c11478de-a92f-4005-ac58-2d636933064f" released by "_delete_snapshot" :: held 1.837s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:48 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-471f405f-87ec-45f4-abdc-f1265ff44e76 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-48e9f8c7-3cac-4576-b656-c4202a96021d" released by "delete_snapshot" :: held 1.874s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:48 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-7eeead4e-d66e-4518-abeb-aa2dc492cb65 tempest-ProjectReaderTests-149416441 None] Lock "cinder-2218ee9e-a4bb-486f-bb0d-03fc7007698e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:48 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-42265ceb-8a17-479c-88ae-b7999f820d6a tempest-ProjectReaderTests-1968626820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:58:48 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-42265ceb-8a17-479c-88ae-b7999f820d6a tempest-ProjectReaderTests-1968626820 None] Flow 'volume_create_manager' (bf3b4871-459f-4df9-a4ed-954c4884c1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:48 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-42265ceb-8a17-479c-88ae-b7999f820d6a tempest-ProjectReaderTests-1968626820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e1bac0b-23cb-44bf-adaf-889bd8d45d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:48 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-42265ceb-8a17-479c-88ae-b7999f820d6a tempest-ProjectReaderTests-1968626820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e1bac0b-23cb-44bf-adaf-889bd8d45d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-423877065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c82c686a-581b-4794-a003-7b8dc3fa42ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='569853389d4b4dfab82a283fb542b1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:49Z,use_quota=True,user_id='feaff37d3ac9457f9326c475e20ee9de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:48 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-42265ceb-8a17-479c-88ae-b7999f820d6a tempest-ProjectReaderTests-1968626820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df20f6c-694a-425d-9faf-88578262d5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:48 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-42265ceb-8a17-479c-88ae-b7999f820d6a tempest-ProjectReaderTests-1968626820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df20f6c-694a-425d-9faf-88578262d5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-42265ceb-8a17-479c-88ae-b7999f820d6a tempest-ProjectReaderTests-1968626820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83bd1e6e-e8f3-4fe0-9c2a-9fbf6c6616f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-42265ceb-8a17-479c-88ae-b7999f820d6a tempest-ProjectReaderTests-1968626820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83bd1e6e-e8f3-4fe0-9c2a-9fbf6c6616f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c82c686a-581b-4794-a003-7b8dc3fa42ae', 'volume_name': 'volume-c82c686a-581b-4794-a003-7b8dc3fa42ae', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-42265ceb-8a17-479c-88ae-b7999f820d6a tempest-ProjectReaderTests-1968626820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf2770a6-4b59-498f-9aa8-3e9b5e756efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-42265ceb-8a17-479c-88ae-b7999f820d6a tempest-ProjectReaderTests-1968626820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf2770a6-4b59-498f-9aa8-3e9b5e756efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-42265ceb-8a17-479c-88ae-b7999f820d6a tempest-ProjectReaderTests-1968626820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05052ebd-c268-4942-930b-84545ed83d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:49 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-42265ceb-8a17-479c-88ae-b7999f820d6a tempest-ProjectReaderTests-1968626820 None] Volume c82c686a-581b-4794-a003-7b8dc3fa42ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c82c686a-581b-4794-a003-7b8dc3fa42ae', 'volume_size': 1} Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-42265ceb-8a17-479c-88ae-b7999f820d6a tempest-ProjectReaderTests-1968626820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-42265ceb-8a17-479c-88ae-b7999f820d6a tempest-ProjectReaderTests-1968626820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-42265ceb-8a17-479c-88ae-b7999f820d6a tempest-ProjectReaderTests-1968626820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-423877065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c82c686a-581b-4794-a003-7b8dc3fa42ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='569853389d4b4dfab82a283fb542b1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:49Z,use_quota=True,user_id='feaff37d3ac9457f9326c475e20ee9de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-42265ceb-8a17-479c-88ae-b7999f820d6a tempest-ProjectReaderTests-1968626820 None] Creating volume c82c686a-581b-4794-a003-7b8dc3fa42ae {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-42265ceb-8a17-479c-88ae-b7999f820d6a tempest-ProjectReaderTests-1968626820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-42265ceb-8a17-479c-88ae-b7999f820d6a tempest-ProjectReaderTests-1968626820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-42265ceb-8a17-479c-88ae-b7999f820d6a tempest-ProjectReaderTests-1968626820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-42265ceb-8a17-479c-88ae-b7999f820d6a tempest-ProjectReaderTests-1968626820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-42265ceb-8a17-479c-88ae-b7999f820d6a tempest-ProjectReaderTests-1968626820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-42265ceb-8a17-479c-88ae-b7999f820d6a tempest-ProjectReaderTests-1968626820 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:58:49 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-42265ceb-8a17-479c-88ae-b7999f820d6a tempest-ProjectReaderTests-1968626820 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-42265ceb-8a17-479c-88ae-b7999f820d6a tempest-ProjectReaderTests-1968626820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c82c686a-581b-4794-a003-7b8dc3fa42ae 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:49 devstack sudo[108607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c82c686a-581b-4794-a003-7b8dc3fa42ae 1073741824 Sep 10 16:58:49 devstack sudo[108607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-7eeead4e-d66e-4518-abeb-aa2dc492cb65 tempest-ProjectReaderTests-149416441 None] Acquiring lock "cinder-quobyte-2218ee9e-a4bb-486f-bb0d-03fc7007698e" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-7eeead4e-d66e-4518-abeb-aa2dc492cb65 tempest-ProjectReaderTests-149416441 None] Lock "cinder-quobyte-2218ee9e-a4bb-486f-bb0d-03fc7007698e" acquired by "delete_volume" :: waited 0.036s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-471f405f-87ec-45f4-abdc-f1265ff44e76 tempest-ProjectMemberTests-1654965068 None] Created reservations ['e0f6a86d-df9e-4380-8991-117989bf9aa2', '8aacdff5-0ab4-4a8f-a285-798f8e71d41c', 'c02654a2-41a1-443a-9f29-daefc60c667c', 'b7b412dd-54ff-455f-a76a-471f0f037dd0'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e625bf-c783-474e-a754-d2e3bf0ebf5c]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7eeead4e-d66e-4518-abeb-aa2dc492cb65 tempest-ProjectReaderTests-149416441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2218ee9e-a4bb-486f-bb0d-03fc7007698e {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:49 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-471f405f-87ec-45f4-abdc-f1265ff44e76 tempest-ProjectMemberTests-1654965068 None] Delete snapshot completed successfully. Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-471f405f-87ec-45f4-abdc-f1265ff44e76 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-c11478de-a92f-4005-ac58-2d636933064f-delete_snapshot" released by "delete_snapshot" :: held 2.265s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:49 devstack sudo[108609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2218ee9e-a4bb-486f-bb0d-03fc7007698e Sep 10 16:58:49 devstack sudo[108609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:49 devstack sudo[108618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:58:49 devstack sudo[108618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:49 devstack sudo[108607]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-42265ceb-8a17-479c-88ae-b7999f820d6a tempest-ProjectReaderTests-1968626820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c82c686a-581b-4794-a003-7b8dc3fa42ae 1073741824" returned: 0 in 0.607s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:49 devstack sudo[108609]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7eeead4e-d66e-4518-abeb-aa2dc492cb65 tempest-ProjectReaderTests-149416441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2218ee9e-a4bb-486f-bb0d-03fc7007698e" returned: 0 in 0.500s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7eeead4e-d66e-4518-abeb-aa2dc492cb65 tempest-ProjectReaderTests-149416441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2218ee9e-a4bb-486f-bb0d-03fc7007698e {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:49 devstack sudo[108620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2218ee9e-a4bb-486f-bb0d-03fc7007698e Sep 10 16:58:49 devstack sudo[108620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-42265ceb-8a17-479c-88ae-b7999f820d6a tempest-ProjectReaderTests-1968626820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c82c686a-581b-4794-a003-7b8dc3fa42ae {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:49 devstack sudo[108622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c82c686a-581b-4794-a003-7b8dc3fa42ae Sep 10 16:58:49 devstack sudo[108622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:49 devstack sudo[108618]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.314s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager._thread_info {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread count: 29 {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread info: [<_MainThread(MainThread, started 125792070905984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 16:58:49 devstack sudo[108620]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7eeead4e-d66e-4518-abeb-aa2dc492cb65 tempest-ProjectReaderTests-149416441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-2218ee9e-a4bb-486f-bb0d-03fc7007698e" returned: 0 in 0.340s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:50 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-7eeead4e-d66e-4518-abeb-aa2dc492cb65 tempest-ProjectReaderTests-149416441 None] Lock "cinder-quobyte-2218ee9e-a4bb-486f-bb0d-03fc7007698e" released by "delete_volume" :: held 0.912s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:50 devstack sudo[108622]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-42265ceb-8a17-479c-88ae-b7999f820d6a tempest-ProjectReaderTests-1968626820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c82c686a-581b-4794-a003-7b8dc3fa42ae" returned: 0 in 0.331s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:50 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-42265ceb-8a17-479c-88ae-b7999f820d6a tempest-ProjectReaderTests-1968626820 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:58:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-42265ceb-8a17-479c-88ae-b7999f820d6a tempest-ProjectReaderTests-1968626820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-42265ceb-8a17-479c-88ae-b7999f820d6a tempest-ProjectReaderTests-1968626820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05052ebd-c268-4942-930b-84545ed83d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c82c686a-581b-4794-a003-7b8dc3fa42ae', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-42265ceb-8a17-479c-88ae-b7999f820d6a tempest-ProjectReaderTests-1968626820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa46a8f-c712-46b6-b9dd-75d1d2cabd30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:50 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-42265ceb-8a17-479c-88ae-b7999f820d6a tempest-ProjectReaderTests-1968626820 None] Volume volume-c82c686a-581b-4794-a003-7b8dc3fa42ae (c82c686a-581b-4794-a003-7b8dc3fa42ae): created successfully Sep 10 16:58:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-42265ceb-8a17-479c-88ae-b7999f820d6a tempest-ProjectReaderTests-1968626820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa46a8f-c712-46b6-b9dd-75d1d2cabd30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:50 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-42265ceb-8a17-479c-88ae-b7999f820d6a tempest-ProjectReaderTests-1968626820 None] Flow 'volume_create_manager' (bf3b4871-459f-4df9-a4ed-954c4884c1d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:50 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-42265ceb-8a17-479c-88ae-b7999f820d6a tempest-ProjectReaderTests-1968626820 None] Created volume successfully. Sep 10 16:58:50 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-7eeead4e-d66e-4518-abeb-aa2dc492cb65 tempest-ProjectReaderTests-149416441 None] Created reservations ['907b4ad9-9957-443e-b261-a3694ba670f0', '50fe645f-e12a-4995-8340-0cc78d76df40', '62b2bddd-54dd-480e-9740-e9a7bfbeebb9', '1d3b3df5-3e29-46e0-aefc-c3ca7388af20'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:58:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7eeead4e-d66e-4518-abeb-aa2dc492cb65 tempest-ProjectReaderTests-149416441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7eeead4e-d66e-4518-abeb-aa2dc492cb65 tempest-ProjectReaderTests-149416441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:50 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7eeead4e-d66e-4518-abeb-aa2dc492cb65 tempest-ProjectReaderTests-149416441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:50 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7eeead4e-d66e-4518-abeb-aa2dc492cb65 tempest-ProjectReaderTests-149416441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7eeead4e-d66e-4518-abeb-aa2dc492cb65 tempest-ProjectReaderTests-149416441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7eeead4e-d66e-4518-abeb-aa2dc492cb65 tempest-ProjectReaderTests-149416441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:50 devstack sudo[108627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:58:50 devstack sudo[108627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:50 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-192d91f2-4a9a-4c44-aaca-a61a60f13d52 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-48e9f8c7-3cac-4576-b656-c4202a96021d-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:50 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-192d91f2-4a9a-4c44-aaca-a61a60f13d52 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-48e9f8c7-3cac-4576-b656-c4202a96021d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:50 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-192d91f2-4a9a-4c44-aaca-a61a60f13d52 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-quobyte-48e9f8c7-3cac-4576-b656-c4202a96021d" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:50 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-192d91f2-4a9a-4c44-aaca-a61a60f13d52 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-48e9f8c7-3cac-4576-b656-c4202a96021d" acquired by "delete_volume" :: waited 0.025s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:50 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[446b820a-09e4-4773-b87f-de1849122a4c]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-192d91f2-4a9a-4c44-aaca-a61a60f13d52 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:50 devstack sudo[108627]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7eeead4e-d66e-4518-abeb-aa2dc492cb65 tempest-ProjectReaderTests-149416441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.308s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:50 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-7eeead4e-d66e-4518-abeb-aa2dc492cb65 tempest-ProjectReaderTests-149416441 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:58:50 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-7eeead4e-d66e-4518-abeb-aa2dc492cb65 tempest-ProjectReaderTests-149416441 None] Deleted volume successfully. Sep 10 16:58:50 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-7eeead4e-d66e-4518-abeb-aa2dc492cb65 tempest-ProjectReaderTests-149416441 None] Lock "cinder-2218ee9e-a4bb-486f-bb0d-03fc7007698e-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:50 devstack sudo[108630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d Sep 10 16:58:50 devstack sudo[108630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:50 devstack sudo[108630]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-192d91f2-4a9a-4c44-aaca-a61a60f13d52 tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d" returned: 0 in 0.388s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-192d91f2-4a9a-4c44-aaca-a61a60f13d52 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:50 devstack sudo[108636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d Sep 10 16:58:50 devstack sudo[108636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:51 devstack sudo[108636]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-192d91f2-4a9a-4c44-aaca-a61a60f13d52 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-48e9f8c7-3cac-4576-b656-c4202a96021d" returned: 0 in 0.298s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:51 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-192d91f2-4a9a-4c44-aaca-a61a60f13d52 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-48e9f8c7-3cac-4576-b656-c4202a96021d" released by "delete_volume" :: held 0.765s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:51 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-192d91f2-4a9a-4c44-aaca-a61a60f13d52 tempest-ProjectMemberTests-1654965068 None] Created reservations ['785bc64b-c98d-47e4-b335-e0d88e7054f8', 'dad81e78-7876-444b-ae63-1fb7c7f2d966', '8667ca87-1d3a-4641-a47f-7082c1b7bcbc', 'fa695ed3-2623-4e99-81d8-3d6c9ccb4604'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:58:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-192d91f2-4a9a-4c44-aaca-a61a60f13d52 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-192d91f2-4a9a-4c44-aaca-a61a60f13d52 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:51 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-192d91f2-4a9a-4c44-aaca-a61a60f13d52 tempest-ProjectMemberTests-1654965068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:51 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-192d91f2-4a9a-4c44-aaca-a61a60f13d52 tempest-ProjectMemberTests-1654965068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-192d91f2-4a9a-4c44-aaca-a61a60f13d52 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-192d91f2-4a9a-4c44-aaca-a61a60f13d52 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:51 devstack sudo[108639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:58:51 devstack sudo[108639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:51 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9d59b6cf-d24e-40ee-99c2-7ea042aa92a2 tempest-ProjectReaderTests-1968626820 None] Acquiring lock "cinder-c82c686a-581b-4794-a003-7b8dc3fa42ae-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:51 devstack sudo[108639]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-192d91f2-4a9a-4c44-aaca-a61a60f13d52 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.338s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:51 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-192d91f2-4a9a-4c44-aaca-a61a60f13d52 tempest-ProjectMemberTests-1654965068 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:58:51 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-192d91f2-4a9a-4c44-aaca-a61a60f13d52 tempest-ProjectMemberTests-1654965068 None] Deleted volume successfully. Sep 10 16:58:51 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9d59b6cf-d24e-40ee-99c2-7ea042aa92a2 tempest-ProjectReaderTests-1968626820 None] Lock "cinder-c82c686a-581b-4794-a003-7b8dc3fa42ae-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:51 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-192d91f2-4a9a-4c44-aaca-a61a60f13d52 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-48e9f8c7-3cac-4576-b656-c4202a96021d-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:51 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9d59b6cf-d24e-40ee-99c2-7ea042aa92a2 tempest-ProjectReaderTests-1968626820 None] Acquiring lock "cinder-quobyte-c82c686a-581b-4794-a003-7b8dc3fa42ae" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:51 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9d59b6cf-d24e-40ee-99c2-7ea042aa92a2 tempest-ProjectReaderTests-1968626820 None] Lock "cinder-quobyte-c82c686a-581b-4794-a003-7b8dc3fa42ae" acquired by "delete_volume" :: waited 0.024s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:51 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6e903c-05b1-4127-a812-593ec418febe]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9d59b6cf-d24e-40ee-99c2-7ea042aa92a2 tempest-ProjectReaderTests-1968626820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c82c686a-581b-4794-a003-7b8dc3fa42ae {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:51 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9309f7b-bb08-4c8e-ac91-881bc190a3ca tempest-ProjectReaderTests-149416441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:58:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d9309f7b-bb08-4c8e-ac91-881bc190a3ca tempest-ProjectReaderTests-149416441 None] Flow 'volume_create_manager' (c6a22567-a295-467c-9c50-565624ba9294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:51 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d9309f7b-bb08-4c8e-ac91-881bc190a3ca tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f984e20-746d-4c62-8aad-ba88671c53ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:52 devstack sudo[108642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c82c686a-581b-4794-a003-7b8dc3fa42ae Sep 10 16:58:52 devstack sudo[108642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d9309f7b-bb08-4c8e-ac91-881bc190a3ca tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f984e20-746d-4c62-8aad-ba88671c53ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2048829017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=086eb299-30be-47cc-9c70-96daf11715cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83eb3afc5ee5439bb2b9b5a142ae00c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:52Z,use_quota=True,user_id='26a94e4aa8894307aa8c1ca59b9e1250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d9309f7b-bb08-4c8e-ac91-881bc190a3ca tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bd5c245-e27e-4523-817c-09bfdbe0a31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d9309f7b-bb08-4c8e-ac91-881bc190a3ca tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bd5c245-e27e-4523-817c-09bfdbe0a31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d9309f7b-bb08-4c8e-ac91-881bc190a3ca tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d03402-7584-4a86-a53f-35f880be3bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d9309f7b-bb08-4c8e-ac91-881bc190a3ca tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d03402-7584-4a86-a53f-35f880be3bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '086eb299-30be-47cc-9c70-96daf11715cb', 'volume_name': 'volume-086eb299-30be-47cc-9c70-96daf11715cb', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d9309f7b-bb08-4c8e-ac91-881bc190a3ca tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd00793-d86c-47a3-9478-bb79b30d835b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d9309f7b-bb08-4c8e-ac91-881bc190a3ca tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd00793-d86c-47a3-9478-bb79b30d835b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d9309f7b-bb08-4c8e-ac91-881bc190a3ca tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c023c03-37ef-4078-8270-7c7ef936f7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:52 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-d9309f7b-bb08-4c8e-ac91-881bc190a3ca tempest-ProjectReaderTests-149416441 None] Volume 086eb299-30be-47cc-9c70-96daf11715cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-086eb299-30be-47cc-9c70-96daf11715cb', 'volume_size': 1} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d9309f7b-bb08-4c8e-ac91-881bc190a3ca tempest-ProjectReaderTests-149416441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d9309f7b-bb08-4c8e-ac91-881bc190a3ca tempest-ProjectReaderTests-149416441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d9309f7b-bb08-4c8e-ac91-881bc190a3ca tempest-ProjectReaderTests-149416441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2048829017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=086eb299-30be-47cc-9c70-96daf11715cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83eb3afc5ee5439bb2b9b5a142ae00c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:52Z,use_quota=True,user_id='26a94e4aa8894307aa8c1ca59b9e1250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-d9309f7b-bb08-4c8e-ac91-881bc190a3ca tempest-ProjectReaderTests-149416441 None] Creating volume 086eb299-30be-47cc-9c70-96daf11715cb {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d9309f7b-bb08-4c8e-ac91-881bc190a3ca tempest-ProjectReaderTests-149416441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d9309f7b-bb08-4c8e-ac91-881bc190a3ca tempest-ProjectReaderTests-149416441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d9309f7b-bb08-4c8e-ac91-881bc190a3ca tempest-ProjectReaderTests-149416441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d9309f7b-bb08-4c8e-ac91-881bc190a3ca tempest-ProjectReaderTests-149416441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d9309f7b-bb08-4c8e-ac91-881bc190a3ca tempest-ProjectReaderTests-149416441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d9309f7b-bb08-4c8e-ac91-881bc190a3ca tempest-ProjectReaderTests-149416441 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:58:52 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-d9309f7b-bb08-4c8e-ac91-881bc190a3ca tempest-ProjectReaderTests-149416441 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d9309f7b-bb08-4c8e-ac91-881bc190a3ca tempest-ProjectReaderTests-149416441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-086eb299-30be-47cc-9c70-96daf11715cb 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:52 devstack sudo[108644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-086eb299-30be-47cc-9c70-96daf11715cb 1073741824 Sep 10 16:58:52 devstack sudo[108644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1f47fe0-d3c8-414f-9f2d-6138d0131fbf tempest-ProjectReaderTests-2110561421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a1f47fe0-d3c8-414f-9f2d-6138d0131fbf tempest-ProjectReaderTests-2110561421 None] Flow 'volume_create_manager' (6598224d-61aa-4483-8779-dbd597bd7f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a1f47fe0-d3c8-414f-9f2d-6138d0131fbf tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6abf3df-b77e-4da0-84e8-c633d0831d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a1f47fe0-d3c8-414f-9f2d-6138d0131fbf tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6abf3df-b77e-4da0-84e8-c633d0831d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-107258763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57359c11-93f4-4789-b654-5c282b7f944b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfe575cf67994730b27c40255f732200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:52Z,use_quota=True,user_id='767a2dafef0c46a7b707405a09806384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a1f47fe0-d3c8-414f-9f2d-6138d0131fbf tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9898349d-3ceb-4a4d-a1e6-ffbab32b586b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a1f47fe0-d3c8-414f-9f2d-6138d0131fbf tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9898349d-3ceb-4a4d-a1e6-ffbab32b586b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:52 devstack sudo[108642]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a1f47fe0-d3c8-414f-9f2d-6138d0131fbf tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f218c54-be17-4e23-b4fa-4006842ed5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a1f47fe0-d3c8-414f-9f2d-6138d0131fbf tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f218c54-be17-4e23-b4fa-4006842ed5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57359c11-93f4-4789-b654-5c282b7f944b', 'volume_name': 'volume-57359c11-93f4-4789-b654-5c282b7f944b', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a1f47fe0-d3c8-414f-9f2d-6138d0131fbf tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85756d25-b249-4063-a044-8942d509aa77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a1f47fe0-d3c8-414f-9f2d-6138d0131fbf tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85756d25-b249-4063-a044-8942d509aa77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a1f47fe0-d3c8-414f-9f2d-6138d0131fbf tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41632b88-f045-4393-aac6-2ec645b2c2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:52 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-a1f47fe0-d3c8-414f-9f2d-6138d0131fbf tempest-ProjectReaderTests-2110561421 None] Volume 57359c11-93f4-4789-b654-5c282b7f944b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57359c11-93f4-4789-b654-5c282b7f944b', 'volume_size': 1} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a1f47fe0-d3c8-414f-9f2d-6138d0131fbf tempest-ProjectReaderTests-2110561421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9d59b6cf-d24e-40ee-99c2-7ea042aa92a2 tempest-ProjectReaderTests-1968626820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c82c686a-581b-4794-a003-7b8dc3fa42ae" returned: 0 in 0.528s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9d59b6cf-d24e-40ee-99c2-7ea042aa92a2 tempest-ProjectReaderTests-1968626820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c82c686a-581b-4794-a003-7b8dc3fa42ae {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:52 devstack sudo[108652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c82c686a-581b-4794-a003-7b8dc3fa42ae Sep 10 16:58:52 devstack sudo[108652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-84e6bdc8-ede1-49b2-a0d5-cd3d220c6d20 tempest-ProjectMemberTests-1654965068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-84e6bdc8-ede1-49b2-a0d5-cd3d220c6d20 tempest-ProjectMemberTests-1654965068 None] Flow 'volume_create_manager' (27c9ce2c-8a8f-4e9a-805f-e51c2fa6373d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-84e6bdc8-ede1-49b2-a0d5-cd3d220c6d20 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e985865-0737-4eac-9084-ccd7f95be536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-84e6bdc8-ede1-49b2-a0d5-cd3d220c6d20 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e985865-0737-4eac-9084-ccd7f95be536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1356954489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9b55fce-e454-4373-b5ef-da23f7da1195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fdc4b0dbad645d8bc3672158e8e45da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:52Z,use_quota=True,user_id='4d7a8be540c54a1e9a03d51feae99641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-84e6bdc8-ede1-49b2-a0d5-cd3d220c6d20 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e429267-d060-4db6-ac30-098eb85a23ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-84e6bdc8-ede1-49b2-a0d5-cd3d220c6d20 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e429267-d060-4db6-ac30-098eb85a23ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-84e6bdc8-ede1-49b2-a0d5-cd3d220c6d20 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c85e98-42d9-4ca3-920f-dae678ba3966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-84e6bdc8-ede1-49b2-a0d5-cd3d220c6d20 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c85e98-42d9-4ca3-920f-dae678ba3966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9b55fce-e454-4373-b5ef-da23f7da1195', 'volume_name': 'volume-e9b55fce-e454-4373-b5ef-da23f7da1195', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-84e6bdc8-ede1-49b2-a0d5-cd3d220c6d20 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c2202b-7757-4c64-acf1-6623031e8558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-84e6bdc8-ede1-49b2-a0d5-cd3d220c6d20 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c2202b-7757-4c64-acf1-6623031e8558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-84e6bdc8-ede1-49b2-a0d5-cd3d220c6d20 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2437e689-14b5-454b-bb48-05622ce74d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:52 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-84e6bdc8-ede1-49b2-a0d5-cd3d220c6d20 tempest-ProjectMemberTests-1654965068 None] Volume e9b55fce-e454-4373-b5ef-da23f7da1195: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9b55fce-e454-4373-b5ef-da23f7da1195', 'volume_size': 1} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-84e6bdc8-ede1-49b2-a0d5-cd3d220c6d20 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:52 devstack sudo[108644]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d9309f7b-bb08-4c8e-ac91-881bc190a3ca tempest-ProjectReaderTests-149416441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-086eb299-30be-47cc-9c70-96daf11715cb 1073741824" returned: 0 in 0.503s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d9309f7b-bb08-4c8e-ac91-881bc190a3ca tempest-ProjectReaderTests-149416441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-086eb299-30be-47cc-9c70-96daf11715cb {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:52 devstack sudo[108654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-086eb299-30be-47cc-9c70-96daf11715cb Sep 10 16:58:52 devstack sudo[108654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:52 devstack sudo[108652]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9d59b6cf-d24e-40ee-99c2-7ea042aa92a2 tempest-ProjectReaderTests-1968626820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-c82c686a-581b-4794-a003-7b8dc3fa42ae" returned: 0 in 0.300s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9d59b6cf-d24e-40ee-99c2-7ea042aa92a2 tempest-ProjectReaderTests-1968626820 None] Lock "cinder-quobyte-c82c686a-581b-4794-a003-7b8dc3fa42ae" released by "delete_volume" :: held 0.895s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-9d59b6cf-d24e-40ee-99c2-7ea042aa92a2 tempest-ProjectReaderTests-1968626820 None] Created reservations ['78810383-9cfa-448c-bf4d-d4735a55f470', '67ff9106-42d0-413c-8cc4-f91ee0ed6efd', '32039baa-ca28-41b0-907b-7ff0708e1e7e', 'd380f57c-3770-441f-a246-8921d0d5fe72'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9d59b6cf-d24e-40ee-99c2-7ea042aa92a2 tempest-ProjectReaderTests-1968626820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9d59b6cf-d24e-40ee-99c2-7ea042aa92a2 tempest-ProjectReaderTests-1968626820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9d59b6cf-d24e-40ee-99c2-7ea042aa92a2 tempest-ProjectReaderTests-1968626820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9d59b6cf-d24e-40ee-99c2-7ea042aa92a2 tempest-ProjectReaderTests-1968626820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9d59b6cf-d24e-40ee-99c2-7ea042aa92a2 tempest-ProjectReaderTests-1968626820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9d59b6cf-d24e-40ee-99c2-7ea042aa92a2 tempest-ProjectReaderTests-1968626820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:52 devstack sudo[108657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:58:52 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:52 devstack sudo[108654]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d9309f7b-bb08-4c8e-ac91-881bc190a3ca tempest-ProjectReaderTests-149416441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-086eb299-30be-47cc-9c70-96daf11715cb" returned: 0 in 0.262s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d9309f7b-bb08-4c8e-ac91-881bc190a3ca tempest-ProjectReaderTests-149416441 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d9309f7b-bb08-4c8e-ac91-881bc190a3ca tempest-ProjectReaderTests-149416441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a1f47fe0-d3c8-414f-9f2d-6138d0131fbf tempest-ProjectReaderTests-2110561421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.509s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-a1f47fe0-d3c8-414f-9f2d-6138d0131fbf tempest-ProjectReaderTests-2110561421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-107258763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57359c11-93f4-4789-b654-5c282b7f944b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfe575cf67994730b27c40255f732200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:52Z,use_quota=True,user_id='767a2dafef0c46a7b707405a09806384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-a1f47fe0-d3c8-414f-9f2d-6138d0131fbf tempest-ProjectReaderTests-2110561421 None] Creating volume 57359c11-93f4-4789-b654-5c282b7f944b {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a1f47fe0-d3c8-414f-9f2d-6138d0131fbf tempest-ProjectReaderTests-2110561421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a1f47fe0-d3c8-414f-9f2d-6138d0131fbf tempest-ProjectReaderTests-2110561421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-a1f47fe0-d3c8-414f-9f2d-6138d0131fbf tempest-ProjectReaderTests-2110561421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-a1f47fe0-d3c8-414f-9f2d-6138d0131fbf tempest-ProjectReaderTests-2110561421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a1f47fe0-d3c8-414f-9f2d-6138d0131fbf tempest-ProjectReaderTests-2110561421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-a1f47fe0-d3c8-414f-9f2d-6138d0131fbf tempest-ProjectReaderTests-2110561421 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:58:52 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-a1f47fe0-d3c8-414f-9f2d-6138d0131fbf tempest-ProjectReaderTests-2110561421 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a1f47fe0-d3c8-414f-9f2d-6138d0131fbf tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d9309f7b-bb08-4c8e-ac91-881bc190a3ca tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c023c03-37ef-4078-8270-7c7ef936f7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-086eb299-30be-47cc-9c70-96daf11715cb', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:52 devstack sudo[108660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b 1073741824 Sep 10 16:58:52 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d9309f7b-bb08-4c8e-ac91-881bc190a3ca tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c0db1d-25a1-4cca-bccf-b629b112d970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:52 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-d9309f7b-bb08-4c8e-ac91-881bc190a3ca tempest-ProjectReaderTests-149416441 None] Volume volume-086eb299-30be-47cc-9c70-96daf11715cb (086eb299-30be-47cc-9c70-96daf11715cb): created successfully Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d9309f7b-bb08-4c8e-ac91-881bc190a3ca tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c0db1d-25a1-4cca-bccf-b629b112d970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:52 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-d9309f7b-bb08-4c8e-ac91-881bc190a3ca tempest-ProjectReaderTests-149416441 None] Flow 'volume_create_manager' (c6a22567-a295-467c-9c50-565624ba9294) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:53 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-d9309f7b-bb08-4c8e-ac91-881bc190a3ca tempest-ProjectReaderTests-149416441 None] Created volume successfully. Sep 10 16:58:53 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9d59b6cf-d24e-40ee-99c2-7ea042aa92a2 tempest-ProjectReaderTests-1968626820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.299s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:53 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-9d59b6cf-d24e-40ee-99c2-7ea042aa92a2 tempest-ProjectReaderTests-1968626820 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:58:53 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-9d59b6cf-d24e-40ee-99c2-7ea042aa92a2 tempest-ProjectReaderTests-1968626820 None] Deleted volume successfully. Sep 10 16:58:53 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9d59b6cf-d24e-40ee-99c2-7ea042aa92a2 tempest-ProjectReaderTests-1968626820 None] Lock "cinder-c82c686a-581b-4794-a003-7b8dc3fa42ae-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:53 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a1f47fe0-d3c8-414f-9f2d-6138d0131fbf tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b 1073741824" returned: 0 in 0.534s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a1f47fe0-d3c8-414f-9f2d-6138d0131fbf tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:53 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-9de06a95-549f-46eb-9c63-5efe9e60eee6 tempest-ProjectReaderTests-1968626820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:58:53 devstack sudo[108667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b Sep 10 16:58:53 devstack sudo[108667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9de06a95-549f-46eb-9c63-5efe9e60eee6 tempest-ProjectReaderTests-1968626820 None] Flow 'volume_create_manager' (b9856970-f926-4a45-80e4-7894b8bb0fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9de06a95-549f-46eb-9c63-5efe9e60eee6 tempest-ProjectReaderTests-1968626820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (605ba5b0-ee4d-4958-bf53-915555ae0e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9de06a95-549f-46eb-9c63-5efe9e60eee6 tempest-ProjectReaderTests-1968626820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (605ba5b0-ee4d-4958-bf53-915555ae0e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-48804107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3541db8b-3b00-4e9b-a913-d32b79eabe98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='569853389d4b4dfab82a283fb542b1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:53Z,use_quota=True,user_id='feaff37d3ac9457f9326c475e20ee9de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9de06a95-549f-46eb-9c63-5efe9e60eee6 tempest-ProjectReaderTests-1968626820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56fb685f-47ed-4b3d-a964-94b7c843e503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9de06a95-549f-46eb-9c63-5efe9e60eee6 tempest-ProjectReaderTests-1968626820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56fb685f-47ed-4b3d-a964-94b7c843e503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9de06a95-549f-46eb-9c63-5efe9e60eee6 tempest-ProjectReaderTests-1968626820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (731f862e-1c1c-4576-b307-1942d11eefb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9de06a95-549f-46eb-9c63-5efe9e60eee6 tempest-ProjectReaderTests-1968626820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (731f862e-1c1c-4576-b307-1942d11eefb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3541db8b-3b00-4e9b-a913-d32b79eabe98', 'volume_name': 'volume-3541db8b-3b00-4e9b-a913-d32b79eabe98', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9de06a95-549f-46eb-9c63-5efe9e60eee6 tempest-ProjectReaderTests-1968626820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1000231-0f00-42f5-b549-fcb5fc20dc79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9de06a95-549f-46eb-9c63-5efe9e60eee6 tempest-ProjectReaderTests-1968626820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1000231-0f00-42f5-b549-fcb5fc20dc79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9de06a95-549f-46eb-9c63-5efe9e60eee6 tempest-ProjectReaderTests-1968626820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f7fd35d-cbe6-40d0-8c0e-14c3658bf79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:53 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-9de06a95-549f-46eb-9c63-5efe9e60eee6 tempest-ProjectReaderTests-1968626820 None] Volume 3541db8b-3b00-4e9b-a913-d32b79eabe98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3541db8b-3b00-4e9b-a913-d32b79eabe98', 'volume_size': 1} Sep 10 16:58:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9de06a95-549f-46eb-9c63-5efe9e60eee6 tempest-ProjectReaderTests-1968626820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:53 devstack sudo[108667]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a1f47fe0-d3c8-414f-9f2d-6138d0131fbf tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b" returned: 0 in 0.254s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:53 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-a1f47fe0-d3c8-414f-9f2d-6138d0131fbf tempest-ProjectReaderTests-2110561421 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:58:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-a1f47fe0-d3c8-414f-9f2d-6138d0131fbf tempest-ProjectReaderTests-2110561421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-84e6bdc8-ede1-49b2-a0d5-cd3d220c6d20 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.223s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:53 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-84e6bdc8-ede1-49b2-a0d5-cd3d220c6d20 tempest-ProjectMemberTests-1654965068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1356954489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9b55fce-e454-4373-b5ef-da23f7da1195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fdc4b0dbad645d8bc3672158e8e45da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:52Z,use_quota=True,user_id='4d7a8be540c54a1e9a03d51feae99641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:58:53 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-84e6bdc8-ede1-49b2-a0d5-cd3d220c6d20 tempest-ProjectMemberTests-1654965068 None] Creating volume e9b55fce-e454-4373-b5ef-da23f7da1195 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:58:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-84e6bdc8-ede1-49b2-a0d5-cd3d220c6d20 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-84e6bdc8-ede1-49b2-a0d5-cd3d220c6d20 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:53 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-84e6bdc8-ede1-49b2-a0d5-cd3d220c6d20 tempest-ProjectMemberTests-1654965068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:53 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-84e6bdc8-ede1-49b2-a0d5-cd3d220c6d20 tempest-ProjectMemberTests-1654965068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-84e6bdc8-ede1-49b2-a0d5-cd3d220c6d20 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:53 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-84e6bdc8-ede1-49b2-a0d5-cd3d220c6d20 tempest-ProjectMemberTests-1654965068 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:58:53 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-84e6bdc8-ede1-49b2-a0d5-cd3d220c6d20 tempest-ProjectMemberTests-1654965068 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:58:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-84e6bdc8-ede1-49b2-a0d5-cd3d220c6d20 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:53 devstack sudo[108670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195 1073741824 Sep 10 16:58:53 devstack sudo[108670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a1f47fe0-d3c8-414f-9f2d-6138d0131fbf tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41632b88-f045-4393-aac6-2ec645b2c2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57359c11-93f4-4789-b654-5c282b7f944b', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a1f47fe0-d3c8-414f-9f2d-6138d0131fbf tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5bc7f93-c7b6-4379-8ac5-989db2be8974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:53 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-a1f47fe0-d3c8-414f-9f2d-6138d0131fbf tempest-ProjectReaderTests-2110561421 None] Volume volume-57359c11-93f4-4789-b654-5c282b7f944b (57359c11-93f4-4789-b654-5c282b7f944b): created successfully Sep 10 16:58:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a1f47fe0-d3c8-414f-9f2d-6138d0131fbf tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5bc7f93-c7b6-4379-8ac5-989db2be8974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:53 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-a1f47fe0-d3c8-414f-9f2d-6138d0131fbf tempest-ProjectReaderTests-2110561421 None] Flow 'volume_create_manager' (6598224d-61aa-4483-8779-dbd597bd7f5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:53 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-a1f47fe0-d3c8-414f-9f2d-6138d0131fbf tempest-ProjectReaderTests-2110561421 None] Created volume successfully. Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-78903d26-342a-4591-bad8-35b73eea2e1b tempest-ProjectReaderTests-149416441 None] Acquiring lock "cinder-086eb299-30be-47cc-9c70-96daf11715cb-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-78903d26-342a-4591-bad8-35b73eea2e1b tempest-ProjectReaderTests-149416441 None] Lock "cinder-086eb299-30be-47cc-9c70-96daf11715cb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-78903d26-342a-4591-bad8-35b73eea2e1b tempest-ProjectReaderTests-149416441 None] Acquiring lock "cinder-quobyte-086eb299-30be-47cc-9c70-96daf11715cb" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-78903d26-342a-4591-bad8-35b73eea2e1b tempest-ProjectReaderTests-149416441 None] Lock "cinder-quobyte-086eb299-30be-47cc-9c70-96daf11715cb" acquired by "delete_volume" :: waited 0.015s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf76722-2758-4a4f-9e05-aab046717925]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-78903d26-342a-4591-bad8-35b73eea2e1b tempest-ProjectReaderTests-149416441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-086eb299-30be-47cc-9c70-96daf11715cb {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:54 devstack sudo[108670]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-84e6bdc8-ede1-49b2-a0d5-cd3d220c6d20 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195 1073741824" returned: 0 in 0.500s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:54 devstack sudo[108676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-086eb299-30be-47cc-9c70-96daf11715cb Sep 10 16:58:54 devstack sudo[108676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-84e6bdc8-ede1-49b2-a0d5-cd3d220c6d20 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:54 devstack sudo[108678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195 Sep 10 16:58:54 devstack sudo[108678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d54e082d-7435-4ead-ad25-437e13437c23 tempest-ProjectReaderTests-2110561421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:54 devstack sudo[108676]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-78903d26-342a-4591-bad8-35b73eea2e1b tempest-ProjectReaderTests-149416441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-086eb299-30be-47cc-9c70-96daf11715cb" returned: 0 in 0.441s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-78903d26-342a-4591-bad8-35b73eea2e1b tempest-ProjectReaderTests-149416441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-086eb299-30be-47cc-9c70-96daf11715cb {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:54 devstack sudo[108684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-086eb299-30be-47cc-9c70-96daf11715cb Sep 10 16:58:54 devstack sudo[108684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:54 devstack sudo[108678]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-84e6bdc8-ede1-49b2-a0d5-cd3d220c6d20 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195" returned: 0 in 0.337s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-84e6bdc8-ede1-49b2-a0d5-cd3d220c6d20 tempest-ProjectMemberTests-1654965068 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-84e6bdc8-ede1-49b2-a0d5-cd3d220c6d20 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9de06a95-549f-46eb-9c63-5efe9e60eee6 tempest-ProjectReaderTests-1968626820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.052s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9de06a95-549f-46eb-9c63-5efe9e60eee6 tempest-ProjectReaderTests-1968626820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-48804107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3541db8b-3b00-4e9b-a913-d32b79eabe98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='569853389d4b4dfab82a283fb542b1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:53Z,use_quota=True,user_id='feaff37d3ac9457f9326c475e20ee9de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-9de06a95-549f-46eb-9c63-5efe9e60eee6 tempest-ProjectReaderTests-1968626820 None] Creating volume 3541db8b-3b00-4e9b-a913-d32b79eabe98 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9de06a95-549f-46eb-9c63-5efe9e60eee6 tempest-ProjectReaderTests-1968626820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9de06a95-549f-46eb-9c63-5efe9e60eee6 tempest-ProjectReaderTests-1968626820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9de06a95-549f-46eb-9c63-5efe9e60eee6 tempest-ProjectReaderTests-1968626820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9de06a95-549f-46eb-9c63-5efe9e60eee6 tempest-ProjectReaderTests-1968626820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9de06a95-549f-46eb-9c63-5efe9e60eee6 tempest-ProjectReaderTests-1968626820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9de06a95-549f-46eb-9c63-5efe9e60eee6 tempest-ProjectReaderTests-1968626820 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:58:54 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-9de06a95-549f-46eb-9c63-5efe9e60eee6 tempest-ProjectReaderTests-1968626820 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9de06a95-549f-46eb-9c63-5efe9e60eee6 tempest-ProjectReaderTests-1968626820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3541db8b-3b00-4e9b-a913-d32b79eabe98 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:54 devstack sudo[108686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3541db8b-3b00-4e9b-a913-d32b79eabe98 1073741824 Sep 10 16:58:54 devstack sudo[108686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-84e6bdc8-ede1-49b2-a0d5-cd3d220c6d20 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2437e689-14b5-454b-bb48-05622ce74d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9b55fce-e454-4373-b5ef-da23f7da1195', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-84e6bdc8-ede1-49b2-a0d5-cd3d220c6d20 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0db6e041-339d-42dc-894b-79400e639eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:54 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-84e6bdc8-ede1-49b2-a0d5-cd3d220c6d20 tempest-ProjectMemberTests-1654965068 None] Volume volume-e9b55fce-e454-4373-b5ef-da23f7da1195 (e9b55fce-e454-4373-b5ef-da23f7da1195): created successfully Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-84e6bdc8-ede1-49b2-a0d5-cd3d220c6d20 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0db6e041-339d-42dc-894b-79400e639eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-84e6bdc8-ede1-49b2-a0d5-cd3d220c6d20 tempest-ProjectMemberTests-1654965068 None] Flow 'volume_create_manager' (27c9ce2c-8a8f-4e9a-805f-e51c2fa6373d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:54 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-84e6bdc8-ede1-49b2-a0d5-cd3d220c6d20 tempest-ProjectMemberTests-1654965068 None] Created volume successfully. Sep 10 16:58:54 devstack sudo[108684]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-78903d26-342a-4591-bad8-35b73eea2e1b tempest-ProjectReaderTests-149416441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-086eb299-30be-47cc-9c70-96daf11715cb" returned: 0 in 0.267s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-78903d26-342a-4591-bad8-35b73eea2e1b tempest-ProjectReaderTests-149416441 None] Lock "cinder-quobyte-086eb299-30be-47cc-9c70-96daf11715cb" released by "delete_volume" :: held 0.750s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-78903d26-342a-4591-bad8-35b73eea2e1b tempest-ProjectReaderTests-149416441 None] Created reservations ['49c580cc-8706-42e2-8184-c6f95bbe2339', '021701a0-7d49-40d1-8331-02399eb5f84d', '8700d51b-59ed-4225-a035-1f4fae56d846', '260a1182-aee8-4e2f-9ee6-59c5a28b4b7a'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-78903d26-342a-4591-bad8-35b73eea2e1b tempest-ProjectReaderTests-149416441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-78903d26-342a-4591-bad8-35b73eea2e1b tempest-ProjectReaderTests-149416441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-78903d26-342a-4591-bad8-35b73eea2e1b tempest-ProjectReaderTests-149416441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-78903d26-342a-4591-bad8-35b73eea2e1b tempest-ProjectReaderTests-149416441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-78903d26-342a-4591-bad8-35b73eea2e1b tempest-ProjectReaderTests-149416441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:54 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-78903d26-342a-4591-bad8-35b73eea2e1b tempest-ProjectReaderTests-149416441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:55 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:58:55 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:55 devstack sudo[108686]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9de06a95-549f-46eb-9c63-5efe9e60eee6 tempest-ProjectReaderTests-1968626820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3541db8b-3b00-4e9b-a913-d32b79eabe98 1073741824" returned: 0 in 0.467s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9de06a95-549f-46eb-9c63-5efe9e60eee6 tempest-ProjectReaderTests-1968626820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3541db8b-3b00-4e9b-a913-d32b79eabe98 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:55 devstack sudo[108695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3541db8b-3b00-4e9b-a913-d32b79eabe98 Sep 10 16:58:55 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:55 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-78903d26-342a-4591-bad8-35b73eea2e1b tempest-ProjectReaderTests-149416441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.270s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-78903d26-342a-4591-bad8-35b73eea2e1b tempest-ProjectReaderTests-149416441 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:58:55 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-78903d26-342a-4591-bad8-35b73eea2e1b tempest-ProjectReaderTests-149416441 None] Deleted volume successfully. Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-78903d26-342a-4591-bad8-35b73eea2e1b tempest-ProjectReaderTests-149416441 None] Lock "cinder-086eb299-30be-47cc-9c70-96daf11715cb-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:55 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9de06a95-549f-46eb-9c63-5efe9e60eee6 tempest-ProjectReaderTests-1968626820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3541db8b-3b00-4e9b-a913-d32b79eabe98" returned: 0 in 0.267s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9de06a95-549f-46eb-9c63-5efe9e60eee6 tempest-ProjectReaderTests-1968626820 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9de06a95-549f-46eb-9c63-5efe9e60eee6 tempest-ProjectReaderTests-1968626820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d54e082d-7435-4ead-ad25-437e13437c23 tempest-ProjectReaderTests-2110561421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.995s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9de06a95-549f-46eb-9c63-5efe9e60eee6 tempest-ProjectReaderTests-1968626820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f7fd35d-cbe6-40d0-8c0e-14c3658bf79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3541db8b-3b00-4e9b-a913-d32b79eabe98', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9de06a95-549f-46eb-9c63-5efe9e60eee6 tempest-ProjectReaderTests-1968626820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16981a66-ce9f-4044-bc4e-bf6ef1559650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-d54e082d-7435-4ead-ad25-437e13437c23 tempest-ProjectReaderTests-2110561421 None] Creating offline snapshot bc5c1e00-370e-4cc7-bb7e-190dd20549af of volume 57359c11-93f4-4789-b654-5c282b7f944b {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:58:55 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-9de06a95-549f-46eb-9c63-5efe9e60eee6 tempest-ProjectReaderTests-1968626820 None] Volume volume-3541db8b-3b00-4e9b-a913-d32b79eabe98 (3541db8b-3b00-4e9b-a913-d32b79eabe98): created successfully Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9de06a95-549f-46eb-9c63-5efe9e60eee6 tempest-ProjectReaderTests-1968626820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16981a66-ce9f-4044-bc4e-bf6ef1559650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9de06a95-549f-46eb-9c63-5efe9e60eee6 tempest-ProjectReaderTests-1968626820 None] Flow 'volume_create_manager' (b9856970-f926-4a45-80e4-7894b8bb0fed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[31bba075-55c9-4d1c-aacc-7139161fbfd3]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d54e082d-7435-4ead-ad25-437e13437c23 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:55 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-9de06a95-549f-46eb-9c63-5efe9e60eee6 tempest-ProjectReaderTests-1968626820 None] Created volume successfully. Sep 10 16:58:55 devstack sudo[108699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b Sep 10 16:58:55 devstack sudo[108699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-92678426-a9b6-423f-990c-b2b69b90af98 tempest-ProjectReaderTests-1968626820 None] Acquiring lock "cinder-3541db8b-3b00-4e9b-a913-d32b79eabe98-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-92678426-a9b6-423f-990c-b2b69b90af98 tempest-ProjectReaderTests-1968626820 None] Lock "cinder-3541db8b-3b00-4e9b-a913-d32b79eabe98-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-329ef24a-796c-4ba2-bde4-56f561e26af5 tempest-ProjectReaderTests-149416441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-329ef24a-796c-4ba2-bde4-56f561e26af5 tempest-ProjectReaderTests-149416441 None] Flow 'volume_create_manager' (6e7378da-4bac-4fe6-9ba3-8e1b65e1723f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-329ef24a-796c-4ba2-bde4-56f561e26af5 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd133eb7-52a9-4901-a4c2-8f1ed372d36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-329ef24a-796c-4ba2-bde4-56f561e26af5 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd133eb7-52a9-4901-a4c2-8f1ed372d36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1288559487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83177af3-6134-40b3-af02-29b4d3d457b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83eb3afc5ee5439bb2b9b5a142ae00c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:56Z,use_quota=True,user_id='26a94e4aa8894307aa8c1ca59b9e1250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-329ef24a-796c-4ba2-bde4-56f561e26af5 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ba4709-094c-4feb-8ed8-415ca5eb64e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-329ef24a-796c-4ba2-bde4-56f561e26af5 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ba4709-094c-4feb-8ed8-415ca5eb64e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-329ef24a-796c-4ba2-bde4-56f561e26af5 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d15f37-f921-42aa-85f9-17e40697af75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-329ef24a-796c-4ba2-bde4-56f561e26af5 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d15f37-f921-42aa-85f9-17e40697af75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83177af3-6134-40b3-af02-29b4d3d457b9', 'volume_name': 'volume-83177af3-6134-40b3-af02-29b4d3d457b9', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-329ef24a-796c-4ba2-bde4-56f561e26af5 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1c8553-9b2d-440e-850d-fdf580d11340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-329ef24a-796c-4ba2-bde4-56f561e26af5 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1c8553-9b2d-440e-850d-fdf580d11340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-329ef24a-796c-4ba2-bde4-56f561e26af5 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf99811-9126-49f9-a8e8-2c03061eac80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:55 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-329ef24a-796c-4ba2-bde4-56f561e26af5 tempest-ProjectReaderTests-149416441 None] Volume 83177af3-6134-40b3-af02-29b4d3d457b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83177af3-6134-40b3-af02-29b4d3d457b9', 'volume_size': 1} Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-329ef24a-796c-4ba2-bde4-56f561e26af5 tempest-ProjectReaderTests-149416441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-92678426-a9b6-423f-990c-b2b69b90af98 tempest-ProjectReaderTests-1968626820 None] Acquiring lock "cinder-quobyte-3541db8b-3b00-4e9b-a913-d32b79eabe98" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-953b297d-330f-4842-87e2-37f9f71e6805 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-92678426-a9b6-423f-990c-b2b69b90af98 tempest-ProjectReaderTests-1968626820 None] Lock "cinder-quobyte-3541db8b-3b00-4e9b-a913-d32b79eabe98" acquired by "delete_volume" :: waited 0.014s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d5e568-b9e8-439c-bac3-44accaea6a20]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-92678426-a9b6-423f-990c-b2b69b90af98 tempest-ProjectReaderTests-1968626820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3541db8b-3b00-4e9b-a913-d32b79eabe98 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:55 devstack sudo[108699]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d54e082d-7435-4ead-ad25-437e13437c23 tempest-ProjectReaderTests-2110561421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b" returned: 0 in 0.488s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:55 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d54e082d-7435-4ead-ad25-437e13437c23 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b.bc5c1e00-370e-4cc7-bb7e-190dd20549af 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:56 devstack sudo[108706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b.bc5c1e00-370e-4cc7-bb7e-190dd20549af 1G Sep 10 16:58:56 devstack sudo[108706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:56 devstack sudo[108704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3541db8b-3b00-4e9b-a913-d32b79eabe98 Sep 10 16:58:56 devstack sudo[108704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:56 devstack sudo[108704]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-92678426-a9b6-423f-990c-b2b69b90af98 tempest-ProjectReaderTests-1968626820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3541db8b-3b00-4e9b-a913-d32b79eabe98" returned: 0 in 0.363s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-92678426-a9b6-423f-990c-b2b69b90af98 tempest-ProjectReaderTests-1968626820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3541db8b-3b00-4e9b-a913-d32b79eabe98 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:56 devstack sudo[108715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3541db8b-3b00-4e9b-a913-d32b79eabe98 Sep 10 16:58:56 devstack sudo[108715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:56 devstack sudo[108706]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d54e082d-7435-4ead-ad25-437e13437c23 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b.bc5c1e00-370e-4cc7-bb7e-190dd20549af 1G" returned: 0 in 0.422s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d54e082d-7435-4ead-ad25-437e13437c23 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57359c11-93f4-4789-b654-5c282b7f944b -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b.bc5c1e00-370e-4cc7-bb7e-190dd20549af {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:56 devstack sudo[108718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57359c11-93f4-4789-b654-5c282b7f944b -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b.bc5c1e00-370e-4cc7-bb7e-190dd20549af Sep 10 16:58:56 devstack sudo[108718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:56 devstack sudo[108715]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-92678426-a9b6-423f-990c-b2b69b90af98 tempest-ProjectReaderTests-1968626820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-3541db8b-3b00-4e9b-a913-d32b79eabe98" returned: 0 in 0.273s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:56 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-92678426-a9b6-423f-990c-b2b69b90af98 tempest-ProjectReaderTests-1968626820 None] Lock "cinder-quobyte-3541db8b-3b00-4e9b-a913-d32b79eabe98" released by "delete_volume" :: held 0.680s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:56 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-92678426-a9b6-423f-990c-b2b69b90af98 tempest-ProjectReaderTests-1968626820 None] Created reservations ['91dc795b-43c4-4c7b-b7ab-702eeadee571', 'fbca2ec8-7b8e-4570-be20-f8bcbfccaf36', 'ea59df84-c9f9-4dfe-95f6-7d91abd0ce70', '3366093f-4e19-4b70-9d0c-00a87021aeda'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:58:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-92678426-a9b6-423f-990c-b2b69b90af98 tempest-ProjectReaderTests-1968626820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-92678426-a9b6-423f-990c-b2b69b90af98 tempest-ProjectReaderTests-1968626820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:56 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-92678426-a9b6-423f-990c-b2b69b90af98 tempest-ProjectReaderTests-1968626820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:56 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-92678426-a9b6-423f-990c-b2b69b90af98 tempest-ProjectReaderTests-1968626820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-92678426-a9b6-423f-990c-b2b69b90af98 tempest-ProjectReaderTests-1968626820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-92678426-a9b6-423f-990c-b2b69b90af98 tempest-ProjectReaderTests-1968626820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:56 devstack sudo[108724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:58:56 devstack sudo[108724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:56 devstack sudo[108718]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d54e082d-7435-4ead-ad25-437e13437c23 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57359c11-93f4-4789-b654-5c282b7f944b -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b.bc5c1e00-370e-4cc7-bb7e-190dd20549af" returned: 0 in 0.355s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:56 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-d54e082d-7435-4ead-ad25-437e13437c23 tempest-ProjectReaderTests-2110561421 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b.bc5c1e00-370e-4cc7-bb7e-190dd20549af is being set with open permissions: ugo+rw Sep 10 16:58:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d54e082d-7435-4ead-ad25-437e13437c23 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b.bc5c1e00-370e-4cc7-bb7e-190dd20549af {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:56 devstack sudo[108726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b.bc5c1e00-370e-4cc7-bb7e-190dd20549af Sep 10 16:58:56 devstack sudo[108726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:56 devstack sudo[108724]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:56 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-92678426-a9b6-423f-990c-b2b69b90af98 tempest-ProjectReaderTests-1968626820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.266s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:56 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-92678426-a9b6-423f-990c-b2b69b90af98 tempest-ProjectReaderTests-1968626820 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:58:56 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-92678426-a9b6-423f-990c-b2b69b90af98 tempest-ProjectReaderTests-1968626820 None] Deleted volume successfully. Sep 10 16:58:57 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-92678426-a9b6-423f-990c-b2b69b90af98 tempest-ProjectReaderTests-1968626820 None] Lock "cinder-3541db8b-3b00-4e9b-a913-d32b79eabe98-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:58:57 devstack sudo[108726]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d54e082d-7435-4ead-ad25-437e13437c23 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b.bc5c1e00-370e-4cc7-bb7e-190dd20549af" returned: 0 in 0.271s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d54e082d-7435-4ead-ad25-437e13437c23 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:57 devstack sudo[108730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b.info Sep 10 16:58:57 devstack sudo[108730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:57 devstack sudo[108730]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d54e082d-7435-4ead-ad25-437e13437c23 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b.info" returned: 0 in 0.258s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:57 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-d54e082d-7435-4ead-ad25-437e13437c23 tempest-ProjectReaderTests-2110561421 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b.info is being set with open permissions: ugo+rw Sep 10 16:58:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d54e082d-7435-4ead-ad25-437e13437c23 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:57 devstack sudo[108733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b.info Sep 10 16:58:57 devstack sudo[108733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:57 devstack sudo[108733]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d54e082d-7435-4ead-ad25-437e13437c23 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b.info" returned: 0 in 0.252s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d54e082d-7435-4ead-ad25-437e13437c23 tempest-ProjectReaderTests-2110561421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.177s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-329ef24a-796c-4ba2-bde4-56f561e26af5 tempest-ProjectReaderTests-149416441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.726s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:57 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-329ef24a-796c-4ba2-bde4-56f561e26af5 tempest-ProjectReaderTests-149416441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1288559487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83177af3-6134-40b3-af02-29b4d3d457b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83eb3afc5ee5439bb2b9b5a142ae00c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:58:56Z,use_quota=True,user_id='26a94e4aa8894307aa8c1ca59b9e1250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:58:57 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-329ef24a-796c-4ba2-bde4-56f561e26af5 tempest-ProjectReaderTests-149416441 None] Creating volume 83177af3-6134-40b3-af02-29b4d3d457b9 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:58:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-329ef24a-796c-4ba2-bde4-56f561e26af5 tempest-ProjectReaderTests-149416441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:58:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-329ef24a-796c-4ba2-bde4-56f561e26af5 tempest-ProjectReaderTests-149416441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:57 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-329ef24a-796c-4ba2-bde4-56f561e26af5 tempest-ProjectReaderTests-149416441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:58:57 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-329ef24a-796c-4ba2-bde4-56f561e26af5 tempest-ProjectReaderTests-149416441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:58:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-329ef24a-796c-4ba2-bde4-56f561e26af5 tempest-ProjectReaderTests-149416441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:57 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-329ef24a-796c-4ba2-bde4-56f561e26af5 tempest-ProjectReaderTests-149416441 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:58:57 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-329ef24a-796c-4ba2-bde4-56f561e26af5 tempest-ProjectReaderTests-149416441 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:58:57 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-329ef24a-796c-4ba2-bde4-56f561e26af5 tempest-ProjectReaderTests-149416441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-83177af3-6134-40b3-af02-29b4d3d457b9 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:57 devstack sudo[108736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-83177af3-6134-40b3-af02-29b4d3d457b9 1073741824 Sep 10 16:58:57 devstack sudo[108736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:57 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-d54e082d-7435-4ead-ad25-437e13437c23 tempest-ProjectReaderTests-2110561421 None] Create snapshot completed successfully Sep 10 16:58:58 devstack sudo[108736]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-329ef24a-796c-4ba2-bde4-56f561e26af5 tempest-ProjectReaderTests-149416441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-83177af3-6134-40b3-af02-29b4d3d457b9 1073741824" returned: 0 in 0.489s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-329ef24a-796c-4ba2-bde4-56f561e26af5 tempest-ProjectReaderTests-149416441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-83177af3-6134-40b3-af02-29b4d3d457b9 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:58 devstack sudo[108742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-83177af3-6134-40b3-af02-29b4d3d457b9 Sep 10 16:58:58 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:58 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-329ef24a-796c-4ba2-bde4-56f561e26af5 tempest-ProjectReaderTests-149416441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-83177af3-6134-40b3-af02-29b4d3d457b9" returned: 0 in 0.268s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:58 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-329ef24a-796c-4ba2-bde4-56f561e26af5 tempest-ProjectReaderTests-149416441 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:58:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-329ef24a-796c-4ba2-bde4-56f561e26af5 tempest-ProjectReaderTests-149416441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:58:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-953b297d-330f-4842-87e2-37f9f71e6805 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.514s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:58:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-329ef24a-796c-4ba2-bde4-56f561e26af5 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf99811-9126-49f9-a8e8-2c03061eac80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83177af3-6134-40b3-af02-29b4d3d457b9', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-329ef24a-796c-4ba2-bde4-56f561e26af5 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d265b98-1b86-4f93-8558-02b6da2ef95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:58:58 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-953b297d-330f-4842-87e2-37f9f71e6805 tempest-ProjectMemberTests-1654965068 None] Creating offline snapshot 805ebac6-4023-426c-afbe-86b96f1294e8 of volume e9b55fce-e454-4373-b5ef-da23f7da1195 {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:58:58 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-329ef24a-796c-4ba2-bde4-56f561e26af5 tempest-ProjectReaderTests-149416441 None] Volume volume-83177af3-6134-40b3-af02-29b4d3d457b9 (83177af3-6134-40b3-af02-29b4d3d457b9): created successfully Sep 10 16:58:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-329ef24a-796c-4ba2-bde4-56f561e26af5 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d265b98-1b86-4f93-8558-02b6da2ef95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:58:58 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-329ef24a-796c-4ba2-bde4-56f561e26af5 tempest-ProjectReaderTests-149416441 None] Flow 'volume_create_manager' (6e7378da-4bac-4fe6-9ba3-8e1b65e1723f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:58:58 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81c6065-0df9-4f94-b549-abc46f514a62]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-953b297d-330f-4842-87e2-37f9f71e6805 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:58 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-329ef24a-796c-4ba2-bde4-56f561e26af5 tempest-ProjectReaderTests-149416441 None] Created volume successfully. Sep 10 16:58:58 devstack sudo[108745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195 Sep 10 16:58:58 devstack sudo[108745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:58 devstack sudo[108745]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-953b297d-330f-4842-87e2-37f9f71e6805 tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195" returned: 0 in 0.407s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:58 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-953b297d-330f-4842-87e2-37f9f71e6805 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195.805ebac6-4023-426c-afbe-86b96f1294e8 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:58 devstack sudo[108752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195.805ebac6-4023-426c-afbe-86b96f1294e8 1G Sep 10 16:58:58 devstack sudo[108752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:58 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-accc448d-247b-4ac6-ae0a-bf1927dd3fb2 tempest-ProjectReaderTests-149416441 None] Acquiring lock "cinder-83177af3-6134-40b3-af02-29b4d3d457b9-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:59 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-accc448d-247b-4ac6-ae0a-bf1927dd3fb2 tempest-ProjectReaderTests-149416441 None] Lock "cinder-83177af3-6134-40b3-af02-29b4d3d457b9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:59 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bb8942a2-88b3-4431-b955-f57b30d8073c tempest-ProjectReaderTests-2110561421 None] Acquiring lock "cinder-bc5c1e00-370e-4cc7-bb7e-190dd20549af-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:59 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-accc448d-247b-4ac6-ae0a-bf1927dd3fb2 tempest-ProjectReaderTests-149416441 None] Acquiring lock "cinder-quobyte-83177af3-6134-40b3-af02-29b4d3d457b9" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:59 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bb8942a2-88b3-4431-b955-f57b30d8073c tempest-ProjectReaderTests-2110561421 None] Lock "cinder-bc5c1e00-370e-4cc7-bb7e-190dd20549af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:59 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bb8942a2-88b3-4431-b955-f57b30d8073c tempest-ProjectReaderTests-2110561421 None] Acquiring lock "cinder-quobyte-57359c11-93f4-4789-b654-5c282b7f944b" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:59 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-accc448d-247b-4ac6-ae0a-bf1927dd3fb2 tempest-ProjectReaderTests-149416441 None] Lock "cinder-quobyte-83177af3-6134-40b3-af02-29b4d3d457b9" acquired by "delete_volume" :: waited 0.043s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:59 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bb8942a2-88b3-4431-b955-f57b30d8073c tempest-ProjectReaderTests-2110561421 None] Lock "cinder-quobyte-57359c11-93f4-4789-b654-5c282b7f944b" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:59 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bb8942a2-88b3-4431-b955-f57b30d8073c tempest-ProjectReaderTests-2110561421 None] Acquiring lock "cinder-quobyte-bc5c1e00-370e-4cc7-bb7e-190dd20549af" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:58:59 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[165e6f16-76d6-4786-b780-baf00df9be75]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-accc448d-247b-4ac6-ae0a-bf1927dd3fb2 tempest-ProjectReaderTests-149416441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-83177af3-6134-40b3-af02-29b4d3d457b9 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:59 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bb8942a2-88b3-4431-b955-f57b30d8073c tempest-ProjectReaderTests-2110561421 None] Lock "cinder-quobyte-bc5c1e00-370e-4cc7-bb7e-190dd20549af" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:58:59 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-bb8942a2-88b3-4431-b955-f57b30d8073c tempest-ProjectReaderTests-2110561421 None] Deleting offline snapshot bc5c1e00-370e-4cc7-bb7e-190dd20549af of volume 57359c11-93f4-4789-b654-5c282b7f944b {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:58:59 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-bb8942a2-88b3-4431-b955-f57b30d8073c tempest-ProjectReaderTests-2110561421 None] snapshot_file for this snap is: volume-57359c11-93f4-4789-b654-5c282b7f944b.bc5c1e00-370e-4cc7-bb7e-190dd20549af {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:58:59 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ea67d5-e9f9-4caf-9e87-53bf5ec17280]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bb8942a2-88b3-4431-b955-f57b30d8073c tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b.bc5c1e00-370e-4cc7-bb7e-190dd20549af {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:59 devstack sudo[108755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-83177af3-6134-40b3-af02-29b4d3d457b9 Sep 10 16:58:59 devstack sudo[108755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:59 devstack sudo[108758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b.bc5c1e00-370e-4cc7-bb7e-190dd20549af Sep 10 16:58:59 devstack sudo[108758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:59 devstack sudo[108752]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-953b297d-330f-4842-87e2-37f9f71e6805 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195.805ebac6-4023-426c-afbe-86b96f1294e8 1G" returned: 0 in 0.560s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-953b297d-330f-4842-87e2-37f9f71e6805 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9b55fce-e454-4373-b5ef-da23f7da1195 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195.805ebac6-4023-426c-afbe-86b96f1294e8 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:59 devstack sudo[108763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9b55fce-e454-4373-b5ef-da23f7da1195 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195.805ebac6-4023-426c-afbe-86b96f1294e8 Sep 10 16:58:59 devstack sudo[108763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:59 devstack sudo[108755]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-accc448d-247b-4ac6-ae0a-bf1927dd3fb2 tempest-ProjectReaderTests-149416441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-83177af3-6134-40b3-af02-29b4d3d457b9" returned: 0 in 0.454s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-accc448d-247b-4ac6-ae0a-bf1927dd3fb2 tempest-ProjectReaderTests-149416441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-83177af3-6134-40b3-af02-29b4d3d457b9 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:59 devstack sudo[108758]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:59 devstack sudo[108771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-83177af3-6134-40b3-af02-29b4d3d457b9 Sep 10 16:58:59 devstack sudo[108771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bb8942a2-88b3-4431-b955-f57b30d8073c tempest-ProjectReaderTests-2110561421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b.bc5c1e00-370e-4cc7-bb7e-190dd20549af" returned: 0 in 0.427s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:59 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-bb8942a2-88b3-4431-b955-f57b30d8073c tempest-ProjectReaderTests-2110561421 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57359c11-93f4-4789-b654-5c282b7f944b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:58:59 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc168537-b6ae-4a1a-81dd-dd23b6fe0a5d]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:58:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bb8942a2-88b3-4431-b955-f57b30d8073c tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:59 devstack sudo[108773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b Sep 10 16:58:59 devstack sudo[108773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:59 devstack sudo[108763]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-953b297d-330f-4842-87e2-37f9f71e6805 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9b55fce-e454-4373-b5ef-da23f7da1195 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195.805ebac6-4023-426c-afbe-86b96f1294e8" returned: 0 in 0.394s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:59 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-953b297d-330f-4842-87e2-37f9f71e6805 tempest-ProjectMemberTests-1654965068 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195.805ebac6-4023-426c-afbe-86b96f1294e8 is being set with open permissions: ugo+rw Sep 10 16:58:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-953b297d-330f-4842-87e2-37f9f71e6805 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195.805ebac6-4023-426c-afbe-86b96f1294e8 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:58:59 devstack sudo[108779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195.805ebac6-4023-426c-afbe-86b96f1294e8 Sep 10 16:58:59 devstack sudo[108779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:58:59 devstack sudo[108771]: pam_unix(sudo:session): session closed for user root Sep 10 16:58:59 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-accc448d-247b-4ac6-ae0a-bf1927dd3fb2 tempest-ProjectReaderTests-149416441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-83177af3-6134-40b3-af02-29b4d3d457b9" returned: 0 in 0.315s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:58:59 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-accc448d-247b-4ac6-ae0a-bf1927dd3fb2 tempest-ProjectReaderTests-149416441 None] Lock "cinder-quobyte-83177af3-6134-40b3-af02-29b4d3d457b9" released by "delete_volume" :: held 0.831s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:00 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-accc448d-247b-4ac6-ae0a-bf1927dd3fb2 tempest-ProjectReaderTests-149416441 None] Created reservations ['e0f3b44b-dd7b-4fe9-b081-61c73846ebfe', 'bb69e429-d255-4045-bb80-f48236244626', '3b16b76a-6d22-40c2-aef4-f92493a067a0', 'bcc0fbd0-dbf3-469e-9490-15125990b0fd'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:59:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-accc448d-247b-4ac6-ae0a-bf1927dd3fb2 tempest-ProjectReaderTests-149416441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-accc448d-247b-4ac6-ae0a-bf1927dd3fb2 tempest-ProjectReaderTests-149416441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:00 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-accc448d-247b-4ac6-ae0a-bf1927dd3fb2 tempest-ProjectReaderTests-149416441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:59:00 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-accc448d-247b-4ac6-ae0a-bf1927dd3fb2 tempest-ProjectReaderTests-149416441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:59:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-accc448d-247b-4ac6-ae0a-bf1927dd3fb2 tempest-ProjectReaderTests-149416441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-accc448d-247b-4ac6-ae0a-bf1927dd3fb2 tempest-ProjectReaderTests-149416441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:00 devstack sudo[108779]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:00 devstack sudo[108773]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-953b297d-330f-4842-87e2-37f9f71e6805 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195.805ebac6-4023-426c-afbe-86b96f1294e8" returned: 0 in 0.345s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bb8942a2-88b3-4431-b955-f57b30d8073c tempest-ProjectReaderTests-2110561421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b" returned: 0 in 0.488s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bb8942a2-88b3-4431-b955-f57b30d8073c tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b.bc5c1e00-370e-4cc7-bb7e-190dd20549af {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:00 devstack sudo[108787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:59:00 devstack sudo[108787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-953b297d-330f-4842-87e2-37f9f71e6805 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:00 devstack sudo[108788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b.bc5c1e00-370e-4cc7-bb7e-190dd20549af Sep 10 16:59:00 devstack sudo[108788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:00 devstack sudo[108790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195.info Sep 10 16:59:00 devstack sudo[108790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:00 devstack sudo[108787]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-accc448d-247b-4ac6-ae0a-bf1927dd3fb2 tempest-ProjectReaderTests-149416441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.445s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:00 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-accc448d-247b-4ac6-ae0a-bf1927dd3fb2 tempest-ProjectReaderTests-149416441 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:59:00 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-accc448d-247b-4ac6-ae0a-bf1927dd3fb2 tempest-ProjectReaderTests-149416441 None] Deleted volume successfully. Sep 10 16:59:00 devstack sudo[108790]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-953b297d-330f-4842-87e2-37f9f71e6805 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195.info" returned: 0 in 0.422s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:00 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-953b297d-330f-4842-87e2-37f9f71e6805 tempest-ProjectMemberTests-1654965068 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195.info is being set with open permissions: ugo+rw Sep 10 16:59:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-953b297d-330f-4842-87e2-37f9f71e6805 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:00 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-accc448d-247b-4ac6-ae0a-bf1927dd3fb2 tempest-ProjectReaderTests-149416441 None] Lock "cinder-83177af3-6134-40b3-af02-29b4d3d457b9-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:00 devstack sudo[108798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195.info Sep 10 16:59:00 devstack sudo[108798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:00 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a6a3592-e229-4f4e-b969-e02651859470 tempest-ProjectReaderTests-149416441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:59:00 devstack sudo[108788]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a6a3592-e229-4f4e-b969-e02651859470 tempest-ProjectReaderTests-149416441 None] Flow 'volume_create_manager' (0608a51b-ba9d-4f8a-a4f5-28d77be9e63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:59:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a6a3592-e229-4f4e-b969-e02651859470 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b0ce41d-6ada-4915-b258-283e13ff9f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bb8942a2-88b3-4431-b955-f57b30d8073c tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b.bc5c1e00-370e-4cc7-bb7e-190dd20549af" returned: 0 in 0.644s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bb8942a2-88b3-4431-b955-f57b30d8073c tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b.bc5c1e00-370e-4cc7-bb7e-190dd20549af {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:00 devstack sudo[108801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b.bc5c1e00-370e-4cc7-bb7e-190dd20549af Sep 10 16:59:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a6a3592-e229-4f4e-b969-e02651859470 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b0ce41d-6ada-4915-b258-283e13ff9f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-497167882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ed5d03b-a9dc-4dbd-8556-f0d4ce6cd698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83eb3afc5ee5439bb2b9b5a142ae00c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:59:01Z,use_quota=True,user_id='26a94e4aa8894307aa8c1ca59b9e1250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:00 devstack sudo[108801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a6a3592-e229-4f4e-b969-e02651859470 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (263497b5-aadc-497f-98d7-e084a159b4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a6a3592-e229-4f4e-b969-e02651859470 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (263497b5-aadc-497f-98d7-e084a159b4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a6a3592-e229-4f4e-b969-e02651859470 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (555c46ea-802a-42a8-a227-6710f136072f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a6a3592-e229-4f4e-b969-e02651859470 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (555c46ea-802a-42a8-a227-6710f136072f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ed5d03b-a9dc-4dbd-8556-f0d4ce6cd698', 'volume_name': 'volume-8ed5d03b-a9dc-4dbd-8556-f0d4ce6cd698', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a6a3592-e229-4f4e-b969-e02651859470 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8418af03-305c-4779-9854-762b685477af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a6a3592-e229-4f4e-b969-e02651859470 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8418af03-305c-4779-9854-762b685477af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:00 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a6a3592-e229-4f4e-b969-e02651859470 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (068e2e60-5a1f-44c9-ad8e-830ae66ddf94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:00 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-8a6a3592-e229-4f4e-b969-e02651859470 tempest-ProjectReaderTests-149416441 None] Volume 8ed5d03b-a9dc-4dbd-8556-f0d4ce6cd698: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ed5d03b-a9dc-4dbd-8556-f0d4ce6cd698', 'volume_size': 1} Sep 10 16:59:00 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8a6a3592-e229-4f4e-b969-e02651859470 tempest-ProjectReaderTests-149416441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:00 devstack sudo[108798]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-953b297d-330f-4842-87e2-37f9f71e6805 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195.info" returned: 0 in 0.316s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-953b297d-330f-4842-87e2-37f9f71e6805 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.601s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8a6a3592-e229-4f4e-b969-e02651859470 tempest-ProjectReaderTests-149416441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.098s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:01 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8a6a3592-e229-4f4e-b969-e02651859470 tempest-ProjectReaderTests-149416441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-497167882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ed5d03b-a9dc-4dbd-8556-f0d4ce6cd698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83eb3afc5ee5439bb2b9b5a142ae00c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:59:01Z,use_quota=True,user_id='26a94e4aa8894307aa8c1ca59b9e1250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:59:01 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-8a6a3592-e229-4f4e-b969-e02651859470 tempest-ProjectReaderTests-149416441 None] Creating volume 8ed5d03b-a9dc-4dbd-8556-f0d4ce6cd698 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:59:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8a6a3592-e229-4f4e-b969-e02651859470 tempest-ProjectReaderTests-149416441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8a6a3592-e229-4f4e-b969-e02651859470 tempest-ProjectReaderTests-149416441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:01 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8a6a3592-e229-4f4e-b969-e02651859470 tempest-ProjectReaderTests-149416441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:59:01 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8a6a3592-e229-4f4e-b969-e02651859470 tempest-ProjectReaderTests-149416441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:59:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8a6a3592-e229-4f4e-b969-e02651859470 tempest-ProjectReaderTests-149416441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:01 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8a6a3592-e229-4f4e-b969-e02651859470 tempest-ProjectReaderTests-149416441 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:59:01 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-8a6a3592-e229-4f4e-b969-e02651859470 tempest-ProjectReaderTests-149416441 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:59:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8a6a3592-e229-4f4e-b969-e02651859470 tempest-ProjectReaderTests-149416441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ed5d03b-a9dc-4dbd-8556-f0d4ce6cd698 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:01 devstack sudo[108804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ed5d03b-a9dc-4dbd-8556-f0d4ce6cd698 1073741824 Sep 10 16:59:01 devstack sudo[108804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:01 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-953b297d-330f-4842-87e2-37f9f71e6805 tempest-ProjectMemberTests-1654965068 None] Create snapshot completed successfully Sep 10 16:59:01 devstack sudo[108801]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bb8942a2-88b3-4431-b955-f57b30d8073c tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b.bc5c1e00-370e-4cc7-bb7e-190dd20549af" returned: 0 in 0.299s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:01 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bb8942a2-88b3-4431-b955-f57b30d8073c tempest-ProjectReaderTests-2110561421 None] Lock "cinder-quobyte-bc5c1e00-370e-4cc7-bb7e-190dd20549af" released by "_delete_snapshot" :: held 1.974s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:01 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bb8942a2-88b3-4431-b955-f57b30d8073c tempest-ProjectReaderTests-2110561421 None] Lock "cinder-quobyte-57359c11-93f4-4789-b654-5c282b7f944b" released by "delete_snapshot" :: held 2.017s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:01 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-bb8942a2-88b3-4431-b955-f57b30d8073c tempest-ProjectReaderTests-2110561421 None] Created reservations ['9442d13a-f497-4010-a761-a58b3a9bf826', 'b4310598-ad84-4fc1-9983-998abb348c36', '12671b3a-fc89-4e5a-9637-7ae89433ec19', '6f021390-3ed4-42bf-9171-4709c2c1b450'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:59:01 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-bb8942a2-88b3-4431-b955-f57b30d8073c tempest-ProjectReaderTests-2110561421 None] Delete snapshot completed successfully. Sep 10 16:59:01 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bb8942a2-88b3-4431-b955-f57b30d8073c tempest-ProjectReaderTests-2110561421 None] Lock "cinder-bc5c1e00-370e-4cc7-bb7e-190dd20549af-delete_snapshot" released by "delete_snapshot" :: held 2.216s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:01 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-138d2e1c-0326-4249-ad80-282c1ac3b05c tempest-ProjectReaderTests-2110561421 None] Acquiring lock "cinder-57359c11-93f4-4789-b654-5c282b7f944b-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:01 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-138d2e1c-0326-4249-ad80-282c1ac3b05c tempest-ProjectReaderTests-2110561421 None] Lock "cinder-57359c11-93f4-4789-b654-5c282b7f944b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:01 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-138d2e1c-0326-4249-ad80-282c1ac3b05c tempest-ProjectReaderTests-2110561421 None] Acquiring lock "cinder-quobyte-57359c11-93f4-4789-b654-5c282b7f944b" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:01 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-138d2e1c-0326-4249-ad80-282c1ac3b05c tempest-ProjectReaderTests-2110561421 None] Lock "cinder-quobyte-57359c11-93f4-4789-b654-5c282b7f944b" acquired by "delete_volume" :: waited 0.016s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:01 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[075c902c-791c-49eb-b313-21563de14e96]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-138d2e1c-0326-4249-ad80-282c1ac3b05c tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:01 devstack sudo[108804]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8a6a3592-e229-4f4e-b969-e02651859470 tempest-ProjectReaderTests-149416441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ed5d03b-a9dc-4dbd-8556-f0d4ce6cd698 1073741824" returned: 0 in 0.586s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:01 devstack sudo[108811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b Sep 10 16:59:01 devstack sudo[108811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8a6a3592-e229-4f4e-b969-e02651859470 tempest-ProjectReaderTests-149416441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ed5d03b-a9dc-4dbd-8556-f0d4ce6cd698 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:01 devstack sudo[108813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ed5d03b-a9dc-4dbd-8556-f0d4ce6cd698 Sep 10 16:59:01 devstack sudo[108813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:01 devstack sudo[108813]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-8a6a3592-e229-4f4e-b969-e02651859470 tempest-ProjectReaderTests-149416441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ed5d03b-a9dc-4dbd-8556-f0d4ce6cd698" returned: 0 in 0.261s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:01 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-8a6a3592-e229-4f4e-b969-e02651859470 tempest-ProjectReaderTests-149416441 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:59:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-8a6a3592-e229-4f4e-b969-e02651859470 tempest-ProjectReaderTests-149416441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a6a3592-e229-4f4e-b969-e02651859470 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (068e2e60-5a1f-44c9-ad8e-830ae66ddf94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ed5d03b-a9dc-4dbd-8556-f0d4ce6cd698', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a6a3592-e229-4f4e-b969-e02651859470 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (981c063c-b311-4aa3-81d5-8895d6bc1849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:01 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-8a6a3592-e229-4f4e-b969-e02651859470 tempest-ProjectReaderTests-149416441 None] Volume volume-8ed5d03b-a9dc-4dbd-8556-f0d4ce6cd698 (8ed5d03b-a9dc-4dbd-8556-f0d4ce6cd698): created successfully Sep 10 16:59:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a6a3592-e229-4f4e-b969-e02651859470 tempest-ProjectReaderTests-149416441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (981c063c-b311-4aa3-81d5-8895d6bc1849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:01 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-8a6a3592-e229-4f4e-b969-e02651859470 tempest-ProjectReaderTests-149416441 None] Flow 'volume_create_manager' (0608a51b-ba9d-4f8a-a4f5-28d77be9e63a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:59:01 devstack sudo[108811]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-138d2e1c-0326-4249-ad80-282c1ac3b05c tempest-ProjectReaderTests-2110561421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b" returned: 0 in 0.458s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:01 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-138d2e1c-0326-4249-ad80-282c1ac3b05c tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:02 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-8a6a3592-e229-4f4e-b969-e02651859470 tempest-ProjectReaderTests-149416441 None] Created volume successfully. Sep 10 16:59:02 devstack sudo[108820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b Sep 10 16:59:02 devstack sudo[108820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6d6f6572-519f-4dca-a121-aa9bb78542f9 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-805ebac6-4023-426c-afbe-86b96f1294e8-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6d6f6572-519f-4dca-a121-aa9bb78542f9 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-805ebac6-4023-426c-afbe-86b96f1294e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6d6f6572-519f-4dca-a121-aa9bb78542f9 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-quobyte-e9b55fce-e454-4373-b5ef-da23f7da1195" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:02 devstack sudo[108820]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-138d2e1c-0326-4249-ad80-282c1ac3b05c tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-57359c11-93f4-4789-b654-5c282b7f944b" returned: 0 in 0.275s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-138d2e1c-0326-4249-ad80-282c1ac3b05c tempest-ProjectReaderTests-2110561421 None] Lock "cinder-quobyte-57359c11-93f4-4789-b654-5c282b7f944b" released by "delete_volume" :: held 0.810s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6d6f6572-519f-4dca-a121-aa9bb78542f9 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-e9b55fce-e454-4373-b5ef-da23f7da1195" acquired by "delete_snapshot" :: waited 0.040s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6d6f6572-519f-4dca-a121-aa9bb78542f9 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-quobyte-805ebac6-4023-426c-afbe-86b96f1294e8" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:02 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6d6f6572-519f-4dca-a121-aa9bb78542f9 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-805ebac6-4023-426c-afbe-86b96f1294e8" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:02 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-6d6f6572-519f-4dca-a121-aa9bb78542f9 tempest-ProjectMemberTests-1654965068 None] Deleting offline snapshot 805ebac6-4023-426c-afbe-86b96f1294e8 of volume e9b55fce-e454-4373-b5ef-da23f7da1195 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:59:02 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-6d6f6572-519f-4dca-a121-aa9bb78542f9 tempest-ProjectMemberTests-1654965068 None] snapshot_file for this snap is: volume-e9b55fce-e454-4373-b5ef-da23f7da1195.805ebac6-4023-426c-afbe-86b96f1294e8 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:59:02 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ff9053-1ae9-454c-9678-212a7dda6ab4]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6d6f6572-519f-4dca-a121-aa9bb78542f9 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195.805ebac6-4023-426c-afbe-86b96f1294e8 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:02 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-138d2e1c-0326-4249-ad80-282c1ac3b05c tempest-ProjectReaderTests-2110561421 None] Created reservations ['fec1b823-95bd-4ab1-b476-b31e6ca56a42', 'bcd1fdbd-9d25-4110-988a-a2b8e2b2ff45', 'b3eb796d-1f72-493f-a926-eaaa7bac6055', 'e5c49467-50fa-4e43-8c01-bcbb06add025'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:59:02 devstack sudo[108824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195.805ebac6-4023-426c-afbe-86b96f1294e8 Sep 10 16:59:02 devstack sudo[108824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-138d2e1c-0326-4249-ad80-282c1ac3b05c tempest-ProjectReaderTests-2110561421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-138d2e1c-0326-4249-ad80-282c1ac3b05c tempest-ProjectReaderTests-2110561421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:02 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-138d2e1c-0326-4249-ad80-282c1ac3b05c tempest-ProjectReaderTests-2110561421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:59:02 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-138d2e1c-0326-4249-ad80-282c1ac3b05c tempest-ProjectReaderTests-2110561421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:59:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-138d2e1c-0326-4249-ad80-282c1ac3b05c tempest-ProjectReaderTests-2110561421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-138d2e1c-0326-4249-ad80-282c1ac3b05c tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:02 devstack sudo[108826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:59:02 devstack sudo[108826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:02 devstack sudo[108826]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:02 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-138d2e1c-0326-4249-ad80-282c1ac3b05c tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.328s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:02 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-138d2e1c-0326-4249-ad80-282c1ac3b05c tempest-ProjectReaderTests-2110561421 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:59:02 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-138d2e1c-0326-4249-ad80-282c1ac3b05c tempest-ProjectReaderTests-2110561421 None] Deleted volume successfully. Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-138d2e1c-0326-4249-ad80-282c1ac3b05c tempest-ProjectReaderTests-2110561421 None] Lock "cinder-57359c11-93f4-4789-b654-5c282b7f944b-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:03 devstack sudo[108824]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6d6f6572-519f-4dca-a121-aa9bb78542f9 tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195.805ebac6-4023-426c-afbe-86b96f1294e8" returned: 0 in 0.632s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-6d6f6572-519f-4dca-a121-aa9bb78542f9 tempest-ProjectMemberTests-1654965068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9b55fce-e454-4373-b5ef-da23f7da1195(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab285bd-cba1-4d4f-b0d4-c27f803abe0d]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6d6f6572-519f-4dca-a121-aa9bb78542f9 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-e64dbd2d-238c-45ad-9c58-82e7450d4fe8 tempest-ProjectReaderTests-149416441 None] Acquiring lock "cinder-8ed5d03b-a9dc-4dbd-8556-f0d4ce6cd698-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-e64dbd2d-238c-45ad-9c58-82e7450d4fe8 tempest-ProjectReaderTests-149416441 None] Lock "cinder-8ed5d03b-a9dc-4dbd-8556-f0d4ce6cd698-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-e64dbd2d-238c-45ad-9c58-82e7450d4fe8 tempest-ProjectReaderTests-149416441 None] Acquiring lock "cinder-quobyte-8ed5d03b-a9dc-4dbd-8556-f0d4ce6cd698" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-5be6c283-21ed-446a-9a93-a82883ccfd64 tempest-ProjectReaderTests-2110561421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5be6c283-21ed-446a-9a93-a82883ccfd64 tempest-ProjectReaderTests-2110561421 None] Flow 'volume_create_manager' (1282aa30-71ec-461b-a01b-1506e368e304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5be6c283-21ed-446a-9a93-a82883ccfd64 tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a30c7567-f37b-4216-976d-cb4370079de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-e64dbd2d-238c-45ad-9c58-82e7450d4fe8 tempest-ProjectReaderTests-149416441 None] Lock "cinder-quobyte-8ed5d03b-a9dc-4dbd-8556-f0d4ce6cd698" acquired by "delete_volume" :: waited 0.069s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:03 devstack sudo[108832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195 Sep 10 16:59:03 devstack sudo[108832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5be6c283-21ed-446a-9a93-a82883ccfd64 tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a30c7567-f37b-4216-976d-cb4370079de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1547885288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae4e144-65f2-47cf-b199-fcda2d1c403d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfe575cf67994730b27c40255f732200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:59:03Z,use_quota=True,user_id='767a2dafef0c46a7b707405a09806384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5be6c283-21ed-446a-9a93-a82883ccfd64 tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (870606c2-ef85-4d1d-ad35-e6646f2de066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5be6c283-21ed-446a-9a93-a82883ccfd64 tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (870606c2-ef85-4d1d-ad35-e6646f2de066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5be6c283-21ed-446a-9a93-a82883ccfd64 tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1917b2f0-5904-4ae5-b8fe-e857cff1c738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5be6c283-21ed-446a-9a93-a82883ccfd64 tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1917b2f0-5904-4ae5-b8fe-e857cff1c738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bae4e144-65f2-47cf-b199-fcda2d1c403d', 'volume_name': 'volume-bae4e144-65f2-47cf-b199-fcda2d1c403d', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5be6c283-21ed-446a-9a93-a82883ccfd64 tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66d10f5c-19b9-40d5-96ac-44d91a3f7e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5be6c283-21ed-446a-9a93-a82883ccfd64 tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66d10f5c-19b9-40d5-96ac-44d91a3f7e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5be6c283-21ed-446a-9a93-a82883ccfd64 tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c5014be-9297-4122-83b9-5863ab7e8f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:03 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-5be6c283-21ed-446a-9a93-a82883ccfd64 tempest-ProjectReaderTests-2110561421 None] Volume bae4e144-65f2-47cf-b199-fcda2d1c403d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bae4e144-65f2-47cf-b199-fcda2d1c403d', 'volume_size': 1} Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5be6c283-21ed-446a-9a93-a82883ccfd64 tempest-ProjectReaderTests-2110561421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5be6c283-21ed-446a-9a93-a82883ccfd64 tempest-ProjectReaderTests-2110561421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-5be6c283-21ed-446a-9a93-a82883ccfd64 tempest-ProjectReaderTests-2110561421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1547885288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae4e144-65f2-47cf-b199-fcda2d1c403d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfe575cf67994730b27c40255f732200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:59:03Z,use_quota=True,user_id='767a2dafef0c46a7b707405a09806384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-5be6c283-21ed-446a-9a93-a82883ccfd64 tempest-ProjectReaderTests-2110561421 None] Creating volume bae4e144-65f2-47cf-b199-fcda2d1c403d {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5be6c283-21ed-446a-9a93-a82883ccfd64 tempest-ProjectReaderTests-2110561421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5be6c283-21ed-446a-9a93-a82883ccfd64 tempest-ProjectReaderTests-2110561421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-5be6c283-21ed-446a-9a93-a82883ccfd64 tempest-ProjectReaderTests-2110561421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-5be6c283-21ed-446a-9a93-a82883ccfd64 tempest-ProjectReaderTests-2110561421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5be6c283-21ed-446a-9a93-a82883ccfd64 tempest-ProjectReaderTests-2110561421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-5be6c283-21ed-446a-9a93-a82883ccfd64 tempest-ProjectReaderTests-2110561421 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:59:03 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-5be6c283-21ed-446a-9a93-a82883ccfd64 tempest-ProjectReaderTests-2110561421 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5be6c283-21ed-446a-9a93-a82883ccfd64 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[252db241-9ddf-463f-b5f5-3f8ba3dbc76e]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e64dbd2d-238c-45ad-9c58-82e7450d4fe8 tempest-ProjectReaderTests-149416441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ed5d03b-a9dc-4dbd-8556-f0d4ce6cd698 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:03 devstack sudo[108834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d 1073741824 Sep 10 16:59:03 devstack sudo[108834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:03 devstack sudo[108835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ed5d03b-a9dc-4dbd-8556-f0d4ce6cd698 Sep 10 16:59:03 devstack sudo[108835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:03 devstack sudo[108832]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6d6f6572-519f-4dca-a121-aa9bb78542f9 tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195" returned: 0 in 0.571s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6d6f6572-519f-4dca-a121-aa9bb78542f9 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195.805ebac6-4023-426c-afbe-86b96f1294e8 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:03 devstack sudo[108842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195.805ebac6-4023-426c-afbe-86b96f1294e8 Sep 10 16:59:03 devstack sudo[108842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:03 devstack sudo[108835]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e64dbd2d-238c-45ad-9c58-82e7450d4fe8 tempest-ProjectReaderTests-149416441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ed5d03b-a9dc-4dbd-8556-f0d4ce6cd698" returned: 0 in 0.476s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e64dbd2d-238c-45ad-9c58-82e7450d4fe8 tempest-ProjectReaderTests-149416441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ed5d03b-a9dc-4dbd-8556-f0d4ce6cd698 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:03 devstack sudo[108834]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5be6c283-21ed-446a-9a93-a82883ccfd64 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d 1073741824" returned: 0 in 0.527s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:03 devstack sudo[108851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ed5d03b-a9dc-4dbd-8556-f0d4ce6cd698 Sep 10 16:59:03 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:03 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5be6c283-21ed-446a-9a93-a82883ccfd64 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:03 devstack sudo[108856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d Sep 10 16:59:03 devstack sudo[108856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:04 devstack sudo[108842]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6d6f6572-519f-4dca-a121-aa9bb78542f9 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195.805ebac6-4023-426c-afbe-86b96f1294e8" returned: 0 in 0.556s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6d6f6572-519f-4dca-a121-aa9bb78542f9 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195.805ebac6-4023-426c-afbe-86b96f1294e8 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:04 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:04 devstack sudo[108859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195.805ebac6-4023-426c-afbe-86b96f1294e8 Sep 10 16:59:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e64dbd2d-238c-45ad-9c58-82e7450d4fe8 tempest-ProjectReaderTests-149416441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8ed5d03b-a9dc-4dbd-8556-f0d4ce6cd698" returned: 0 in 0.369s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:04 devstack sudo[108859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:04 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-e64dbd2d-238c-45ad-9c58-82e7450d4fe8 tempest-ProjectReaderTests-149416441 None] Lock "cinder-quobyte-8ed5d03b-a9dc-4dbd-8556-f0d4ce6cd698" released by "delete_volume" :: held 0.979s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:04 devstack sudo[108856]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5be6c283-21ed-446a-9a93-a82883ccfd64 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d" returned: 0 in 0.361s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-5be6c283-21ed-446a-9a93-a82883ccfd64 tempest-ProjectReaderTests-2110561421 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:59:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-5be6c283-21ed-446a-9a93-a82883ccfd64 tempest-ProjectReaderTests-2110561421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:04 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5be6c283-21ed-446a-9a93-a82883ccfd64 tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c5014be-9297-4122-83b9-5863ab7e8f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bae4e144-65f2-47cf-b199-fcda2d1c403d', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:04 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5be6c283-21ed-446a-9a93-a82883ccfd64 tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e18c2d6-a40c-4afa-bf4f-a5038fdc4821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:04 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-5be6c283-21ed-446a-9a93-a82883ccfd64 tempest-ProjectReaderTests-2110561421 None] Volume volume-bae4e144-65f2-47cf-b199-fcda2d1c403d (bae4e144-65f2-47cf-b199-fcda2d1c403d): created successfully Sep 10 16:59:04 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5be6c283-21ed-446a-9a93-a82883ccfd64 tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e18c2d6-a40c-4afa-bf4f-a5038fdc4821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:04 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-5be6c283-21ed-446a-9a93-a82883ccfd64 tempest-ProjectReaderTests-2110561421 None] Flow 'volume_create_manager' (1282aa30-71ec-461b-a01b-1506e368e304) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:59:04 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-e64dbd2d-238c-45ad-9c58-82e7450d4fe8 tempest-ProjectReaderTests-149416441 None] Created reservations ['55a1a739-b26d-4460-973d-f4bfae8f8b05', '2a7300ca-8087-45ba-b0e4-767b21068bad', 'a0f49583-ecd4-46d6-9ce2-ac4b39674ab0', '81a16ef7-75f2-4f5f-90ab-babc4281a7e9'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:59:04 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-5be6c283-21ed-446a-9a93-a82883ccfd64 tempest-ProjectReaderTests-2110561421 None] Created volume successfully. Sep 10 16:59:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e64dbd2d-238c-45ad-9c58-82e7450d4fe8 tempest-ProjectReaderTests-149416441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e64dbd2d-238c-45ad-9c58-82e7450d4fe8 tempest-ProjectReaderTests-149416441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-e64dbd2d-238c-45ad-9c58-82e7450d4fe8 tempest-ProjectReaderTests-149416441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:59:04 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-e64dbd2d-238c-45ad-9c58-82e7450d4fe8 tempest-ProjectReaderTests-149416441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:59:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e64dbd2d-238c-45ad-9c58-82e7450d4fe8 tempest-ProjectReaderTests-149416441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e64dbd2d-238c-45ad-9c58-82e7450d4fe8 tempest-ProjectReaderTests-149416441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:04 devstack sudo[108863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:59:04 devstack sudo[108863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:04 devstack sudo[108859]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-6d6f6572-519f-4dca-a121-aa9bb78542f9 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195.805ebac6-4023-426c-afbe-86b96f1294e8" returned: 0 in 0.339s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:04 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6d6f6572-519f-4dca-a121-aa9bb78542f9 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-805ebac6-4023-426c-afbe-86b96f1294e8" released by "_delete_snapshot" :: held 2.249s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:04 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6d6f6572-519f-4dca-a121-aa9bb78542f9 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-e9b55fce-e454-4373-b5ef-da23f7da1195" released by "delete_snapshot" :: held 2.292s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:04 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-6d6f6572-519f-4dca-a121-aa9bb78542f9 tempest-ProjectMemberTests-1654965068 None] Created reservations ['28246f58-47f7-4f10-a0bc-d0fc12c8f9fc', '97616884-b70a-4513-9a14-3fdd3984120e', '9de532ae-888d-40b5-9e35-351b062db956', 'eabfa54b-78d7-4704-9dec-62952201e5b5'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:59:04 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-6d6f6572-519f-4dca-a121-aa9bb78542f9 tempest-ProjectMemberTests-1654965068 None] Delete snapshot completed successfully. Sep 10 16:59:04 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-6d6f6572-519f-4dca-a121-aa9bb78542f9 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-805ebac6-4023-426c-afbe-86b96f1294e8-delete_snapshot" released by "delete_snapshot" :: held 2.461s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:04 devstack sudo[108863]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:04 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e64dbd2d-238c-45ad-9c58-82e7450d4fe8 tempest-ProjectReaderTests-149416441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.273s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:04 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-e64dbd2d-238c-45ad-9c58-82e7450d4fe8 tempest-ProjectReaderTests-149416441 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:59:04 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-e64dbd2d-238c-45ad-9c58-82e7450d4fe8 tempest-ProjectReaderTests-149416441 None] Deleted volume successfully. Sep 10 16:59:04 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-e64dbd2d-238c-45ad-9c58-82e7450d4fe8 tempest-ProjectReaderTests-149416441 None] Lock "cinder-8ed5d03b-a9dc-4dbd-8556-f0d4ce6cd698-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ddeea35b-9863-44ac-88eb-0a0ff40eda67 tempest-ProjectReaderTests-2110561421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ddeea35b-9863-44ac-88eb-0a0ff40eda67 tempest-ProjectReaderTests-2110561421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:05 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4c2d02d8-c441-4023-b195-d40950c15c7f tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-e9b55fce-e454-4373-b5ef-da23f7da1195-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:05 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-ddeea35b-9863-44ac-88eb-0a0ff40eda67 tempest-ProjectReaderTests-2110561421 None] Creating offline snapshot d2096690-6ec8-4c6a-b728-5b1663875d30 of volume bae4e144-65f2-47cf-b199-fcda2d1c403d {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:59:05 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4c2d02d8-c441-4023-b195-d40950c15c7f tempest-ProjectMemberTests-1654965068 None] Lock "cinder-e9b55fce-e454-4373-b5ef-da23f7da1195-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:05 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e71169-0651-4ef2-a21b-6ed7e9d1538b]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ddeea35b-9863-44ac-88eb-0a0ff40eda67 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:05 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4c2d02d8-c441-4023-b195-d40950c15c7f tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-quobyte-e9b55fce-e454-4373-b5ef-da23f7da1195" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:05 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4c2d02d8-c441-4023-b195-d40950c15c7f tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-e9b55fce-e454-4373-b5ef-da23f7da1195" acquired by "delete_volume" :: waited 0.024s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:05 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6115a7-e303-491a-b394-3ec7f9185a43]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4c2d02d8-c441-4023-b195-d40950c15c7f tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:05 devstack sudo[108866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d Sep 10 16:59:05 devstack sudo[108866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:05 devstack sudo[108867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195 Sep 10 16:59:05 devstack sudo[108867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:05 devstack sudo[108866]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ddeea35b-9863-44ac-88eb-0a0ff40eda67 tempest-ProjectReaderTests-2110561421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d" returned: 0 in 0.418s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:05 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ddeea35b-9863-44ac-88eb-0a0ff40eda67 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d.d2096690-6ec8-4c6a-b728-5b1663875d30 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:06 devstack sudo[108873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d.d2096690-6ec8-4c6a-b728-5b1663875d30 1G Sep 10 16:59:06 devstack sudo[108873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:06 devstack sudo[108867]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4c2d02d8-c441-4023-b195-d40950c15c7f tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195" returned: 0 in 0.420s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4c2d02d8-c441-4023-b195-d40950c15c7f tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:06 devstack sudo[108878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195 Sep 10 16:59:06 devstack sudo[108878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:06 devstack sudo[108878]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4c2d02d8-c441-4023-b195-d40950c15c7f tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-e9b55fce-e454-4373-b5ef-da23f7da1195" returned: 0 in 0.272s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:06 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4c2d02d8-c441-4023-b195-d40950c15c7f tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-e9b55fce-e454-4373-b5ef-da23f7da1195" released by "delete_volume" :: held 0.769s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:06 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-4c2d02d8-c441-4023-b195-d40950c15c7f tempest-ProjectMemberTests-1654965068 None] Created reservations ['131c3212-39e5-4297-b421-0e2004906930', '7bf62cec-e4ad-45b7-a622-12fc74fcb405', 'e5ae1e02-0edb-48f2-b1ac-36316a51a91a', '020f935a-939a-4753-9bd6-6e2f69191e03'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:59:06 devstack sudo[108873]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ddeea35b-9863-44ac-88eb-0a0ff40eda67 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d.d2096690-6ec8-4c6a-b728-5b1663875d30 1G" returned: 0 in 0.487s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ddeea35b-9863-44ac-88eb-0a0ff40eda67 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae4e144-65f2-47cf-b199-fcda2d1c403d -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d.d2096690-6ec8-4c6a-b728-5b1663875d30 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:06 devstack sudo[108885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae4e144-65f2-47cf-b199-fcda2d1c403d -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d.d2096690-6ec8-4c6a-b728-5b1663875d30 Sep 10 16:59:06 devstack sudo[108885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4c2d02d8-c441-4023-b195-d40950c15c7f tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4c2d02d8-c441-4023-b195-d40950c15c7f tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:06 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-4c2d02d8-c441-4023-b195-d40950c15c7f tempest-ProjectMemberTests-1654965068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:59:06 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-4c2d02d8-c441-4023-b195-d40950c15c7f tempest-ProjectMemberTests-1654965068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:59:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4c2d02d8-c441-4023-b195-d40950c15c7f tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4c2d02d8-c441-4023-b195-d40950c15c7f tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:06 devstack sudo[108887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:59:06 devstack sudo[108887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:06 devstack sudo[108885]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ddeea35b-9863-44ac-88eb-0a0ff40eda67 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae4e144-65f2-47cf-b199-fcda2d1c403d -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d.d2096690-6ec8-4c6a-b728-5b1663875d30" returned: 0 in 0.416s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:06 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-ddeea35b-9863-44ac-88eb-0a0ff40eda67 tempest-ProjectReaderTests-2110561421 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d.d2096690-6ec8-4c6a-b728-5b1663875d30 is being set with open permissions: ugo+rw Sep 10 16:59:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ddeea35b-9863-44ac-88eb-0a0ff40eda67 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d.d2096690-6ec8-4c6a-b728-5b1663875d30 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:06 devstack sudo[108887]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:06 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4c2d02d8-c441-4023-b195-d40950c15c7f tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.322s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:06 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-4c2d02d8-c441-4023-b195-d40950c15c7f tempest-ProjectMemberTests-1654965068 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:59:06 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-4c2d02d8-c441-4023-b195-d40950c15c7f tempest-ProjectMemberTests-1654965068 None] Deleted volume successfully. Sep 10 16:59:06 devstack sudo[108893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d.d2096690-6ec8-4c6a-b728-5b1663875d30 Sep 10 16:59:06 devstack sudo[108893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:06 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4c2d02d8-c441-4023-b195-d40950c15c7f tempest-ProjectMemberTests-1654965068 None] Lock "cinder-e9b55fce-e454-4373-b5ef-da23f7da1195-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:07 devstack sudo[108893]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ddeea35b-9863-44ac-88eb-0a0ff40eda67 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d.d2096690-6ec8-4c6a-b728-5b1663875d30" returned: 0 in 0.300s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ddeea35b-9863-44ac-88eb-0a0ff40eda67 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:07 devstack sudo[108896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d.info Sep 10 16:59:07 devstack sudo[108896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:07 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-931e4b6e-a252-47cd-a066-9493e5ad21e0 tempest-ProjectMemberTests-1654965068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:59:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-931e4b6e-a252-47cd-a066-9493e5ad21e0 tempest-ProjectMemberTests-1654965068 None] Flow 'volume_create_manager' (1fbb3788-01bd-4688-8512-213d7cfe33c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:59:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-931e4b6e-a252-47cd-a066-9493e5ad21e0 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85c2041e-430b-4d07-beb7-013ada3cf773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-931e4b6e-a252-47cd-a066-9493e5ad21e0 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85c2041e-430b-4d07-beb7-013ada3cf773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1540151567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4089e086-e123-4315-bd4d-990f94867ca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fdc4b0dbad645d8bc3672158e8e45da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:59:07Z,use_quota=True,user_id='4d7a8be540c54a1e9a03d51feae99641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-931e4b6e-a252-47cd-a066-9493e5ad21e0 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f941af87-ea0d-405f-a8a8-16bcc3c51060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-931e4b6e-a252-47cd-a066-9493e5ad21e0 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f941af87-ea0d-405f-a8a8-16bcc3c51060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-931e4b6e-a252-47cd-a066-9493e5ad21e0 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68178691-825f-4753-a3a3-e75f31fabb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-931e4b6e-a252-47cd-a066-9493e5ad21e0 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68178691-825f-4753-a3a3-e75f31fabb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4089e086-e123-4315-bd4d-990f94867ca3', 'volume_name': 'volume-4089e086-e123-4315-bd4d-990f94867ca3', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-931e4b6e-a252-47cd-a066-9493e5ad21e0 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae888fca-8afd-4269-8d36-6e899454d2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-931e4b6e-a252-47cd-a066-9493e5ad21e0 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae888fca-8afd-4269-8d36-6e899454d2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:07 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-931e4b6e-a252-47cd-a066-9493e5ad21e0 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d17aac6e-ef17-4de3-b1fb-220ef3d4cd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:07 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-931e4b6e-a252-47cd-a066-9493e5ad21e0 tempest-ProjectMemberTests-1654965068 None] Volume 4089e086-e123-4315-bd4d-990f94867ca3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4089e086-e123-4315-bd4d-990f94867ca3', 'volume_size': 1} Sep 10 16:59:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-931e4b6e-a252-47cd-a066-9493e5ad21e0 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:07 devstack sudo[108896]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ddeea35b-9863-44ac-88eb-0a0ff40eda67 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d.info" returned: 0 in 0.283s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:07 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-ddeea35b-9863-44ac-88eb-0a0ff40eda67 tempest-ProjectReaderTests-2110561421 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d.info is being set with open permissions: ugo+rw Sep 10 16:59:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ddeea35b-9863-44ac-88eb-0a0ff40eda67 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:07 devstack sudo[108899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d.info Sep 10 16:59:07 devstack sudo[108899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:07 devstack sudo[108899]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ddeea35b-9863-44ac-88eb-0a0ff40eda67 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d.info" returned: 0 in 0.254s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ddeea35b-9863-44ac-88eb-0a0ff40eda67 tempest-ProjectReaderTests-2110561421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.266s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-931e4b6e-a252-47cd-a066-9493e5ad21e0 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.399s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:07 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-931e4b6e-a252-47cd-a066-9493e5ad21e0 tempest-ProjectMemberTests-1654965068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1540151567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4089e086-e123-4315-bd4d-990f94867ca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fdc4b0dbad645d8bc3672158e8e45da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:59:07Z,use_quota=True,user_id='4d7a8be540c54a1e9a03d51feae99641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:59:07 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-931e4b6e-a252-47cd-a066-9493e5ad21e0 tempest-ProjectMemberTests-1654965068 None] Creating volume 4089e086-e123-4315-bd4d-990f94867ca3 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:59:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-931e4b6e-a252-47cd-a066-9493e5ad21e0 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-931e4b6e-a252-47cd-a066-9493e5ad21e0 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:07 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-931e4b6e-a252-47cd-a066-9493e5ad21e0 tempest-ProjectMemberTests-1654965068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:59:07 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-931e4b6e-a252-47cd-a066-9493e5ad21e0 tempest-ProjectMemberTests-1654965068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:59:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-931e4b6e-a252-47cd-a066-9493e5ad21e0 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:07 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-931e4b6e-a252-47cd-a066-9493e5ad21e0 tempest-ProjectMemberTests-1654965068 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:59:07 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-931e4b6e-a252-47cd-a066-9493e5ad21e0 tempest-ProjectMemberTests-1654965068 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:59:07 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-931e4b6e-a252-47cd-a066-9493e5ad21e0 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:07 devstack sudo[108902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3 1073741824 Sep 10 16:59:07 devstack sudo[108902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:07 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-ddeea35b-9863-44ac-88eb-0a0ff40eda67 tempest-ProjectReaderTests-2110561421 None] Create snapshot completed successfully Sep 10 16:59:08 devstack sudo[108902]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-931e4b6e-a252-47cd-a066-9493e5ad21e0 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3 1073741824" returned: 0 in 0.423s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-931e4b6e-a252-47cd-a066-9493e5ad21e0 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:08 devstack sudo[108907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3 Sep 10 16:59:08 devstack sudo[108907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:08 devstack sudo[108907]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-931e4b6e-a252-47cd-a066-9493e5ad21e0 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3" returned: 0 in 0.254s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:08 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-931e4b6e-a252-47cd-a066-9493e5ad21e0 tempest-ProjectMemberTests-1654965068 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:59:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-931e4b6e-a252-47cd-a066-9493e5ad21e0 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-931e4b6e-a252-47cd-a066-9493e5ad21e0 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d17aac6e-ef17-4de3-b1fb-220ef3d4cd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4089e086-e123-4315-bd4d-990f94867ca3', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-931e4b6e-a252-47cd-a066-9493e5ad21e0 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b34bd90b-45bd-4d16-9124-fa3b715718c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:08 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-931e4b6e-a252-47cd-a066-9493e5ad21e0 tempest-ProjectMemberTests-1654965068 None] Volume volume-4089e086-e123-4315-bd4d-990f94867ca3 (4089e086-e123-4315-bd4d-990f94867ca3): created successfully Sep 10 16:59:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-931e4b6e-a252-47cd-a066-9493e5ad21e0 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b34bd90b-45bd-4d16-9124-fa3b715718c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:08 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-931e4b6e-a252-47cd-a066-9493e5ad21e0 tempest-ProjectMemberTests-1654965068 None] Flow 'volume_create_manager' (1fbb3788-01bd-4688-8512-213d7cfe33c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:59:08 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-931e4b6e-a252-47cd-a066-9493e5ad21e0 tempest-ProjectMemberTests-1654965068 None] Created volume successfully. Sep 10 16:59:08 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d635a5df-eb1e-406b-a5d1-a3a250ef8c63 tempest-ProjectReaderTests-2110561421 None] Acquiring lock "cinder-d2096690-6ec8-4c6a-b728-5b1663875d30-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:08 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d635a5df-eb1e-406b-a5d1-a3a250ef8c63 tempest-ProjectReaderTests-2110561421 None] Lock "cinder-d2096690-6ec8-4c6a-b728-5b1663875d30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:08 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d635a5df-eb1e-406b-a5d1-a3a250ef8c63 tempest-ProjectReaderTests-2110561421 None] Acquiring lock "cinder-quobyte-bae4e144-65f2-47cf-b199-fcda2d1c403d" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:08 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d635a5df-eb1e-406b-a5d1-a3a250ef8c63 tempest-ProjectReaderTests-2110561421 None] Lock "cinder-quobyte-bae4e144-65f2-47cf-b199-fcda2d1c403d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:08 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d635a5df-eb1e-406b-a5d1-a3a250ef8c63 tempest-ProjectReaderTests-2110561421 None] Acquiring lock "cinder-quobyte-d2096690-6ec8-4c6a-b728-5b1663875d30" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:08 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d635a5df-eb1e-406b-a5d1-a3a250ef8c63 tempest-ProjectReaderTests-2110561421 None] Lock "cinder-quobyte-d2096690-6ec8-4c6a-b728-5b1663875d30" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:08 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-d635a5df-eb1e-406b-a5d1-a3a250ef8c63 tempest-ProjectReaderTests-2110561421 None] Deleting offline snapshot d2096690-6ec8-4c6a-b728-5b1663875d30 of volume bae4e144-65f2-47cf-b199-fcda2d1c403d {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:59:08 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-d635a5df-eb1e-406b-a5d1-a3a250ef8c63 tempest-ProjectReaderTests-2110561421 None] snapshot_file for this snap is: volume-bae4e144-65f2-47cf-b199-fcda2d1c403d.d2096690-6ec8-4c6a-b728-5b1663875d30 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:59:08 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26cddbb-97e4-4f24-972c-8045939ad8f3]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:08 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d635a5df-eb1e-406b-a5d1-a3a250ef8c63 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d.d2096690-6ec8-4c6a-b728-5b1663875d30 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:08 devstack sudo[108910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d.d2096690-6ec8-4c6a-b728-5b1663875d30 Sep 10 16:59:08 devstack sudo[108910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:09 devstack sudo[108910]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d635a5df-eb1e-406b-a5d1-a3a250ef8c63 tempest-ProjectReaderTests-2110561421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d.d2096690-6ec8-4c6a-b728-5b1663875d30" returned: 0 in 0.365s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:09 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-d635a5df-eb1e-406b-a5d1-a3a250ef8c63 tempest-ProjectReaderTests-2110561421 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bae4e144-65f2-47cf-b199-fcda2d1c403d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:59:09 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[773535de-de3c-44c4-ab95-84de318311e9]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d635a5df-eb1e-406b-a5d1-a3a250ef8c63 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:09 devstack sudo[108916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d Sep 10 16:59:09 devstack sudo[108916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-cda72713-7fb9-4f07-9819-1ff98654b319 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-cda72713-7fb9-4f07-9819-1ff98654b319 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:09 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-cda72713-7fb9-4f07-9819-1ff98654b319 tempest-ProjectMemberTests-1654965068 None] Creating offline snapshot f69b9458-2082-481c-8c35-d74a7d5508f0 of volume 4089e086-e123-4315-bd4d-990f94867ca3 {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:59:09 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[abac9f01-640c-43c4-aaa5-ff0358c19c2e]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cda72713-7fb9-4f07-9819-1ff98654b319 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:09 devstack sudo[108916]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d635a5df-eb1e-406b-a5d1-a3a250ef8c63 tempest-ProjectReaderTests-2110561421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d" returned: 0 in 0.401s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d635a5df-eb1e-406b-a5d1-a3a250ef8c63 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d.d2096690-6ec8-4c6a-b728-5b1663875d30 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:09 devstack sudo[108923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d.d2096690-6ec8-4c6a-b728-5b1663875d30 Sep 10 16:59:09 devstack sudo[108923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:09 devstack sudo[108922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3 Sep 10 16:59:09 devstack sudo[108922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:09 devstack sudo[108922]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cda72713-7fb9-4f07-9819-1ff98654b319 tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3" returned: 0 in 0.378s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cda72713-7fb9-4f07-9819-1ff98654b319 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3.f69b9458-2082-481c-8c35-d74a7d5508f0 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:09 devstack sudo[108923]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d635a5df-eb1e-406b-a5d1-a3a250ef8c63 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d.d2096690-6ec8-4c6a-b728-5b1663875d30" returned: 0 in 0.362s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:09 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d635a5df-eb1e-406b-a5d1-a3a250ef8c63 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d.d2096690-6ec8-4c6a-b728-5b1663875d30 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:09 devstack sudo[108932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3.f69b9458-2082-481c-8c35-d74a7d5508f0 1G Sep 10 16:59:09 devstack sudo[108932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:09 devstack sudo[108933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d.d2096690-6ec8-4c6a-b728-5b1663875d30 Sep 10 16:59:09 devstack sudo[108933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:10 devstack sudo[108933]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d635a5df-eb1e-406b-a5d1-a3a250ef8c63 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d.d2096690-6ec8-4c6a-b728-5b1663875d30" returned: 0 in 0.254s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:10 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d635a5df-eb1e-406b-a5d1-a3a250ef8c63 tempest-ProjectReaderTests-2110561421 None] Lock "cinder-quobyte-d2096690-6ec8-4c6a-b728-5b1663875d30" released by "_delete_snapshot" :: held 1.472s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:10 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d635a5df-eb1e-406b-a5d1-a3a250ef8c63 tempest-ProjectReaderTests-2110561421 None] Lock "cinder-quobyte-bae4e144-65f2-47cf-b199-fcda2d1c403d" released by "delete_snapshot" :: held 1.498s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:10 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-d635a5df-eb1e-406b-a5d1-a3a250ef8c63 tempest-ProjectReaderTests-2110561421 None] Created reservations ['c21d7230-1f58-4010-a760-d174b1fab4e4', '9f6a8ae4-66da-4c2d-bae3-6d206cb2e761', '96522aef-3406-4224-a88b-2136ce4031a5', 'e872dc93-0983-421a-986b-cc9ec0ded444'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:59:10 devstack sudo[108932]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cda72713-7fb9-4f07-9819-1ff98654b319 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3.f69b9458-2082-481c-8c35-d74a7d5508f0 1G" returned: 0 in 0.413s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cda72713-7fb9-4f07-9819-1ff98654b319 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4089e086-e123-4315-bd4d-990f94867ca3 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3.f69b9458-2082-481c-8c35-d74a7d5508f0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:10 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-d635a5df-eb1e-406b-a5d1-a3a250ef8c63 tempest-ProjectReaderTests-2110561421 None] Delete snapshot completed successfully. Sep 10 16:59:10 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d635a5df-eb1e-406b-a5d1-a3a250ef8c63 tempest-ProjectReaderTests-2110561421 None] Lock "cinder-d2096690-6ec8-4c6a-b728-5b1663875d30-delete_snapshot" released by "delete_snapshot" :: held 1.649s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:10 devstack sudo[108940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4089e086-e123-4315-bd4d-990f94867ca3 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3.f69b9458-2082-481c-8c35-d74a7d5508f0 Sep 10 16:59:10 devstack sudo[108940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:10 devstack sudo[108940]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cda72713-7fb9-4f07-9819-1ff98654b319 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4089e086-e123-4315-bd4d-990f94867ca3 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3.f69b9458-2082-481c-8c35-d74a7d5508f0" returned: 0 in 0.292s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:10 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-cda72713-7fb9-4f07-9819-1ff98654b319 tempest-ProjectMemberTests-1654965068 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3.f69b9458-2082-481c-8c35-d74a7d5508f0 is being set with open permissions: ugo+rw Sep 10 16:59:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cda72713-7fb9-4f07-9819-1ff98654b319 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3.f69b9458-2082-481c-8c35-d74a7d5508f0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:10 devstack sudo[108945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3.f69b9458-2082-481c-8c35-d74a7d5508f0 Sep 10 16:59:10 devstack sudo[108945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:10 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d9cf83c5-4c64-4b66-83e1-1b41b961238e tempest-ProjectReaderTests-2110561421 None] Acquiring lock "cinder-bae4e144-65f2-47cf-b199-fcda2d1c403d-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:10 devstack sudo[108945]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cda72713-7fb9-4f07-9819-1ff98654b319 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3.f69b9458-2082-481c-8c35-d74a7d5508f0" returned: 0 in 0.251s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:10 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d9cf83c5-4c64-4b66-83e1-1b41b961238e tempest-ProjectReaderTests-2110561421 None] Lock "cinder-bae4e144-65f2-47cf-b199-fcda2d1c403d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cda72713-7fb9-4f07-9819-1ff98654b319 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:10 devstack sudo[108949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3.info Sep 10 16:59:10 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d9cf83c5-4c64-4b66-83e1-1b41b961238e tempest-ProjectReaderTests-2110561421 None] Acquiring lock "cinder-quobyte-bae4e144-65f2-47cf-b199-fcda2d1c403d" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:10 devstack sudo[108949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:10 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d9cf83c5-4c64-4b66-83e1-1b41b961238e tempest-ProjectReaderTests-2110561421 None] Lock "cinder-quobyte-bae4e144-65f2-47cf-b199-fcda2d1c403d" acquired by "delete_volume" :: waited 0.015s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:10 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[da48a815-64d0-455e-8509-88a0fcbd3b5a]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:10 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d9cf83c5-4c64-4b66-83e1-1b41b961238e tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:11 devstack sudo[108951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d Sep 10 16:59:11 devstack sudo[108951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:11 devstack sudo[108949]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cda72713-7fb9-4f07-9819-1ff98654b319 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3.info" returned: 0 in 0.265s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:11 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-cda72713-7fb9-4f07-9819-1ff98654b319 tempest-ProjectMemberTests-1654965068 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3.info is being set with open permissions: ugo+rw Sep 10 16:59:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cda72713-7fb9-4f07-9819-1ff98654b319 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:11 devstack sudo[108954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3.info Sep 10 16:59:11 devstack sudo[108954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:11 devstack sudo[108951]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d9cf83c5-4c64-4b66-83e1-1b41b961238e tempest-ProjectReaderTests-2110561421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d" returned: 0 in 0.380s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d9cf83c5-4c64-4b66-83e1-1b41b961238e tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:11 devstack sudo[108959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d Sep 10 16:59:11 devstack sudo[108959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:11 devstack sudo[108954]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cda72713-7fb9-4f07-9819-1ff98654b319 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3.info" returned: 0 in 0.261s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-cda72713-7fb9-4f07-9819-1ff98654b319 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.953s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:11 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-cda72713-7fb9-4f07-9819-1ff98654b319 tempest-ProjectMemberTests-1654965068 None] Create snapshot completed successfully Sep 10 16:59:11 devstack sudo[108959]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:11 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-09b81322-aaf9-4869-b71e-1b8b26250508 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-f69b9458-2082-481c-8c35-d74a7d5508f0-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d9cf83c5-4c64-4b66-83e1-1b41b961238e tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bae4e144-65f2-47cf-b199-fcda2d1c403d" returned: 0 in 0.269s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:11 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-09b81322-aaf9-4869-b71e-1b8b26250508 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-f69b9458-2082-481c-8c35-d74a7d5508f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:11 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-09b81322-aaf9-4869-b71e-1b8b26250508 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-quobyte-4089e086-e123-4315-bd4d-990f94867ca3" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:11 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d9cf83c5-4c64-4b66-83e1-1b41b961238e tempest-ProjectReaderTests-2110561421 None] Lock "cinder-quobyte-bae4e144-65f2-47cf-b199-fcda2d1c403d" released by "delete_volume" :: held 0.718s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:11 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-09b81322-aaf9-4869-b71e-1b8b26250508 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-4089e086-e123-4315-bd4d-990f94867ca3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:11 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-09b81322-aaf9-4869-b71e-1b8b26250508 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-quobyte-f69b9458-2082-481c-8c35-d74a7d5508f0" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:11 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-09b81322-aaf9-4869-b71e-1b8b26250508 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-f69b9458-2082-481c-8c35-d74a7d5508f0" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:11 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-09b81322-aaf9-4869-b71e-1b8b26250508 tempest-ProjectMemberTests-1654965068 None] Deleting offline snapshot f69b9458-2082-481c-8c35-d74a7d5508f0 of volume 4089e086-e123-4315-bd4d-990f94867ca3 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:59:11 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-09b81322-aaf9-4869-b71e-1b8b26250508 tempest-ProjectMemberTests-1654965068 None] snapshot_file for this snap is: volume-4089e086-e123-4315-bd4d-990f94867ca3.f69b9458-2082-481c-8c35-d74a7d5508f0 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:59:11 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cced30-e0b4-4086-b028-b65c186867f4]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-09b81322-aaf9-4869-b71e-1b8b26250508 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3.f69b9458-2082-481c-8c35-d74a7d5508f0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:11 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-d9cf83c5-4c64-4b66-83e1-1b41b961238e tempest-ProjectReaderTests-2110561421 None] Created reservations ['86d600aa-e203-4fd6-babc-3477f72b2b90', 'e877c673-dffe-4b9f-b304-47ef853c3725', 'be8369fd-90c0-4708-b204-05692e35607f', '53fbaffa-8fca-4f39-85e8-21b8010853d7'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:59:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d9cf83c5-4c64-4b66-83e1-1b41b961238e tempest-ProjectReaderTests-2110561421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d9cf83c5-4c64-4b66-83e1-1b41b961238e tempest-ProjectReaderTests-2110561421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:11 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d9cf83c5-4c64-4b66-83e1-1b41b961238e tempest-ProjectReaderTests-2110561421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:59:11 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d9cf83c5-4c64-4b66-83e1-1b41b961238e tempest-ProjectReaderTests-2110561421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:59:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d9cf83c5-4c64-4b66-83e1-1b41b961238e tempest-ProjectReaderTests-2110561421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:11 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d9cf83c5-4c64-4b66-83e1-1b41b961238e tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:11 devstack sudo[108963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3.f69b9458-2082-481c-8c35-d74a7d5508f0 Sep 10 16:59:11 devstack sudo[108963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:11 devstack sudo[108964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:59:11 devstack sudo[108964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:12 devstack sudo[108964]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d9cf83c5-4c64-4b66-83e1-1b41b961238e tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.253s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:12 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-d9cf83c5-4c64-4b66-83e1-1b41b961238e tempest-ProjectReaderTests-2110561421 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:59:12 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-d9cf83c5-4c64-4b66-83e1-1b41b961238e tempest-ProjectReaderTests-2110561421 None] Deleted volume successfully. Sep 10 16:59:12 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d9cf83c5-4c64-4b66-83e1-1b41b961238e tempest-ProjectReaderTests-2110561421 None] Lock "cinder-bae4e144-65f2-47cf-b199-fcda2d1c403d-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:12 devstack sudo[108963]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-09b81322-aaf9-4869-b71e-1b8b26250508 tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3.f69b9458-2082-481c-8c35-d74a7d5508f0" returned: 0 in 0.404s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:12 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-09b81322-aaf9-4869-b71e-1b8b26250508 tempest-ProjectMemberTests-1654965068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4089e086-e123-4315-bd4d-990f94867ca3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:59:12 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e5990a-1241-4f1d-a85d-da2a3436a2b4]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-09b81322-aaf9-4869-b71e-1b8b26250508 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:12 devstack sudo[108971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3 Sep 10 16:59:12 devstack sudo[108971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:12 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-74efafc8-1487-48d9-bf29-f42e476a7d6d tempest-ProjectReaderTests-2110561421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:59:12 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-74efafc8-1487-48d9-bf29-f42e476a7d6d tempest-ProjectReaderTests-2110561421 None] Flow 'volume_create_manager' (16042b05-4180-4068-8a36-579ae862e8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:59:12 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-74efafc8-1487-48d9-bf29-f42e476a7d6d tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ef9cfe0-0383-4125-b12c-91808a2b4998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:12 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-74efafc8-1487-48d9-bf29-f42e476a7d6d tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ef9cfe0-0383-4125-b12c-91808a2b4998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1765108237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfe575cf67994730b27c40255f732200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:59:12Z,use_quota=True,user_id='767a2dafef0c46a7b707405a09806384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:12 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-74efafc8-1487-48d9-bf29-f42e476a7d6d tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f377b7d-2e06-43ed-af5f-8efb125bb3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:12 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-74efafc8-1487-48d9-bf29-f42e476a7d6d tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f377b7d-2e06-43ed-af5f-8efb125bb3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:12 devstack sudo[108971]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:12 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-74efafc8-1487-48d9-bf29-f42e476a7d6d tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b48fc093-017c-4867-9daf-b379c78580fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:12 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-74efafc8-1487-48d9-bf29-f42e476a7d6d tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b48fc093-017c-4867-9daf-b379c78580fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6', 'volume_name': 'volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:12 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-74efafc8-1487-48d9-bf29-f42e476a7d6d tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9ed0d9a-a32f-4b73-a6eb-c8527780541c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:12 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-74efafc8-1487-48d9-bf29-f42e476a7d6d tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9ed0d9a-a32f-4b73-a6eb-c8527780541c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:12 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-74efafc8-1487-48d9-bf29-f42e476a7d6d tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b6b5f4d-b030-4f6c-8628-30f5dc12827b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:12 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-74efafc8-1487-48d9-bf29-f42e476a7d6d tempest-ProjectReaderTests-2110561421 None] Volume 8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6', 'volume_size': 1} Sep 10 16:59:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-74efafc8-1487-48d9-bf29-f42e476a7d6d tempest-ProjectReaderTests-2110561421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-74efafc8-1487-48d9-bf29-f42e476a7d6d tempest-ProjectReaderTests-2110561421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:12 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-74efafc8-1487-48d9-bf29-f42e476a7d6d tempest-ProjectReaderTests-2110561421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1765108237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfe575cf67994730b27c40255f732200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:59:12Z,use_quota=True,user_id='767a2dafef0c46a7b707405a09806384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:59:12 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-74efafc8-1487-48d9-bf29-f42e476a7d6d tempest-ProjectReaderTests-2110561421 None] Creating volume 8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:59:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-74efafc8-1487-48d9-bf29-f42e476a7d6d tempest-ProjectReaderTests-2110561421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-74efafc8-1487-48d9-bf29-f42e476a7d6d tempest-ProjectReaderTests-2110561421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:12 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-74efafc8-1487-48d9-bf29-f42e476a7d6d tempest-ProjectReaderTests-2110561421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:59:12 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-74efafc8-1487-48d9-bf29-f42e476a7d6d tempest-ProjectReaderTests-2110561421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:59:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-74efafc8-1487-48d9-bf29-f42e476a7d6d tempest-ProjectReaderTests-2110561421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:12 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-74efafc8-1487-48d9-bf29-f42e476a7d6d tempest-ProjectReaderTests-2110561421 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:59:12 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-74efafc8-1487-48d9-bf29-f42e476a7d6d tempest-ProjectReaderTests-2110561421 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:59:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-74efafc8-1487-48d9-bf29-f42e476a7d6d tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-09b81322-aaf9-4869-b71e-1b8b26250508 tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3" returned: 0 in 0.417s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-09b81322-aaf9-4869-b71e-1b8b26250508 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3.f69b9458-2082-481c-8c35-d74a7d5508f0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:12 devstack sudo[108976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6 1073741824 Sep 10 16:59:12 devstack sudo[108976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:12 devstack sudo[108977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3.f69b9458-2082-481c-8c35-d74a7d5508f0 Sep 10 16:59:12 devstack sudo[108977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:12 devstack sudo[108977]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-09b81322-aaf9-4869-b71e-1b8b26250508 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3.f69b9458-2082-481c-8c35-d74a7d5508f0" returned: 0 in 0.353s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:12 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-09b81322-aaf9-4869-b71e-1b8b26250508 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3.f69b9458-2082-481c-8c35-d74a7d5508f0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:12 devstack sudo[108986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3.f69b9458-2082-481c-8c35-d74a7d5508f0 Sep 10 16:59:12 devstack sudo[108986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:13 devstack sudo[108976]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-74efafc8-1487-48d9-bf29-f42e476a7d6d tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6 1073741824" returned: 0 in 0.444s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-74efafc8-1487-48d9-bf29-f42e476a7d6d tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:13 devstack sudo[108988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6 Sep 10 16:59:13 devstack sudo[108988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:13 devstack sudo[108986]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-09b81322-aaf9-4869-b71e-1b8b26250508 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3.f69b9458-2082-481c-8c35-d74a7d5508f0" returned: 0 in 0.255s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:13 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-09b81322-aaf9-4869-b71e-1b8b26250508 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-f69b9458-2082-481c-8c35-d74a7d5508f0" released by "_delete_snapshot" :: held 1.525s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:13 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-09b81322-aaf9-4869-b71e-1b8b26250508 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-4089e086-e123-4315-bd4d-990f94867ca3" released by "delete_snapshot" :: held 1.551s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:13 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-09b81322-aaf9-4869-b71e-1b8b26250508 tempest-ProjectMemberTests-1654965068 None] Created reservations ['e85a6c3b-f97a-4f04-bd4d-c4d6fba0fc12', 'e06486bb-3f48-4913-8b75-655fa9e4eadd', '9d0b5a35-d1b3-4745-9a8e-9b49de62ac35', 'd8f0e648-12a9-4b30-8762-0b520ff48a84'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:59:13 devstack sudo[108988]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-74efafc8-1487-48d9-bf29-f42e476a7d6d tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6" returned: 0 in 0.267s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:13 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-74efafc8-1487-48d9-bf29-f42e476a7d6d tempest-ProjectReaderTests-2110561421 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:59:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-74efafc8-1487-48d9-bf29-f42e476a7d6d tempest-ProjectReaderTests-2110561421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:13 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-74efafc8-1487-48d9-bf29-f42e476a7d6d tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b6b5f4d-b030-4f6c-8628-30f5dc12827b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:13 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-74efafc8-1487-48d9-bf29-f42e476a7d6d tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41b65472-4627-4b72-881e-be1552a2a9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:13 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-74efafc8-1487-48d9-bf29-f42e476a7d6d tempest-ProjectReaderTests-2110561421 None] Volume volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6 (8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6): created successfully Sep 10 16:59:13 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-74efafc8-1487-48d9-bf29-f42e476a7d6d tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41b65472-4627-4b72-881e-be1552a2a9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:13 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-74efafc8-1487-48d9-bf29-f42e476a7d6d tempest-ProjectReaderTests-2110561421 None] Flow 'volume_create_manager' (16042b05-4180-4068-8a36-579ae862e8b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:59:13 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-74efafc8-1487-48d9-bf29-f42e476a7d6d tempest-ProjectReaderTests-2110561421 None] Created volume successfully. Sep 10 16:59:13 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-09b81322-aaf9-4869-b71e-1b8b26250508 tempest-ProjectMemberTests-1654965068 None] Delete snapshot completed successfully. Sep 10 16:59:13 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-09b81322-aaf9-4869-b71e-1b8b26250508 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-f69b9458-2082-481c-8c35-d74a7d5508f0-delete_snapshot" released by "delete_snapshot" :: held 1.731s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-08b7fc94-1742-48d6-bb31-6cdb51af6769 tempest-ProjectReaderTests-2110561421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-08b7fc94-1742-48d6-bb31-6cdb51af6769 tempest-ProjectReaderTests-2110561421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:13 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-08b7fc94-1742-48d6-bb31-6cdb51af6769 tempest-ProjectReaderTests-2110561421 None] Creating offline snapshot ca344052-d976-4ac9-9f35-8c5a23ee0a9b of volume 8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6 {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:59:13 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d684d6ea-a953-435c-a4d9-ecb901ae4b6e]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-08b7fc94-1742-48d6-bb31-6cdb51af6769 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:13 devstack sudo[108992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6 Sep 10 16:59:13 devstack sudo[108992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:13 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d225363d-28b6-43ee-a07a-c676dda1c4e7 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-4089e086-e123-4315-bd4d-990f94867ca3-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:13 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d225363d-28b6-43ee-a07a-c676dda1c4e7 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-4089e086-e123-4315-bd4d-990f94867ca3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:13 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d225363d-28b6-43ee-a07a-c676dda1c4e7 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-quobyte-4089e086-e123-4315-bd4d-990f94867ca3" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:13 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d225363d-28b6-43ee-a07a-c676dda1c4e7 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-4089e086-e123-4315-bd4d-990f94867ca3" acquired by "delete_volume" :: waited 0.015s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:13 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a759a6-afbb-4c21-a7cc-86c21c444c60]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:13 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d225363d-28b6-43ee-a07a-c676dda1c4e7 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:14 devstack sudo[108994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3 Sep 10 16:59:14 devstack sudo[108994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:14 devstack sudo[108992]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-08b7fc94-1742-48d6-bb31-6cdb51af6769 tempest-ProjectReaderTests-2110561421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6" returned: 0 in 0.368s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-08b7fc94-1742-48d6-bb31-6cdb51af6769 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6.ca344052-d976-4ac9-9f35-8c5a23ee0a9b 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:14 devstack sudo[108999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6.ca344052-d976-4ac9-9f35-8c5a23ee0a9b 1G Sep 10 16:59:14 devstack sudo[108999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:14 devstack sudo[108994]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d225363d-28b6-43ee-a07a-c676dda1c4e7 tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3" returned: 0 in 0.363s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d225363d-28b6-43ee-a07a-c676dda1c4e7 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:14 devstack sudo[109007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3 Sep 10 16:59:14 devstack sudo[109007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:14 devstack sudo[108999]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-08b7fc94-1742-48d6-bb31-6cdb51af6769 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6.ca344052-d976-4ac9-9f35-8c5a23ee0a9b 1G" returned: 0 in 0.402s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-08b7fc94-1742-48d6-bb31-6cdb51af6769 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6.ca344052-d976-4ac9-9f35-8c5a23ee0a9b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:14 devstack sudo[109010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6.ca344052-d976-4ac9-9f35-8c5a23ee0a9b Sep 10 16:59:14 devstack sudo[109010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:14 devstack sudo[109007]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d225363d-28b6-43ee-a07a-c676dda1c4e7 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-4089e086-e123-4315-bd4d-990f94867ca3" returned: 0 in 0.269s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:14 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d225363d-28b6-43ee-a07a-c676dda1c4e7 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-4089e086-e123-4315-bd4d-990f94867ca3" released by "delete_volume" :: held 0.697s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:14 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-d225363d-28b6-43ee-a07a-c676dda1c4e7 tempest-ProjectMemberTests-1654965068 None] Created reservations ['c75d8078-6e09-44aa-b211-0997a3d50cec', '0a28ad9c-e016-4a8f-891e-3cd8a468478f', '9ca29209-0fa7-457e-aa40-a0d19e9bd2e5', '08a25042-7a77-4788-902b-9fe771d3d106'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:59:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d225363d-28b6-43ee-a07a-c676dda1c4e7 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d225363d-28b6-43ee-a07a-c676dda1c4e7 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:14 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d225363d-28b6-43ee-a07a-c676dda1c4e7 tempest-ProjectMemberTests-1654965068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:59:14 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-d225363d-28b6-43ee-a07a-c676dda1c4e7 tempest-ProjectMemberTests-1654965068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:59:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-d225363d-28b6-43ee-a07a-c676dda1c4e7 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d225363d-28b6-43ee-a07a-c676dda1c4e7 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:14 devstack sudo[109016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:59:14 devstack sudo[109016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:14 devstack sudo[109010]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-08b7fc94-1742-48d6-bb31-6cdb51af6769 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6.ca344052-d976-4ac9-9f35-8c5a23ee0a9b" returned: 0 in 0.326s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:14 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-08b7fc94-1742-48d6-bb31-6cdb51af6769 tempest-ProjectReaderTests-2110561421 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6.ca344052-d976-4ac9-9f35-8c5a23ee0a9b is being set with open permissions: ugo+rw Sep 10 16:59:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-08b7fc94-1742-48d6-bb31-6cdb51af6769 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6.ca344052-d976-4ac9-9f35-8c5a23ee0a9b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:14 devstack sudo[109019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6.ca344052-d976-4ac9-9f35-8c5a23ee0a9b Sep 10 16:59:14 devstack sudo[109019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:14 devstack sudo[109016]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:14 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-d225363d-28b6-43ee-a07a-c676dda1c4e7 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.268s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:14 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-d225363d-28b6-43ee-a07a-c676dda1c4e7 tempest-ProjectMemberTests-1654965068 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:59:14 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-d225363d-28b6-43ee-a07a-c676dda1c4e7 tempest-ProjectMemberTests-1654965068 None] Deleted volume successfully. Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-d225363d-28b6-43ee-a07a-c676dda1c4e7 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-4089e086-e123-4315-bd4d-990f94867ca3-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:15 devstack sudo[109019]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-08b7fc94-1742-48d6-bb31-6cdb51af6769 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6.ca344052-d976-4ac9-9f35-8c5a23ee0a9b" returned: 0 in 0.260s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-08b7fc94-1742-48d6-bb31-6cdb51af6769 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:15 devstack sudo[109023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6.info Sep 10 16:59:15 devstack sudo[109023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:15 devstack sudo[109023]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-08b7fc94-1742-48d6-bb31-6cdb51af6769 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6.info" returned: 0 in 0.290s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:15 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-08b7fc94-1742-48d6-bb31-6cdb51af6769 tempest-ProjectReaderTests-2110561421 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6.info is being set with open permissions: ugo+rw Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-08b7fc94-1742-48d6-bb31-6cdb51af6769 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:15 devstack sudo[109026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6.info Sep 10 16:59:15 devstack sudo[109026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-feb233f9-9e11-42aa-817b-0ff66f9d7829 tempest-ProjectMemberTests-1654965068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-feb233f9-9e11-42aa-817b-0ff66f9d7829 tempest-ProjectMemberTests-1654965068 None] Flow 'volume_create_manager' (2aae2c63-a062-4f41-a9ed-900ce53ee025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-feb233f9-9e11-42aa-817b-0ff66f9d7829 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36062ade-84df-4825-a541-1fed5ed3318b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-feb233f9-9e11-42aa-817b-0ff66f9d7829 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36062ade-84df-4825-a541-1fed5ed3318b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1514207798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=030c1613-a8ff-4b06-9b6c-5f15d26c861b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fdc4b0dbad645d8bc3672158e8e45da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:59:15Z,use_quota=True,user_id='4d7a8be540c54a1e9a03d51feae99641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-feb233f9-9e11-42aa-817b-0ff66f9d7829 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3252af67-668c-4558-a92f-641fee2fb741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-feb233f9-9e11-42aa-817b-0ff66f9d7829 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3252af67-668c-4558-a92f-641fee2fb741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-feb233f9-9e11-42aa-817b-0ff66f9d7829 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5f4e60-2028-4e65-9dbb-66c7d83fecbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-feb233f9-9e11-42aa-817b-0ff66f9d7829 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5f4e60-2028-4e65-9dbb-66c7d83fecbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '030c1613-a8ff-4b06-9b6c-5f15d26c861b', 'volume_name': 'volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-feb233f9-9e11-42aa-817b-0ff66f9d7829 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72ec5718-6e76-43e9-a084-1e8ebc7330b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-feb233f9-9e11-42aa-817b-0ff66f9d7829 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72ec5718-6e76-43e9-a084-1e8ebc7330b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-feb233f9-9e11-42aa-817b-0ff66f9d7829 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e4d65d1-1f7d-4c87-83a6-8a46e4840a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:15 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-feb233f9-9e11-42aa-817b-0ff66f9d7829 tempest-ProjectMemberTests-1654965068 None] Volume 030c1613-a8ff-4b06-9b6c-5f15d26c861b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b', 'volume_size': 1} Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-feb233f9-9e11-42aa-817b-0ff66f9d7829 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:15 devstack sudo[109026]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-08b7fc94-1742-48d6-bb31-6cdb51af6769 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6.info" returned: 0 in 0.244s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-08b7fc94-1742-48d6-bb31-6cdb51af6769 tempest-ProjectReaderTests-2110561421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.967s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-feb233f9-9e11-42aa-817b-0ff66f9d7829 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.091s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-feb233f9-9e11-42aa-817b-0ff66f9d7829 tempest-ProjectMemberTests-1654965068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1514207798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=030c1613-a8ff-4b06-9b6c-5f15d26c861b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fdc4b0dbad645d8bc3672158e8e45da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:59:15Z,use_quota=True,user_id='4d7a8be540c54a1e9a03d51feae99641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-feb233f9-9e11-42aa-817b-0ff66f9d7829 tempest-ProjectMemberTests-1654965068 None] Creating volume 030c1613-a8ff-4b06-9b6c-5f15d26c861b {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-feb233f9-9e11-42aa-817b-0ff66f9d7829 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-feb233f9-9e11-42aa-817b-0ff66f9d7829 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-feb233f9-9e11-42aa-817b-0ff66f9d7829 tempest-ProjectMemberTests-1654965068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-feb233f9-9e11-42aa-817b-0ff66f9d7829 tempest-ProjectMemberTests-1654965068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-feb233f9-9e11-42aa-817b-0ff66f9d7829 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-feb233f9-9e11-42aa-817b-0ff66f9d7829 tempest-ProjectMemberTests-1654965068 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:59:15 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-feb233f9-9e11-42aa-817b-0ff66f9d7829 tempest-ProjectMemberTests-1654965068 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-feb233f9-9e11-42aa-817b-0ff66f9d7829 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:15 devstack sudo[109029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b 1073741824 Sep 10 16:59:15 devstack sudo[109029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:15 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-08b7fc94-1742-48d6-bb31-6cdb51af6769 tempest-ProjectReaderTests-2110561421 None] Create snapshot completed successfully Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-04c6b146-7032-433c-a055-26c0587425a8 tempest-ProjectReaderTests-2110561421 None] Acquiring lock "cinder-ca344052-d976-4ac9-9f35-8c5a23ee0a9b-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-04c6b146-7032-433c-a055-26c0587425a8 tempest-ProjectReaderTests-2110561421 None] Lock "cinder-ca344052-d976-4ac9-9f35-8c5a23ee0a9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-04c6b146-7032-433c-a055-26c0587425a8 tempest-ProjectReaderTests-2110561421 None] Acquiring lock "cinder-quobyte-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-04c6b146-7032-433c-a055-26c0587425a8 tempest-ProjectReaderTests-2110561421 None] Lock "cinder-quobyte-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-04c6b146-7032-433c-a055-26c0587425a8 tempest-ProjectReaderTests-2110561421 None] Acquiring lock "cinder-quobyte-ca344052-d976-4ac9-9f35-8c5a23ee0a9b" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-04c6b146-7032-433c-a055-26c0587425a8 tempest-ProjectReaderTests-2110561421 None] Lock "cinder-quobyte-ca344052-d976-4ac9-9f35-8c5a23ee0a9b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-04c6b146-7032-433c-a055-26c0587425a8 tempest-ProjectReaderTests-2110561421 None] Deleting offline snapshot ca344052-d976-4ac9-9f35-8c5a23ee0a9b of volume 8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-04c6b146-7032-433c-a055-26c0587425a8 tempest-ProjectReaderTests-2110561421 None] snapshot_file for this snap is: volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6.ca344052-d976-4ac9-9f35-8c5a23ee0a9b {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1e4148-dd5d-4418-8fb7-4f22f1557cc2]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:15 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-04c6b146-7032-433c-a055-26c0587425a8 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6.ca344052-d976-4ac9-9f35-8c5a23ee0a9b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:15 devstack sudo[109034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6.ca344052-d976-4ac9-9f35-8c5a23ee0a9b Sep 10 16:59:15 devstack sudo[109034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:16 devstack sudo[109029]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-feb233f9-9e11-42aa-817b-0ff66f9d7829 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b 1073741824" returned: 0 in 0.421s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-feb233f9-9e11-42aa-817b-0ff66f9d7829 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:16 devstack sudo[109036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b Sep 10 16:59:16 devstack sudo[109036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:16 devstack sudo[109034]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-04c6b146-7032-433c-a055-26c0587425a8 tempest-ProjectReaderTests-2110561421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6.ca344052-d976-4ac9-9f35-8c5a23ee0a9b" returned: 0 in 0.371s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-04c6b146-7032-433c-a055-26c0587425a8 tempest-ProjectReaderTests-2110561421 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:59:16 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff446066-cd9e-469c-bb1a-e6a8cf01d68d]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-04c6b146-7032-433c-a055-26c0587425a8 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:16 devstack sudo[109036]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-feb233f9-9e11-42aa-817b-0ff66f9d7829 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b" returned: 0 in 0.258s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:16 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-feb233f9-9e11-42aa-817b-0ff66f9d7829 tempest-ProjectMemberTests-1654965068 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:59:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-feb233f9-9e11-42aa-817b-0ff66f9d7829 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-feb233f9-9e11-42aa-817b-0ff66f9d7829 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e4d65d1-1f7d-4c87-83a6-8a46e4840a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-feb233f9-9e11-42aa-817b-0ff66f9d7829 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53681018-19ea-42d6-9b63-63a3c87869de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:16 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-feb233f9-9e11-42aa-817b-0ff66f9d7829 tempest-ProjectMemberTests-1654965068 None] Volume volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b (030c1613-a8ff-4b06-9b6c-5f15d26c861b): created successfully Sep 10 16:59:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-feb233f9-9e11-42aa-817b-0ff66f9d7829 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53681018-19ea-42d6-9b63-63a3c87869de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:16 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-feb233f9-9e11-42aa-817b-0ff66f9d7829 tempest-ProjectMemberTests-1654965068 None] Flow 'volume_create_manager' (2aae2c63-a062-4f41-a9ed-900ce53ee025) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:59:16 devstack sudo[109041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6 Sep 10 16:59:16 devstack sudo[109041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:16 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-feb233f9-9e11-42aa-817b-0ff66f9d7829 tempest-ProjectMemberTests-1654965068 None] Created volume successfully. Sep 10 16:59:16 devstack sudo[109041]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-04c6b146-7032-433c-a055-26c0587425a8 tempest-ProjectReaderTests-2110561421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6" returned: 0 in 0.364s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-04c6b146-7032-433c-a055-26c0587425a8 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6.ca344052-d976-4ac9-9f35-8c5a23ee0a9b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:16 devstack sudo[109047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6.ca344052-d976-4ac9-9f35-8c5a23ee0a9b Sep 10 16:59:16 devstack sudo[109047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:16 devstack sudo[109047]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-04c6b146-7032-433c-a055-26c0587425a8 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6.ca344052-d976-4ac9-9f35-8c5a23ee0a9b" returned: 0 in 0.315s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:16 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-04c6b146-7032-433c-a055-26c0587425a8 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6.ca344052-d976-4ac9-9f35-8c5a23ee0a9b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:16 devstack sudo[109052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6.ca344052-d976-4ac9-9f35-8c5a23ee0a9b Sep 10 16:59:16 devstack sudo[109052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:17 devstack sudo[109052]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-04c6b146-7032-433c-a055-26c0587425a8 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6.ca344052-d976-4ac9-9f35-8c5a23ee0a9b" returned: 0 in 0.242s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:17 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-04c6b146-7032-433c-a055-26c0587425a8 tempest-ProjectReaderTests-2110561421 None] Lock "cinder-quobyte-ca344052-d976-4ac9-9f35-8c5a23ee0a9b" released by "_delete_snapshot" :: held 1.379s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:17 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-04c6b146-7032-433c-a055-26c0587425a8 tempest-ProjectReaderTests-2110561421 None] Lock "cinder-quobyte-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6" released by "delete_snapshot" :: held 1.400s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:17 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-04c6b146-7032-433c-a055-26c0587425a8 tempest-ProjectReaderTests-2110561421 None] Created reservations ['6a5595f8-dd2f-4fe5-a747-465681fe02ad', '057b918b-f544-4eb7-bae8-3e67d8e0719a', '7bbbe05e-d994-4a2d-897f-c688a55cc38a', '0fb36b79-fefe-409e-964d-24abfa1041e1'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:59:17 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-04c6b146-7032-433c-a055-26c0587425a8 tempest-ProjectReaderTests-2110561421 None] Delete snapshot completed successfully. Sep 10 16:59:17 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-04c6b146-7032-433c-a055-26c0587425a8 tempest-ProjectReaderTests-2110561421 None] Lock "cinder-ca344052-d976-4ac9-9f35-8c5a23ee0a9b-delete_snapshot" released by "delete_snapshot" :: held 1.539s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-407438ee-5652-4e79-8cb4-f41dbe35bedb tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-407438ee-5652-4e79-8cb4-f41dbe35bedb tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:17 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-407438ee-5652-4e79-8cb4-f41dbe35bedb tempest-ProjectMemberTests-1654965068 None] Creating offline snapshot 831039e5-aa6d-4717-805d-98b1563af1c0 of volume 030c1613-a8ff-4b06-9b6c-5f15d26c861b {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:59:17 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33bf15b-1b4b-45ae-862b-a9c377375cb8]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:17 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-407438ee-5652-4e79-8cb4-f41dbe35bedb tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:17 devstack sudo[109055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b Sep 10 16:59:17 devstack sudo[109055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:17 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-814a461c-a759-40e3-872d-e7c693c0b704 tempest-ProjectReaderTests-2110561421 None] Acquiring lock "cinder-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:17 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-814a461c-a759-40e3-872d-e7c693c0b704 tempest-ProjectReaderTests-2110561421 None] Lock "cinder-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:17 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-814a461c-a759-40e3-872d-e7c693c0b704 tempest-ProjectReaderTests-2110561421 None] Acquiring lock "cinder-quobyte-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:18 devstack sudo[109055]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-407438ee-5652-4e79-8cb4-f41dbe35bedb tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b" returned: 0 in 0.368s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-407438ee-5652-4e79-8cb4-f41dbe35bedb tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b.831039e5-aa6d-4717-805d-98b1563af1c0 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:18 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-814a461c-a759-40e3-872d-e7c693c0b704 tempest-ProjectReaderTests-2110561421 None] Lock "cinder-quobyte-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6" acquired by "delete_volume" :: waited 0.032s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:18 devstack sudo[109061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b.831039e5-aa6d-4717-805d-98b1563af1c0 1G Sep 10 16:59:18 devstack sudo[109061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:18 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[442bfc5c-1985-45c2-af76-9a665199c904]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-814a461c-a759-40e3-872d-e7c693c0b704 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:18 devstack sudo[109063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6 Sep 10 16:59:18 devstack sudo[109063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:18 devstack sudo[109061]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-407438ee-5652-4e79-8cb4-f41dbe35bedb tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b.831039e5-aa6d-4717-805d-98b1563af1c0 1G" returned: 0 in 0.383s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-407438ee-5652-4e79-8cb4-f41dbe35bedb tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b.831039e5-aa6d-4717-805d-98b1563af1c0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:18 devstack sudo[109071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b.831039e5-aa6d-4717-805d-98b1563af1c0 Sep 10 16:59:18 devstack sudo[109071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:18 devstack sudo[109063]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-814a461c-a759-40e3-872d-e7c693c0b704 tempest-ProjectReaderTests-2110561421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6" returned: 0 in 0.379s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-814a461c-a759-40e3-872d-e7c693c0b704 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:18 devstack sudo[109073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6 Sep 10 16:59:18 devstack sudo[109073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:18 devstack sudo[109071]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-407438ee-5652-4e79-8cb4-f41dbe35bedb tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b.831039e5-aa6d-4717-805d-98b1563af1c0" returned: 0 in 0.289s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:18 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-407438ee-5652-4e79-8cb4-f41dbe35bedb tempest-ProjectMemberTests-1654965068 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b.831039e5-aa6d-4717-805d-98b1563af1c0 is being set with open permissions: ugo+rw Sep 10 16:59:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-407438ee-5652-4e79-8cb4-f41dbe35bedb tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b.831039e5-aa6d-4717-805d-98b1563af1c0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:18 devstack sudo[109073]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-814a461c-a759-40e3-872d-e7c693c0b704 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6" returned: 0 in 0.255s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:18 devstack sudo[109079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b.831039e5-aa6d-4717-805d-98b1563af1c0 Sep 10 16:59:18 devstack sudo[109079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:18 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-814a461c-a759-40e3-872d-e7c693c0b704 tempest-ProjectReaderTests-2110561421 None] Lock "cinder-quobyte-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6" released by "delete_volume" :: held 0.698s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:18 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-814a461c-a759-40e3-872d-e7c693c0b704 tempest-ProjectReaderTests-2110561421 None] Created reservations ['e5e8c060-4426-4b29-a393-44e1bcff102c', 'ae613941-b64a-42e1-946c-5f04ae6d5546', 'b2ef9922-5d8d-4fc2-af74-ce21ab73c392', '5103e1e8-b3fa-4449-99f7-28ab00c2d48a'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:59:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-814a461c-a759-40e3-872d-e7c693c0b704 tempest-ProjectReaderTests-2110561421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-814a461c-a759-40e3-872d-e7c693c0b704 tempest-ProjectReaderTests-2110561421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:18 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-814a461c-a759-40e3-872d-e7c693c0b704 tempest-ProjectReaderTests-2110561421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:59:18 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-814a461c-a759-40e3-872d-e7c693c0b704 tempest-ProjectReaderTests-2110561421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:59:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-814a461c-a759-40e3-872d-e7c693c0b704 tempest-ProjectReaderTests-2110561421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-814a461c-a759-40e3-872d-e7c693c0b704 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:18 devstack sudo[109081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:59:18 devstack sudo[109081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:18 devstack sudo[109079]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-407438ee-5652-4e79-8cb4-f41dbe35bedb tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b.831039e5-aa6d-4717-805d-98b1563af1c0" returned: 0 in 0.246s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:18 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-407438ee-5652-4e79-8cb4-f41dbe35bedb tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:18 devstack sudo[109084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b.info Sep 10 16:59:18 devstack sudo[109084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:19 devstack sudo[109081]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-814a461c-a759-40e3-872d-e7c693c0b704 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.243s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-814a461c-a759-40e3-872d-e7c693c0b704 tempest-ProjectReaderTests-2110561421 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:59:19 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-814a461c-a759-40e3-872d-e7c693c0b704 tempest-ProjectReaderTests-2110561421 None] Deleted volume successfully. Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-814a461c-a759-40e3-872d-e7c693c0b704 tempest-ProjectReaderTests-2110561421 None] Lock "cinder-8d6c2edb-a5e2-4e6c-b3c6-d8f81a3dafb6-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:19 devstack sudo[109084]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-407438ee-5652-4e79-8cb4-f41dbe35bedb tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b.info" returned: 0 in 0.284s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:19 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-407438ee-5652-4e79-8cb4-f41dbe35bedb tempest-ProjectMemberTests-1654965068 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b.info is being set with open permissions: ugo+rw Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-407438ee-5652-4e79-8cb4-f41dbe35bedb tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:19 devstack sudo[109088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b.info Sep 10 16:59:19 devstack sudo[109088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:19 devstack sudo[109088]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-407438ee-5652-4e79-8cb4-f41dbe35bedb tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b.info" returned: 0 in 0.250s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-407438ee-5652-4e79-8cb4-f41dbe35bedb tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.896s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:19 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-407438ee-5652-4e79-8cb4-f41dbe35bedb tempest-ProjectMemberTests-1654965068 None] Create snapshot completed successfully Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-75a49e64-b05a-44aa-8633-f9b39e608673 tempest-ProjectReaderTests-2110561421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-75a49e64-b05a-44aa-8633-f9b39e608673 tempest-ProjectReaderTests-2110561421 None] Flow 'volume_create_manager' (3495e4af-b64e-45ea-8981-8d6f97efa10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-75a49e64-b05a-44aa-8633-f9b39e608673 tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d042edb-f2d1-4a66-bb23-b91e32d30665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-75a49e64-b05a-44aa-8633-f9b39e608673 tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d042edb-f2d1-4a66-bb23-b91e32d30665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-177471072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=036b6e60-4656-4d51-961d-9f946d238e7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfe575cf67994730b27c40255f732200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:59:19Z,use_quota=True,user_id='767a2dafef0c46a7b707405a09806384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-75a49e64-b05a-44aa-8633-f9b39e608673 tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bfd565c-112a-4942-904c-a77ef7e0d4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-75a49e64-b05a-44aa-8633-f9b39e608673 tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bfd565c-112a-4942-904c-a77ef7e0d4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-75a49e64-b05a-44aa-8633-f9b39e608673 tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (598cfabe-02eb-45fc-8b87-664f266ccffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-75a49e64-b05a-44aa-8633-f9b39e608673 tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (598cfabe-02eb-45fc-8b87-664f266ccffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '036b6e60-4656-4d51-961d-9f946d238e7b', 'volume_name': 'volume-036b6e60-4656-4d51-961d-9f946d238e7b', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-75a49e64-b05a-44aa-8633-f9b39e608673 tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd2194ae-782f-4301-b53a-bc5ee197484f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-75a49e64-b05a-44aa-8633-f9b39e608673 tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd2194ae-782f-4301-b53a-bc5ee197484f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-75a49e64-b05a-44aa-8633-f9b39e608673 tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb50556b-5739-4226-88a2-ecb734aa5aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:19 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-75a49e64-b05a-44aa-8633-f9b39e608673 tempest-ProjectReaderTests-2110561421 None] Volume 036b6e60-4656-4d51-961d-9f946d238e7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-036b6e60-4656-4d51-961d-9f946d238e7b', 'volume_size': 1} Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-75a49e64-b05a-44aa-8633-f9b39e608673 tempest-ProjectReaderTests-2110561421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-75a49e64-b05a-44aa-8633-f9b39e608673 tempest-ProjectReaderTests-2110561421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-75a49e64-b05a-44aa-8633-f9b39e608673 tempest-ProjectReaderTests-2110561421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-177471072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=036b6e60-4656-4d51-961d-9f946d238e7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfe575cf67994730b27c40255f732200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:59:19Z,use_quota=True,user_id='767a2dafef0c46a7b707405a09806384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-75a49e64-b05a-44aa-8633-f9b39e608673 tempest-ProjectReaderTests-2110561421 None] Creating volume 036b6e60-4656-4d51-961d-9f946d238e7b {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-75a49e64-b05a-44aa-8633-f9b39e608673 tempest-ProjectReaderTests-2110561421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-75a49e64-b05a-44aa-8633-f9b39e608673 tempest-ProjectReaderTests-2110561421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-75a49e64-b05a-44aa-8633-f9b39e608673 tempest-ProjectReaderTests-2110561421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-75a49e64-b05a-44aa-8633-f9b39e608673 tempest-ProjectReaderTests-2110561421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-75a49e64-b05a-44aa-8633-f9b39e608673 tempest-ProjectReaderTests-2110561421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-75a49e64-b05a-44aa-8633-f9b39e608673 tempest-ProjectReaderTests-2110561421 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:59:19 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-75a49e64-b05a-44aa-8633-f9b39e608673 tempest-ProjectReaderTests-2110561421 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-75a49e64-b05a-44aa-8633-f9b39e608673 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:19 devstack sudo[109091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b 1073741824 Sep 10 16:59:19 devstack sudo[109091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-536eea37-d535-4676-8537-721dc50914b5 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-831039e5-aa6d-4717-805d-98b1563af1c0-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-536eea37-d535-4676-8537-721dc50914b5 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-831039e5-aa6d-4717-805d-98b1563af1c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-536eea37-d535-4676-8537-721dc50914b5 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-quobyte-030c1613-a8ff-4b06-9b6c-5f15d26c861b" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-536eea37-d535-4676-8537-721dc50914b5 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-030c1613-a8ff-4b06-9b6c-5f15d26c861b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-536eea37-d535-4676-8537-721dc50914b5 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-quobyte-831039e5-aa6d-4717-805d-98b1563af1c0" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-536eea37-d535-4676-8537-721dc50914b5 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-831039e5-aa6d-4717-805d-98b1563af1c0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-536eea37-d535-4676-8537-721dc50914b5 tempest-ProjectMemberTests-1654965068 None] Deleting offline snapshot 831039e5-aa6d-4717-805d-98b1563af1c0 of volume 030c1613-a8ff-4b06-9b6c-5f15d26c861b {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-536eea37-d535-4676-8537-721dc50914b5 tempest-ProjectMemberTests-1654965068 None] snapshot_file for this snap is: volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b.831039e5-aa6d-4717-805d-98b1563af1c0 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[013333fc-8657-4a05-8b88-12a88bf7bc58]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:19 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-536eea37-d535-4676-8537-721dc50914b5 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b.831039e5-aa6d-4717-805d-98b1563af1c0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:19 devstack sudo[109093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b.831039e5-aa6d-4717-805d-98b1563af1c0 Sep 10 16:59:19 devstack sudo[109093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:20 devstack sudo[109091]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-75a49e64-b05a-44aa-8633-f9b39e608673 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b 1073741824" returned: 0 in 0.416s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-75a49e64-b05a-44aa-8633-f9b39e608673 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:20 devstack sudo[109098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b Sep 10 16:59:20 devstack sudo[109098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:20 devstack sudo[109093]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-536eea37-d535-4676-8537-721dc50914b5 tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b.831039e5-aa6d-4717-805d-98b1563af1c0" returned: 0 in 0.375s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:20 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-536eea37-d535-4676-8537-721dc50914b5 tempest-ProjectMemberTests-1654965068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:59:20 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[02be1869-ddb7-4fb9-a380-5d483d3610d2]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-536eea37-d535-4676-8537-721dc50914b5 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:20 devstack sudo[109098]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-75a49e64-b05a-44aa-8633-f9b39e608673 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b" returned: 0 in 0.262s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:20 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-75a49e64-b05a-44aa-8633-f9b39e608673 tempest-ProjectReaderTests-2110561421 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:59:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-75a49e64-b05a-44aa-8633-f9b39e608673 tempest-ProjectReaderTests-2110561421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:20 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-75a49e64-b05a-44aa-8633-f9b39e608673 tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb50556b-5739-4226-88a2-ecb734aa5aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-036b6e60-4656-4d51-961d-9f946d238e7b', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:20 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-75a49e64-b05a-44aa-8633-f9b39e608673 tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ec2a9bf-f4ca-4e89-9c7f-4d511da47009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:20 devstack sudo[109117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b Sep 10 16:59:20 devstack sudo[109117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:20 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-75a49e64-b05a-44aa-8633-f9b39e608673 tempest-ProjectReaderTests-2110561421 None] Volume volume-036b6e60-4656-4d51-961d-9f946d238e7b (036b6e60-4656-4d51-961d-9f946d238e7b): created successfully Sep 10 16:59:20 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-75a49e64-b05a-44aa-8633-f9b39e608673 tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ec2a9bf-f4ca-4e89-9c7f-4d511da47009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:20 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-75a49e64-b05a-44aa-8633-f9b39e608673 tempest-ProjectReaderTests-2110561421 None] Flow 'volume_create_manager' (3495e4af-b64e-45ea-8981-8d6f97efa10d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:59:20 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-75a49e64-b05a-44aa-8633-f9b39e608673 tempest-ProjectReaderTests-2110561421 None] Created volume successfully. Sep 10 16:59:20 devstack sudo[109117]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-536eea37-d535-4676-8537-721dc50914b5 tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b" returned: 0 in 0.418s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-536eea37-d535-4676-8537-721dc50914b5 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b.831039e5-aa6d-4717-805d-98b1563af1c0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:20 devstack sudo[109145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b.831039e5-aa6d-4717-805d-98b1563af1c0 Sep 10 16:59:20 devstack sudo[109145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-661f3128-f156-4d9f-8e59-64de17c3ce76 tempest-ProjectReaderTests-2110561421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-661f3128-f156-4d9f-8e59-64de17c3ce76 tempest-ProjectReaderTests-2110561421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:20 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-661f3128-f156-4d9f-8e59-64de17c3ce76 tempest-ProjectReaderTests-2110561421 None] Creating offline snapshot deb34e16-0193-422e-902a-5631e1e27abf of volume 036b6e60-4656-4d51-961d-9f946d238e7b {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:59:20 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5da207-cf14-4c0c-8cff-4e1de8d48412]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-661f3128-f156-4d9f-8e59-64de17c3ce76 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:20 devstack sudo[109148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b Sep 10 16:59:20 devstack sudo[109148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:21 devstack sudo[109145]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-536eea37-d535-4676-8537-721dc50914b5 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b.831039e5-aa6d-4717-805d-98b1563af1c0" returned: 0 in 0.344s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-536eea37-d535-4676-8537-721dc50914b5 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b.831039e5-aa6d-4717-805d-98b1563af1c0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:21 devstack sudo[109153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b.831039e5-aa6d-4717-805d-98b1563af1c0 Sep 10 16:59:21 devstack sudo[109153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:21 devstack sudo[109148]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-661f3128-f156-4d9f-8e59-64de17c3ce76 tempest-ProjectReaderTests-2110561421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b" returned: 0 in 0.388s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-661f3128-f156-4d9f-8e59-64de17c3ce76 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b.deb34e16-0193-422e-902a-5631e1e27abf 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:21 devstack sudo[109158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b.deb34e16-0193-422e-902a-5631e1e27abf 1G Sep 10 16:59:21 devstack sudo[109158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:21 devstack sudo[109153]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-536eea37-d535-4676-8537-721dc50914b5 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b.831039e5-aa6d-4717-805d-98b1563af1c0" returned: 0 in 0.252s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-536eea37-d535-4676-8537-721dc50914b5 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-831039e5-aa6d-4717-805d-98b1563af1c0" released by "_delete_snapshot" :: held 1.479s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-536eea37-d535-4676-8537-721dc50914b5 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-030c1613-a8ff-4b06-9b6c-5f15d26c861b" released by "delete_snapshot" :: held 1.504s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:21 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-536eea37-d535-4676-8537-721dc50914b5 tempest-ProjectMemberTests-1654965068 None] Created reservations ['36082940-1f6d-4cf1-be11-e31a3f81abc3', '4c572662-f40a-45fc-a190-6458ad4cbbe4', '2d04d4a3-8fca-4542-9c1d-38fe3e8a73f7', 'dc847387-bf66-454f-8bca-e7b0b606cab1'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:59:21 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-536eea37-d535-4676-8537-721dc50914b5 tempest-ProjectMemberTests-1654965068 None] Delete snapshot completed successfully. Sep 10 16:59:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-536eea37-d535-4676-8537-721dc50914b5 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-831039e5-aa6d-4717-805d-98b1563af1c0-delete_snapshot" released by "delete_snapshot" :: held 1.644s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:21 devstack sudo[109158]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-661f3128-f156-4d9f-8e59-64de17c3ce76 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b.deb34e16-0193-422e-902a-5631e1e27abf 1G" returned: 0 in 0.410s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-661f3128-f156-4d9f-8e59-64de17c3ce76 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-036b6e60-4656-4d51-961d-9f946d238e7b -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b.deb34e16-0193-422e-902a-5631e1e27abf {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:21 devstack sudo[109164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-036b6e60-4656-4d51-961d-9f946d238e7b -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b.deb34e16-0193-422e-902a-5631e1e27abf Sep 10 16:59:21 devstack sudo[109164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:21 devstack sudo[109164]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-661f3128-f156-4d9f-8e59-64de17c3ce76 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-036b6e60-4656-4d51-961d-9f946d238e7b -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b.deb34e16-0193-422e-902a-5631e1e27abf" returned: 0 in 0.298s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:21 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-661f3128-f156-4d9f-8e59-64de17c3ce76 tempest-ProjectReaderTests-2110561421 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b.deb34e16-0193-422e-902a-5631e1e27abf is being set with open permissions: ugo+rw Sep 10 16:59:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-661f3128-f156-4d9f-8e59-64de17c3ce76 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b.deb34e16-0193-422e-902a-5631e1e27abf {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:21 devstack sudo[109170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b.deb34e16-0193-422e-902a-5631e1e27abf Sep 10 16:59:21 devstack sudo[109170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-e99a5e46-045f-4301-927a-fc1cd6e6ba11 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-030c1613-a8ff-4b06-9b6c-5f15d26c861b-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-e99a5e46-045f-4301-927a-fc1cd6e6ba11 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-030c1613-a8ff-4b06-9b6c-5f15d26c861b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-e99a5e46-045f-4301-927a-fc1cd6e6ba11 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-quobyte-030c1613-a8ff-4b06-9b6c-5f15d26c861b" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:21 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-e99a5e46-045f-4301-927a-fc1cd6e6ba11 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-030c1613-a8ff-4b06-9b6c-5f15d26c861b" acquired by "delete_volume" :: waited 0.016s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:22 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa66ed8-0b7d-4620-b495-1dd42e3501ef]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e99a5e46-045f-4301-927a-fc1cd6e6ba11 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:22 devstack sudo[109170]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-661f3128-f156-4d9f-8e59-64de17c3ce76 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b.deb34e16-0193-422e-902a-5631e1e27abf" returned: 0 in 0.259s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-661f3128-f156-4d9f-8e59-64de17c3ce76 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:22 devstack sudo[109172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b Sep 10 16:59:22 devstack sudo[109172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:22 devstack sudo[109174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b.info Sep 10 16:59:22 devstack sudo[109174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:22 devstack sudo[109174]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-661f3128-f156-4d9f-8e59-64de17c3ce76 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b.info" returned: 0 in 0.251s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:22 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-661f3128-f156-4d9f-8e59-64de17c3ce76 tempest-ProjectReaderTests-2110561421 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b.info is being set with open permissions: ugo+rw Sep 10 16:59:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-661f3128-f156-4d9f-8e59-64de17c3ce76 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:22 devstack sudo[109172]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e99a5e46-045f-4301-927a-fc1cd6e6ba11 tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b" returned: 0 in 0.364s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e99a5e46-045f-4301-927a-fc1cd6e6ba11 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:22 devstack sudo[109181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b.info Sep 10 16:59:22 devstack sudo[109181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:22 devstack sudo[109182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b Sep 10 16:59:22 devstack sudo[109182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:22 devstack sudo[109181]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-661f3128-f156-4d9f-8e59-64de17c3ce76 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b.info" returned: 0 in 0.249s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:22 devstack sudo[109182]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-661f3128-f156-4d9f-8e59-64de17c3ce76 tempest-ProjectReaderTests-2110561421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.934s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e99a5e46-045f-4301-927a-fc1cd6e6ba11 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-030c1613-a8ff-4b06-9b6c-5f15d26c861b" returned: 0 in 0.259s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:22 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-e99a5e46-045f-4301-927a-fc1cd6e6ba11 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-030c1613-a8ff-4b06-9b6c-5f15d26c861b" released by "delete_volume" :: held 0.685s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:22 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-661f3128-f156-4d9f-8e59-64de17c3ce76 tempest-ProjectReaderTests-2110561421 None] Create snapshot completed successfully Sep 10 16:59:22 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-e99a5e46-045f-4301-927a-fc1cd6e6ba11 tempest-ProjectMemberTests-1654965068 None] Created reservations ['c209d836-e194-4402-9628-68a5651ad452', '90c35788-69c2-4bb6-8302-14e5776f42e9', 'ae5c8404-db9e-4f59-a327-4615af3c771d', '7d6ab5a3-c25a-4c9c-9236-32993553a4c7'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:59:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e99a5e46-045f-4301-927a-fc1cd6e6ba11 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e99a5e46-045f-4301-927a-fc1cd6e6ba11 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:22 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-e99a5e46-045f-4301-927a-fc1cd6e6ba11 tempest-ProjectMemberTests-1654965068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:59:22 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-e99a5e46-045f-4301-927a-fc1cd6e6ba11 tempest-ProjectMemberTests-1654965068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:59:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e99a5e46-045f-4301-927a-fc1cd6e6ba11 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e99a5e46-045f-4301-927a-fc1cd6e6ba11 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:22 devstack sudo[109187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:59:22 devstack sudo[109187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:22 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-df10ad75-7748-4b1b-a336-1c2696eb7ee8 tempest-ProjectReaderTests-2110561421 None] Acquiring lock "cinder-deb34e16-0193-422e-902a-5631e1e27abf-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:22 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-df10ad75-7748-4b1b-a336-1c2696eb7ee8 tempest-ProjectReaderTests-2110561421 None] Lock "cinder-deb34e16-0193-422e-902a-5631e1e27abf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:22 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-df10ad75-7748-4b1b-a336-1c2696eb7ee8 tempest-ProjectReaderTests-2110561421 None] Acquiring lock "cinder-quobyte-036b6e60-4656-4d51-961d-9f946d238e7b" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:22 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-df10ad75-7748-4b1b-a336-1c2696eb7ee8 tempest-ProjectReaderTests-2110561421 None] Lock "cinder-quobyte-036b6e60-4656-4d51-961d-9f946d238e7b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:22 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-df10ad75-7748-4b1b-a336-1c2696eb7ee8 tempest-ProjectReaderTests-2110561421 None] Acquiring lock "cinder-quobyte-deb34e16-0193-422e-902a-5631e1e27abf" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:22 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-df10ad75-7748-4b1b-a336-1c2696eb7ee8 tempest-ProjectReaderTests-2110561421 None] Lock "cinder-quobyte-deb34e16-0193-422e-902a-5631e1e27abf" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:22 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-df10ad75-7748-4b1b-a336-1c2696eb7ee8 tempest-ProjectReaderTests-2110561421 None] Deleting offline snapshot deb34e16-0193-422e-902a-5631e1e27abf of volume 036b6e60-4656-4d51-961d-9f946d238e7b {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:59:22 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-df10ad75-7748-4b1b-a336-1c2696eb7ee8 tempest-ProjectReaderTests-2110561421 None] snapshot_file for this snap is: volume-036b6e60-4656-4d51-961d-9f946d238e7b.deb34e16-0193-422e-902a-5631e1e27abf {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:59:22 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac96e57-e25d-4d4e-a32d-b0f735d8ecc2]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-df10ad75-7748-4b1b-a336-1c2696eb7ee8 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b.deb34e16-0193-422e-902a-5631e1e27abf {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:23 devstack sudo[109189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b.deb34e16-0193-422e-902a-5631e1e27abf Sep 10 16:59:23 devstack sudo[109189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:23 devstack sudo[109187]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e99a5e46-045f-4301-927a-fc1cd6e6ba11 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.279s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:23 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-e99a5e46-045f-4301-927a-fc1cd6e6ba11 tempest-ProjectMemberTests-1654965068 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:59:23 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-e99a5e46-045f-4301-927a-fc1cd6e6ba11 tempest-ProjectMemberTests-1654965068 None] Deleted volume successfully. Sep 10 16:59:23 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-e99a5e46-045f-4301-927a-fc1cd6e6ba11 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-030c1613-a8ff-4b06-9b6c-5f15d26c861b-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:23 devstack sudo[109189]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-df10ad75-7748-4b1b-a336-1c2696eb7ee8 tempest-ProjectReaderTests-2110561421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b.deb34e16-0193-422e-902a-5631e1e27abf" returned: 0 in 0.394s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:23 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-df10ad75-7748-4b1b-a336-1c2696eb7ee8 tempest-ProjectReaderTests-2110561421 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-036b6e60-4656-4d51-961d-9f946d238e7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:59:23 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[03885508-638d-4fc6-9e80-f28706f2b5fd]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-df10ad75-7748-4b1b-a336-1c2696eb7ee8 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:23 devstack sudo[109196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b Sep 10 16:59:23 devstack sudo[109196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:23 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e4faa6e-c01b-4c26-8147-0dce18162467 tempest-ProjectMemberTests-1654965068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:59:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3e4faa6e-c01b-4c26-8147-0dce18162467 tempest-ProjectMemberTests-1654965068 None] Flow 'volume_create_manager' (983b511a-2219-4d31-b8b2-39833cc1a1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:59:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3e4faa6e-c01b-4c26-8147-0dce18162467 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48c38f7c-f08d-4ad1-8761-c862fee853b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3e4faa6e-c01b-4c26-8147-0dce18162467 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48c38f7c-f08d-4ad1-8761-c862fee853b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:59:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-368486994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3d07f38-93b2-49d6-bf7d-f9786acf762e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fdc4b0dbad645d8bc3672158e8e45da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:59:23Z,use_quota=True,user_id='4d7a8be540c54a1e9a03d51feae99641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3e4faa6e-c01b-4c26-8147-0dce18162467 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8de14db-fd14-4e3a-908b-492a5a17b6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3e4faa6e-c01b-4c26-8147-0dce18162467 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8de14db-fd14-4e3a-908b-492a5a17b6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3e4faa6e-c01b-4c26-8147-0dce18162467 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77648abd-3670-471b-ae44-f70c90e0c9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3e4faa6e-c01b-4c26-8147-0dce18162467 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77648abd-3670-471b-ae44-f70c90e0c9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3d07f38-93b2-49d6-bf7d-f9786acf762e', 'volume_name': 'volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3e4faa6e-c01b-4c26-8147-0dce18162467 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d4330d7-f6d5-4889-a87d-6eeda89fc4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3e4faa6e-c01b-4c26-8147-0dce18162467 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d4330d7-f6d5-4889-a87d-6eeda89fc4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:23 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3e4faa6e-c01b-4c26-8147-0dce18162467 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65aa80f9-10a4-4c48-8ae4-a32997b9433e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:23 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-3e4faa6e-c01b-4c26-8147-0dce18162467 tempest-ProjectMemberTests-1654965068 None] Volume b3d07f38-93b2-49d6-bf7d-f9786acf762e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e', 'volume_size': 1} Sep 10 16:59:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3e4faa6e-c01b-4c26-8147-0dce18162467 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3e4faa6e-c01b-4c26-8147-0dce18162467 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:23 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3e4faa6e-c01b-4c26-8147-0dce18162467 tempest-ProjectMemberTests-1654965068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:59:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-368486994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3d07f38-93b2-49d6-bf7d-f9786acf762e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fdc4b0dbad645d8bc3672158e8e45da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:59:23Z,use_quota=True,user_id='4d7a8be540c54a1e9a03d51feae99641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:59:23 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-3e4faa6e-c01b-4c26-8147-0dce18162467 tempest-ProjectMemberTests-1654965068 None] Creating volume b3d07f38-93b2-49d6-bf7d-f9786acf762e {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:59:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3e4faa6e-c01b-4c26-8147-0dce18162467 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3e4faa6e-c01b-4c26-8147-0dce18162467 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:23 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3e4faa6e-c01b-4c26-8147-0dce18162467 tempest-ProjectMemberTests-1654965068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:59:23 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3e4faa6e-c01b-4c26-8147-0dce18162467 tempest-ProjectMemberTests-1654965068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:59:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3e4faa6e-c01b-4c26-8147-0dce18162467 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:23 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3e4faa6e-c01b-4c26-8147-0dce18162467 tempest-ProjectMemberTests-1654965068 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:59:23 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-3e4faa6e-c01b-4c26-8147-0dce18162467 tempest-ProjectMemberTests-1654965068 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:59:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3e4faa6e-c01b-4c26-8147-0dce18162467 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:23 devstack sudo[109198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e 1073741824 Sep 10 16:59:23 devstack sudo[109198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:23 devstack sudo[109196]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-df10ad75-7748-4b1b-a336-1c2696eb7ee8 tempest-ProjectReaderTests-2110561421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b" returned: 0 in 0.379s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-df10ad75-7748-4b1b-a336-1c2696eb7ee8 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b.deb34e16-0193-422e-902a-5631e1e27abf {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:23 devstack sudo[109203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b.deb34e16-0193-422e-902a-5631e1e27abf Sep 10 16:59:23 devstack sudo[109203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:24 devstack sudo[109198]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3e4faa6e-c01b-4c26-8147-0dce18162467 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e 1073741824" returned: 0 in 0.435s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3e4faa6e-c01b-4c26-8147-0dce18162467 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:24 devstack sudo[109212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e Sep 10 16:59:24 devstack sudo[109212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:24 devstack sudo[109203]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-df10ad75-7748-4b1b-a336-1c2696eb7ee8 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b.deb34e16-0193-422e-902a-5631e1e27abf" returned: 0 in 0.388s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-df10ad75-7748-4b1b-a336-1c2696eb7ee8 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b.deb34e16-0193-422e-902a-5631e1e27abf {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:24 devstack sudo[109214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b.deb34e16-0193-422e-902a-5631e1e27abf Sep 10 16:59:24 devstack sudo[109214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:24 devstack sudo[109212]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-3e4faa6e-c01b-4c26-8147-0dce18162467 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e" returned: 0 in 0.244s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:24 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-3e4faa6e-c01b-4c26-8147-0dce18162467 tempest-ProjectMemberTests-1654965068 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:59:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-3e4faa6e-c01b-4c26-8147-0dce18162467 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:24 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3e4faa6e-c01b-4c26-8147-0dce18162467 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65aa80f9-10a4-4c48-8ae4-a32997b9433e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:24 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3e4faa6e-c01b-4c26-8147-0dce18162467 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4150b327-6a6b-4e34-94b5-90ed6f470023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:24 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-3e4faa6e-c01b-4c26-8147-0dce18162467 tempest-ProjectMemberTests-1654965068 None] Volume volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e (b3d07f38-93b2-49d6-bf7d-f9786acf762e): created successfully Sep 10 16:59:24 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3e4faa6e-c01b-4c26-8147-0dce18162467 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4150b327-6a6b-4e34-94b5-90ed6f470023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:24 devstack sudo[109214]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:24 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-3e4faa6e-c01b-4c26-8147-0dce18162467 tempest-ProjectMemberTests-1654965068 None] Flow 'volume_create_manager' (983b511a-2219-4d31-b8b2-39833cc1a1a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:59:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-df10ad75-7748-4b1b-a336-1c2696eb7ee8 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b.deb34e16-0193-422e-902a-5631e1e27abf" returned: 0 in 0.253s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:24 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-df10ad75-7748-4b1b-a336-1c2696eb7ee8 tempest-ProjectReaderTests-2110561421 None] Lock "cinder-quobyte-deb34e16-0193-422e-902a-5631e1e27abf" released by "_delete_snapshot" :: held 1.518s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:24 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-3e4faa6e-c01b-4c26-8147-0dce18162467 tempest-ProjectMemberTests-1654965068 None] Created volume successfully. Sep 10 16:59:24 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-df10ad75-7748-4b1b-a336-1c2696eb7ee8 tempest-ProjectReaderTests-2110561421 None] Lock "cinder-quobyte-036b6e60-4656-4d51-961d-9f946d238e7b" released by "delete_snapshot" :: held 1.546s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:24 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-df10ad75-7748-4b1b-a336-1c2696eb7ee8 tempest-ProjectReaderTests-2110561421 None] Created reservations ['cf5df2a8-262f-4591-b058-d300d404be26', '7c60cc58-bd53-45ac-a119-cf1f2eeb3738', '372057cf-ac6d-4379-b929-f4b07b597925', '1e8adc31-b19d-4226-bd9c-703fb2fc663a'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:59:24 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-df10ad75-7748-4b1b-a336-1c2696eb7ee8 tempest-ProjectReaderTests-2110561421 None] Delete snapshot completed successfully. Sep 10 16:59:24 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-df10ad75-7748-4b1b-a336-1c2696eb7ee8 tempest-ProjectReaderTests-2110561421 None] Lock "cinder-deb34e16-0193-422e-902a-5631e1e27abf-delete_snapshot" released by "delete_snapshot" :: held 1.700s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-75b92342-afcb-4186-a1bd-0d0de25edd28 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-75b92342-afcb-4186-a1bd-0d0de25edd28 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:24 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-75b92342-afcb-4186-a1bd-0d0de25edd28 tempest-ProjectMemberTests-1654965068 None] Creating offline snapshot efffb18c-1a16-4eec-9032-6c5af06377c0 of volume b3d07f38-93b2-49d6-bf7d-f9786acf762e {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:59:24 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50a9d77-e63b-420b-9360-d9e28082c49f]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-75b92342-afcb-4186-a1bd-0d0de25edd28 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:24 devstack sudo[109218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e Sep 10 16:59:24 devstack sudo[109218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:24 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-11a222a4-d3ca-465c-a7f5-f86893f4f421 tempest-ProjectReaderTests-2110561421 None] Acquiring lock "cinder-036b6e60-4656-4d51-961d-9f946d238e7b-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:25 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-11a222a4-d3ca-465c-a7f5-f86893f4f421 tempest-ProjectReaderTests-2110561421 None] Lock "cinder-036b6e60-4656-4d51-961d-9f946d238e7b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:25 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-11a222a4-d3ca-465c-a7f5-f86893f4f421 tempest-ProjectReaderTests-2110561421 None] Acquiring lock "cinder-quobyte-036b6e60-4656-4d51-961d-9f946d238e7b" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:25 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-11a222a4-d3ca-465c-a7f5-f86893f4f421 tempest-ProjectReaderTests-2110561421 None] Lock "cinder-quobyte-036b6e60-4656-4d51-961d-9f946d238e7b" acquired by "delete_volume" :: waited 0.015s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:25 devstack sudo[109218]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-75b92342-afcb-4186-a1bd-0d0de25edd28 tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e" returned: 0 in 0.384s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-75b92342-afcb-4186-a1bd-0d0de25edd28 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e.efffb18c-1a16-4eec-9032-6c5af06377c0 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:25 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1298d00f-e47f-452d-8965-707bde22c352]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-11a222a4-d3ca-465c-a7f5-f86893f4f421 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:25 devstack sudo[109224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e.efffb18c-1a16-4eec-9032-6c5af06377c0 1G Sep 10 16:59:25 devstack sudo[109224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:25 devstack sudo[109225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b Sep 10 16:59:25 devstack sudo[109225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:25 devstack sudo[109225]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-11a222a4-d3ca-465c-a7f5-f86893f4f421 tempest-ProjectReaderTests-2110561421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b" returned: 0 in 0.354s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-11a222a4-d3ca-465c-a7f5-f86893f4f421 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:25 devstack sudo[109224]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-75b92342-afcb-4186-a1bd-0d0de25edd28 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e.efffb18c-1a16-4eec-9032-6c5af06377c0 1G" returned: 0 in 0.387s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-75b92342-afcb-4186-a1bd-0d0de25edd28 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e.efffb18c-1a16-4eec-9032-6c5af06377c0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:25 devstack sudo[109235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b Sep 10 16:59:25 devstack sudo[109235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:25 devstack sudo[109237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e.efffb18c-1a16-4eec-9032-6c5af06377c0 Sep 10 16:59:25 devstack sudo[109237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:25 devstack sudo[109235]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-11a222a4-d3ca-465c-a7f5-f86893f4f421 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-036b6e60-4656-4d51-961d-9f946d238e7b" returned: 0 in 0.268s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:25 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-11a222a4-d3ca-465c-a7f5-f86893f4f421 tempest-ProjectReaderTests-2110561421 None] Lock "cinder-quobyte-036b6e60-4656-4d51-961d-9f946d238e7b" released by "delete_volume" :: held 0.682s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:25 devstack sudo[109237]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-75b92342-afcb-4186-a1bd-0d0de25edd28 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e.efffb18c-1a16-4eec-9032-6c5af06377c0" returned: 0 in 0.309s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:25 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-75b92342-afcb-4186-a1bd-0d0de25edd28 tempest-ProjectMemberTests-1654965068 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e.efffb18c-1a16-4eec-9032-6c5af06377c0 is being set with open permissions: ugo+rw Sep 10 16:59:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-75b92342-afcb-4186-a1bd-0d0de25edd28 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e.efffb18c-1a16-4eec-9032-6c5af06377c0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:25 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-11a222a4-d3ca-465c-a7f5-f86893f4f421 tempest-ProjectReaderTests-2110561421 None] Created reservations ['dc5f2743-f677-4391-a59d-c5d0735516b6', '4f9ed9f6-4890-42fb-a89a-230077f107f1', 'a532fd13-81d1-472b-b52e-fb7ae8aa8451', '239c1bf0-cc9a-4565-b533-795ee12cf78c'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:59:25 devstack sudo[109250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e.efffb18c-1a16-4eec-9032-6c5af06377c0 Sep 10 16:59:25 devstack sudo[109250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-11a222a4-d3ca-465c-a7f5-f86893f4f421 tempest-ProjectReaderTests-2110561421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-11a222a4-d3ca-465c-a7f5-f86893f4f421 tempest-ProjectReaderTests-2110561421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-11a222a4-d3ca-465c-a7f5-f86893f4f421 tempest-ProjectReaderTests-2110561421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:59:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-11a222a4-d3ca-465c-a7f5-f86893f4f421 tempest-ProjectReaderTests-2110561421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:59:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-11a222a4-d3ca-465c-a7f5-f86893f4f421 tempest-ProjectReaderTests-2110561421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-11a222a4-d3ca-465c-a7f5-f86893f4f421 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:25 devstack sudo[109252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:59:25 devstack sudo[109252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:26 devstack sudo[109250]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-75b92342-afcb-4186-a1bd-0d0de25edd28 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e.efffb18c-1a16-4eec-9032-6c5af06377c0" returned: 0 in 0.245s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-75b92342-afcb-4186-a1bd-0d0de25edd28 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:26 devstack sudo[109255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e.info Sep 10 16:59:26 devstack sudo[109255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:26 devstack sudo[109252]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-11a222a4-d3ca-465c-a7f5-f86893f4f421 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.254s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-11a222a4-d3ca-465c-a7f5-f86893f4f421 tempest-ProjectReaderTests-2110561421 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:59:26 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-11a222a4-d3ca-465c-a7f5-f86893f4f421 tempest-ProjectReaderTests-2110561421 None] Deleted volume successfully. Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-11a222a4-d3ca-465c-a7f5-f86893f4f421 tempest-ProjectReaderTests-2110561421 None] Lock "cinder-036b6e60-4656-4d51-961d-9f946d238e7b-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:26 devstack sudo[109255]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-75b92342-afcb-4186-a1bd-0d0de25edd28 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e.info" returned: 0 in 0.271s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:26 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-75b92342-afcb-4186-a1bd-0d0de25edd28 tempest-ProjectMemberTests-1654965068 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e.info is being set with open permissions: ugo+rw Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-75b92342-afcb-4186-a1bd-0d0de25edd28 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:26 devstack sudo[109259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e.info Sep 10 16:59:26 devstack sudo[109259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:26 devstack sudo[109259]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-75b92342-afcb-4186-a1bd-0d0de25edd28 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e.info" returned: 0 in 0.262s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-75b92342-afcb-4186-a1bd-0d0de25edd28 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.941s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:26 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-75b92342-afcb-4186-a1bd-0d0de25edd28 tempest-ProjectMemberTests-1654965068 None] Create snapshot completed successfully Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-29289683-9bcf-424c-b5f9-162c083622ba tempest-ProjectReaderTests-2110561421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-29289683-9bcf-424c-b5f9-162c083622ba tempest-ProjectReaderTests-2110561421 None] Flow 'volume_create_manager' (a6951ee5-2746-4d2e-a1b9-f32e1f49617f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-29289683-9bcf-424c-b5f9-162c083622ba tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36685a21-6cdd-4fc8-849c-3e9b1010c142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-29289683-9bcf-424c-b5f9-162c083622ba tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36685a21-6cdd-4fc8-849c-3e9b1010c142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1543900943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47a6a7c5-da22-4960-b5d3-5bef729aae13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfe575cf67994730b27c40255f732200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:59:27Z,use_quota=True,user_id='767a2dafef0c46a7b707405a09806384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-29289683-9bcf-424c-b5f9-162c083622ba tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (402ede8f-10a7-4c0f-840e-9aaaa7124838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-29289683-9bcf-424c-b5f9-162c083622ba tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (402ede8f-10a7-4c0f-840e-9aaaa7124838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-29289683-9bcf-424c-b5f9-162c083622ba tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (373798e3-9bb2-4fe7-833c-8084e90befe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-29289683-9bcf-424c-b5f9-162c083622ba tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (373798e3-9bb2-4fe7-833c-8084e90befe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47a6a7c5-da22-4960-b5d3-5bef729aae13', 'volume_name': 'volume-47a6a7c5-da22-4960-b5d3-5bef729aae13', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-29289683-9bcf-424c-b5f9-162c083622ba tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309f11bd-365f-49fb-abb0-2f98ef167e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-29289683-9bcf-424c-b5f9-162c083622ba tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309f11bd-365f-49fb-abb0-2f98ef167e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-29289683-9bcf-424c-b5f9-162c083622ba tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3c1d689-f0f8-4904-942e-b2e476f80cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:26 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-29289683-9bcf-424c-b5f9-162c083622ba tempest-ProjectReaderTests-2110561421 None] Volume 47a6a7c5-da22-4960-b5d3-5bef729aae13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47a6a7c5-da22-4960-b5d3-5bef729aae13', 'volume_size': 1} Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-29289683-9bcf-424c-b5f9-162c083622ba tempest-ProjectReaderTests-2110561421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-29289683-9bcf-424c-b5f9-162c083622ba tempest-ProjectReaderTests-2110561421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-29289683-9bcf-424c-b5f9-162c083622ba tempest-ProjectReaderTests-2110561421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1543900943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47a6a7c5-da22-4960-b5d3-5bef729aae13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfe575cf67994730b27c40255f732200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:59:27Z,use_quota=True,user_id='767a2dafef0c46a7b707405a09806384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-29289683-9bcf-424c-b5f9-162c083622ba tempest-ProjectReaderTests-2110561421 None] Creating volume 47a6a7c5-da22-4960-b5d3-5bef729aae13 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-29289683-9bcf-424c-b5f9-162c083622ba tempest-ProjectReaderTests-2110561421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-29289683-9bcf-424c-b5f9-162c083622ba tempest-ProjectReaderTests-2110561421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-29289683-9bcf-424c-b5f9-162c083622ba tempest-ProjectReaderTests-2110561421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-29289683-9bcf-424c-b5f9-162c083622ba tempest-ProjectReaderTests-2110561421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-29289683-9bcf-424c-b5f9-162c083622ba tempest-ProjectReaderTests-2110561421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-29289683-9bcf-424c-b5f9-162c083622ba tempest-ProjectReaderTests-2110561421 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:59:26 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-29289683-9bcf-424c-b5f9-162c083622ba tempest-ProjectReaderTests-2110561421 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-29289683-9bcf-424c-b5f9-162c083622ba tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:26 devstack sudo[109262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13 1073741824 Sep 10 16:59:26 devstack sudo[109262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-724c9703-0ba0-4354-9984-55592bf106d9 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-efffb18c-1a16-4eec-9032-6c5af06377c0-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-724c9703-0ba0-4354-9984-55592bf106d9 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-efffb18c-1a16-4eec-9032-6c5af06377c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-724c9703-0ba0-4354-9984-55592bf106d9 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-quobyte-b3d07f38-93b2-49d6-bf7d-f9786acf762e" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-724c9703-0ba0-4354-9984-55592bf106d9 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-b3d07f38-93b2-49d6-bf7d-f9786acf762e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-724c9703-0ba0-4354-9984-55592bf106d9 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-quobyte-efffb18c-1a16-4eec-9032-6c5af06377c0" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-724c9703-0ba0-4354-9984-55592bf106d9 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-efffb18c-1a16-4eec-9032-6c5af06377c0" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-724c9703-0ba0-4354-9984-55592bf106d9 tempest-ProjectMemberTests-1654965068 None] Deleting offline snapshot efffb18c-1a16-4eec-9032-6c5af06377c0 of volume b3d07f38-93b2-49d6-bf7d-f9786acf762e {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-724c9703-0ba0-4354-9984-55592bf106d9 tempest-ProjectMemberTests-1654965068 None] snapshot_file for this snap is: volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e.efffb18c-1a16-4eec-9032-6c5af06377c0 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc9d86e-4a56-4091-8bc0-a5771f3a5af3]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:26 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-724c9703-0ba0-4354-9984-55592bf106d9 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e.efffb18c-1a16-4eec-9032-6c5af06377c0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:27 devstack sudo[109264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e.efffb18c-1a16-4eec-9032-6c5af06377c0 Sep 10 16:59:27 devstack sudo[109264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:27 devstack sudo[109262]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-29289683-9bcf-424c-b5f9-162c083622ba tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13 1073741824" returned: 0 in 0.416s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-29289683-9bcf-424c-b5f9-162c083622ba tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:27 devstack sudo[109269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13 Sep 10 16:59:27 devstack sudo[109269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:27 devstack sudo[109264]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-724c9703-0ba0-4354-9984-55592bf106d9 tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e.efffb18c-1a16-4eec-9032-6c5af06377c0" returned: 0 in 0.365s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-724c9703-0ba0-4354-9984-55592bf106d9 tempest-ProjectMemberTests-1654965068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:59:27 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7036b7f6-6ced-4af4-8bda-d0d1927b4e8b]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-724c9703-0ba0-4354-9984-55592bf106d9 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:27 devstack sudo[109274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e Sep 10 16:59:27 devstack sudo[109274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:27 devstack sudo[109269]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-29289683-9bcf-424c-b5f9-162c083622ba tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13" returned: 0 in 0.255s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-29289683-9bcf-424c-b5f9-162c083622ba tempest-ProjectReaderTests-2110561421 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:59:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-29289683-9bcf-424c-b5f9-162c083622ba tempest-ProjectReaderTests-2110561421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-29289683-9bcf-424c-b5f9-162c083622ba tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3c1d689-f0f8-4904-942e-b2e476f80cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47a6a7c5-da22-4960-b5d3-5bef729aae13', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-29289683-9bcf-424c-b5f9-162c083622ba tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (931a649f-b604-4691-8477-8089293370c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:27 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-29289683-9bcf-424c-b5f9-162c083622ba tempest-ProjectReaderTests-2110561421 None] Volume volume-47a6a7c5-da22-4960-b5d3-5bef729aae13 (47a6a7c5-da22-4960-b5d3-5bef729aae13): created successfully Sep 10 16:59:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-29289683-9bcf-424c-b5f9-162c083622ba tempest-ProjectReaderTests-2110561421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (931a649f-b604-4691-8477-8089293370c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:27 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-29289683-9bcf-424c-b5f9-162c083622ba tempest-ProjectReaderTests-2110561421 None] Flow 'volume_create_manager' (a6951ee5-2746-4d2e-a1b9-f32e1f49617f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:59:27 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-29289683-9bcf-424c-b5f9-162c083622ba tempest-ProjectReaderTests-2110561421 None] Created volume successfully. Sep 10 16:59:27 devstack sudo[109274]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-724c9703-0ba0-4354-9984-55592bf106d9 tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e" returned: 0 in 0.368s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-724c9703-0ba0-4354-9984-55592bf106d9 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e.efffb18c-1a16-4eec-9032-6c5af06377c0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:27 devstack sudo[109280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e.efffb18c-1a16-4eec-9032-6c5af06377c0 Sep 10 16:59:27 devstack sudo[109280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f33938b4-a3c9-4ce6-803b-91eb5626befc tempest-ProjectReaderTests-2110561421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f33938b4-a3c9-4ce6-803b-91eb5626befc tempest-ProjectReaderTests-2110561421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:27 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-f33938b4-a3c9-4ce6-803b-91eb5626befc tempest-ProjectReaderTests-2110561421 None] Creating offline snapshot 68156800-b063-4874-956c-f7fbe52e98a6 of volume 47a6a7c5-da22-4960-b5d3-5bef729aae13 {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:59:27 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b072dec5-d1d3-43ba-8318-20a23f2e9c39]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:27 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f33938b4-a3c9-4ce6-803b-91eb5626befc tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:27 devstack sudo[109282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13 Sep 10 16:59:27 devstack sudo[109282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:28 devstack sudo[109280]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-724c9703-0ba0-4354-9984-55592bf106d9 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e.efffb18c-1a16-4eec-9032-6c5af06377c0" returned: 0 in 0.333s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-724c9703-0ba0-4354-9984-55592bf106d9 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e.efffb18c-1a16-4eec-9032-6c5af06377c0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:28 devstack sudo[109288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e.efffb18c-1a16-4eec-9032-6c5af06377c0 Sep 10 16:59:28 devstack sudo[109288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:28 devstack sudo[109282]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f33938b4-a3c9-4ce6-803b-91eb5626befc tempest-ProjectReaderTests-2110561421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13" returned: 0 in 0.362s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f33938b4-a3c9-4ce6-803b-91eb5626befc tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13.68156800-b063-4874-956c-f7fbe52e98a6 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:28 devstack sudo[109293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13.68156800-b063-4874-956c-f7fbe52e98a6 1G Sep 10 16:59:28 devstack sudo[109293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:28 devstack sudo[109288]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-724c9703-0ba0-4354-9984-55592bf106d9 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e.efffb18c-1a16-4eec-9032-6c5af06377c0" returned: 0 in 0.251s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:28 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-724c9703-0ba0-4354-9984-55592bf106d9 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-efffb18c-1a16-4eec-9032-6c5af06377c0" released by "_delete_snapshot" :: held 1.404s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:28 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-724c9703-0ba0-4354-9984-55592bf106d9 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-b3d07f38-93b2-49d6-bf7d-f9786acf762e" released by "delete_snapshot" :: held 1.431s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:28 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-724c9703-0ba0-4354-9984-55592bf106d9 tempest-ProjectMemberTests-1654965068 None] Created reservations ['76558ab4-045a-46cc-be19-6bd50c074943', '5976a00d-53db-4dc0-97b8-d9195c5a5544', 'dbc9aa8e-758f-4f70-a40f-40fa184daedb', 'ebcfd003-49db-48d7-8bb6-a08e9eaf586f'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:59:28 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-724c9703-0ba0-4354-9984-55592bf106d9 tempest-ProjectMemberTests-1654965068 None] Delete snapshot completed successfully. Sep 10 16:59:28 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-724c9703-0ba0-4354-9984-55592bf106d9 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-efffb18c-1a16-4eec-9032-6c5af06377c0-delete_snapshot" released by "delete_snapshot" :: held 1.590s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:28 devstack sudo[109293]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f33938b4-a3c9-4ce6-803b-91eb5626befc tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13.68156800-b063-4874-956c-f7fbe52e98a6 1G" returned: 0 in 0.387s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f33938b4-a3c9-4ce6-803b-91eb5626befc tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47a6a7c5-da22-4960-b5d3-5bef729aae13 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13.68156800-b063-4874-956c-f7fbe52e98a6 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:28 devstack sudo[109299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47a6a7c5-da22-4960-b5d3-5bef729aae13 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13.68156800-b063-4874-956c-f7fbe52e98a6 Sep 10 16:59:28 devstack sudo[109299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:28 devstack sudo[109299]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f33938b4-a3c9-4ce6-803b-91eb5626befc tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47a6a7c5-da22-4960-b5d3-5bef729aae13 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13.68156800-b063-4874-956c-f7fbe52e98a6" returned: 0 in 0.280s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:28 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-f33938b4-a3c9-4ce6-803b-91eb5626befc tempest-ProjectReaderTests-2110561421 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13.68156800-b063-4874-956c-f7fbe52e98a6 is being set with open permissions: ugo+rw Sep 10 16:59:28 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f33938b4-a3c9-4ce6-803b-91eb5626befc tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13.68156800-b063-4874-956c-f7fbe52e98a6 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:28 devstack sudo[109304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13.68156800-b063-4874-956c-f7fbe52e98a6 Sep 10 16:59:28 devstack sudo[109304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:28 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-832a151e-e3ab-402b-8bd7-d894559c0d7c tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-b3d07f38-93b2-49d6-bf7d-f9786acf762e-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:29 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-832a151e-e3ab-402b-8bd7-d894559c0d7c tempest-ProjectMemberTests-1654965068 None] Lock "cinder-b3d07f38-93b2-49d6-bf7d-f9786acf762e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:29 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-832a151e-e3ab-402b-8bd7-d894559c0d7c tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-quobyte-b3d07f38-93b2-49d6-bf7d-f9786acf762e" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:29 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-832a151e-e3ab-402b-8bd7-d894559c0d7c tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-b3d07f38-93b2-49d6-bf7d-f9786acf762e" acquired by "delete_volume" :: waited 0.031s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:29 devstack sudo[109304]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:29 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4d4836-e5ed-4d40-9a46-a9195b1bfe66]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-832a151e-e3ab-402b-8bd7-d894559c0d7c tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f33938b4-a3c9-4ce6-803b-91eb5626befc tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13.68156800-b063-4874-956c-f7fbe52e98a6" returned: 0 in 0.275s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f33938b4-a3c9-4ce6-803b-91eb5626befc tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:29 devstack sudo[109308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13.info Sep 10 16:59:29 devstack sudo[109308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:29 devstack sudo[109307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e Sep 10 16:59:29 devstack sudo[109307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:29 devstack sudo[109308]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f33938b4-a3c9-4ce6-803b-91eb5626befc tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13.info" returned: 0 in 0.261s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:29 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-f33938b4-a3c9-4ce6-803b-91eb5626befc tempest-ProjectReaderTests-2110561421 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13.info is being set with open permissions: ugo+rw Sep 10 16:59:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f33938b4-a3c9-4ce6-803b-91eb5626befc tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:29 devstack sudo[109314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13.info Sep 10 16:59:29 devstack sudo[109314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:29 devstack sudo[109307]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-832a151e-e3ab-402b-8bd7-d894559c0d7c tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e" returned: 0 in 0.370s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-832a151e-e3ab-402b-8bd7-d894559c0d7c tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:29 devstack sudo[109317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e Sep 10 16:59:29 devstack sudo[109317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:29 devstack sudo[109314]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f33938b4-a3c9-4ce6-803b-91eb5626befc tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13.info" returned: 0 in 0.250s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f33938b4-a3c9-4ce6-803b-91eb5626befc tempest-ProjectReaderTests-2110561421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.897s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:29 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-f33938b4-a3c9-4ce6-803b-91eb5626befc tempest-ProjectReaderTests-2110561421 None] Create snapshot completed successfully Sep 10 16:59:29 devstack sudo[109317]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-832a151e-e3ab-402b-8bd7-d894559c0d7c tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-b3d07f38-93b2-49d6-bf7d-f9786acf762e" returned: 0 in 0.277s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:29 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-832a151e-e3ab-402b-8bd7-d894559c0d7c tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-b3d07f38-93b2-49d6-bf7d-f9786acf762e" released by "delete_volume" :: held 0.709s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:29 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-832a151e-e3ab-402b-8bd7-d894559c0d7c tempest-ProjectMemberTests-1654965068 None] Created reservations ['5841de5a-359a-4782-adea-8059a75a62bd', 'a622404a-00b6-4b6f-92dc-465fd64f8df2', 'c33c882e-fa8c-47d2-9053-c55b5a79b197', '7c4a83a1-0cd9-4418-8159-cd7a50874027'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:59:29 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a1366fca-f7ab-4b5e-b0aa-9fba9326b36c tempest-ProjectReaderTests-2110561421 None] Acquiring lock "cinder-68156800-b063-4874-956c-f7fbe52e98a6-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:29 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a1366fca-f7ab-4b5e-b0aa-9fba9326b36c tempest-ProjectReaderTests-2110561421 None] Lock "cinder-68156800-b063-4874-956c-f7fbe52e98a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:29 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a1366fca-f7ab-4b5e-b0aa-9fba9326b36c tempest-ProjectReaderTests-2110561421 None] Acquiring lock "cinder-quobyte-47a6a7c5-da22-4960-b5d3-5bef729aae13" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-832a151e-e3ab-402b-8bd7-d894559c0d7c tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-832a151e-e3ab-402b-8bd7-d894559c0d7c tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:29 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-832a151e-e3ab-402b-8bd7-d894559c0d7c tempest-ProjectMemberTests-1654965068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:59:29 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-832a151e-e3ab-402b-8bd7-d894559c0d7c tempest-ProjectMemberTests-1654965068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:59:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-832a151e-e3ab-402b-8bd7-d894559c0d7c tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-832a151e-e3ab-402b-8bd7-d894559c0d7c tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:29 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a1366fca-f7ab-4b5e-b0aa-9fba9326b36c tempest-ProjectReaderTests-2110561421 None] Lock "cinder-quobyte-47a6a7c5-da22-4960-b5d3-5bef729aae13" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:29 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a1366fca-f7ab-4b5e-b0aa-9fba9326b36c tempest-ProjectReaderTests-2110561421 None] Acquiring lock "cinder-quobyte-68156800-b063-4874-956c-f7fbe52e98a6" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:29 devstack sudo[109321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:59:29 devstack sudo[109321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a1366fca-f7ab-4b5e-b0aa-9fba9326b36c tempest-ProjectReaderTests-2110561421 None] Lock "cinder-quobyte-68156800-b063-4874-956c-f7fbe52e98a6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-a1366fca-f7ab-4b5e-b0aa-9fba9326b36c tempest-ProjectReaderTests-2110561421 None] Deleting offline snapshot 68156800-b063-4874-956c-f7fbe52e98a6 of volume 47a6a7c5-da22-4960-b5d3-5bef729aae13 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-a1366fca-f7ab-4b5e-b0aa-9fba9326b36c tempest-ProjectReaderTests-2110561421 None] snapshot_file for this snap is: volume-47a6a7c5-da22-4960-b5d3-5bef729aae13.68156800-b063-4874-956c-f7fbe52e98a6 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[334cebfb-e90a-4c42-8fe6-19150d4f81a1]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a1366fca-f7ab-4b5e-b0aa-9fba9326b36c tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13.68156800-b063-4874-956c-f7fbe52e98a6 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:30 devstack sudo[109323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13.68156800-b063-4874-956c-f7fbe52e98a6 Sep 10 16:59:30 devstack sudo[109323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:30 devstack sudo[109321]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-832a151e-e3ab-402b-8bd7-d894559c0d7c tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.273s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-832a151e-e3ab-402b-8bd7-d894559c0d7c tempest-ProjectMemberTests-1654965068 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:59:30 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-832a151e-e3ab-402b-8bd7-d894559c0d7c tempest-ProjectMemberTests-1654965068 None] Deleted volume successfully. Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-832a151e-e3ab-402b-8bd7-d894559c0d7c tempest-ProjectMemberTests-1654965068 None] Lock "cinder-b3d07f38-93b2-49d6-bf7d-f9786acf762e-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:30 devstack sudo[109323]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a1366fca-f7ab-4b5e-b0aa-9fba9326b36c tempest-ProjectReaderTests-2110561421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13.68156800-b063-4874-956c-f7fbe52e98a6" returned: 0 in 0.385s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-a1366fca-f7ab-4b5e-b0aa-9fba9326b36c tempest-ProjectReaderTests-2110561421 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47a6a7c5-da22-4960-b5d3-5bef729aae13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf33215-4847-43fa-9896-5c4e72dc123d]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a1366fca-f7ab-4b5e-b0aa-9fba9326b36c tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:30 devstack sudo[109329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13 Sep 10 16:59:30 devstack sudo[109329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-b63157b1-64b2-4b5a-961e-38d348b4d60f tempest-ProjectMemberTests-1654965068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b63157b1-64b2-4b5a-961e-38d348b4d60f tempest-ProjectMemberTests-1654965068 None] Flow 'volume_create_manager' (acc50a05-4447-44f7-ab3b-ba0f105d7f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b63157b1-64b2-4b5a-961e-38d348b4d60f tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (479a27f9-fd37-422a-9797-af9d8ab8411e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b63157b1-64b2-4b5a-961e-38d348b4d60f tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (479a27f9-fd37-422a-9797-af9d8ab8411e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-467643852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=620eaa70-27ca-4d60-bf63-99517b8b1cad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fdc4b0dbad645d8bc3672158e8e45da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:59:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:59:31Z,use_quota=True,user_id='4d7a8be540c54a1e9a03d51feae99641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b63157b1-64b2-4b5a-961e-38d348b4d60f tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0e84098-5f38-4d5d-bf1f-e2e5c48164fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b63157b1-64b2-4b5a-961e-38d348b4d60f tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0e84098-5f38-4d5d-bf1f-e2e5c48164fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b63157b1-64b2-4b5a-961e-38d348b4d60f tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (388564b2-9da4-431b-b246-4dab156aaae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b63157b1-64b2-4b5a-961e-38d348b4d60f tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (388564b2-9da4-431b-b246-4dab156aaae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '620eaa70-27ca-4d60-bf63-99517b8b1cad', 'volume_name': 'volume-620eaa70-27ca-4d60-bf63-99517b8b1cad', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b63157b1-64b2-4b5a-961e-38d348b4d60f tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (414db3f2-2d23-46a9-9e79-c346d1b68f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b63157b1-64b2-4b5a-961e-38d348b4d60f tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (414db3f2-2d23-46a9-9e79-c346d1b68f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b63157b1-64b2-4b5a-961e-38d348b4d60f tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c91f39d-99c2-4e3f-b59b-95ba93bb6806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:30 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-b63157b1-64b2-4b5a-961e-38d348b4d60f tempest-ProjectMemberTests-1654965068 None] Volume 620eaa70-27ca-4d60-bf63-99517b8b1cad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-620eaa70-27ca-4d60-bf63-99517b8b1cad', 'volume_size': 1} Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b63157b1-64b2-4b5a-961e-38d348b4d60f tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b63157b1-64b2-4b5a-961e-38d348b4d60f tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b63157b1-64b2-4b5a-961e-38d348b4d60f tempest-ProjectMemberTests-1654965068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-467643852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=620eaa70-27ca-4d60-bf63-99517b8b1cad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fdc4b0dbad645d8bc3672158e8e45da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:59:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:59:31Z,use_quota=True,user_id='4d7a8be540c54a1e9a03d51feae99641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-b63157b1-64b2-4b5a-961e-38d348b4d60f tempest-ProjectMemberTests-1654965068 None] Creating volume 620eaa70-27ca-4d60-bf63-99517b8b1cad {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b63157b1-64b2-4b5a-961e-38d348b4d60f tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b63157b1-64b2-4b5a-961e-38d348b4d60f tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b63157b1-64b2-4b5a-961e-38d348b4d60f tempest-ProjectMemberTests-1654965068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b63157b1-64b2-4b5a-961e-38d348b4d60f tempest-ProjectMemberTests-1654965068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b63157b1-64b2-4b5a-961e-38d348b4d60f tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b63157b1-64b2-4b5a-961e-38d348b4d60f tempest-ProjectMemberTests-1654965068 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:59:30 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-b63157b1-64b2-4b5a-961e-38d348b4d60f tempest-ProjectMemberTests-1654965068 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b63157b1-64b2-4b5a-961e-38d348b4d60f tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:30 devstack sudo[109331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad 1073741824 Sep 10 16:59:30 devstack sudo[109331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:30 devstack sudo[109329]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a1366fca-f7ab-4b5e-b0aa-9fba9326b36c tempest-ProjectReaderTests-2110561421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13" returned: 0 in 0.380s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a1366fca-f7ab-4b5e-b0aa-9fba9326b36c tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13.68156800-b063-4874-956c-f7fbe52e98a6 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:30 devstack sudo[109337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13.68156800-b063-4874-956c-f7fbe52e98a6 Sep 10 16:59:30 devstack sudo[109337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:31 devstack sudo[109331]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b63157b1-64b2-4b5a-961e-38d348b4d60f tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad 1073741824" returned: 0 in 0.472s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:31 devstack sudo[109337]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a1366fca-f7ab-4b5e-b0aa-9fba9326b36c tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13.68156800-b063-4874-956c-f7fbe52e98a6" returned: 0 in 0.375s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a1366fca-f7ab-4b5e-b0aa-9fba9326b36c tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13.68156800-b063-4874-956c-f7fbe52e98a6 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b63157b1-64b2-4b5a-961e-38d348b4d60f tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:31 devstack sudo[109346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13.68156800-b063-4874-956c-f7fbe52e98a6 Sep 10 16:59:31 devstack sudo[109346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:31 devstack sudo[109347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad Sep 10 16:59:31 devstack sudo[109347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:31 devstack sudo[109347]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:31 devstack sudo[109346]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-b63157b1-64b2-4b5a-961e-38d348b4d60f tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad" returned: 0 in 0.242s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:31 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-b63157b1-64b2-4b5a-961e-38d348b4d60f tempest-ProjectMemberTests-1654965068 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:59:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-b63157b1-64b2-4b5a-961e-38d348b4d60f tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-a1366fca-f7ab-4b5e-b0aa-9fba9326b36c tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13.68156800-b063-4874-956c-f7fbe52e98a6" returned: 0 in 0.265s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b63157b1-64b2-4b5a-961e-38d348b4d60f tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c91f39d-99c2-4e3f-b59b-95ba93bb6806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-620eaa70-27ca-4d60-bf63-99517b8b1cad', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b63157b1-64b2-4b5a-961e-38d348b4d60f tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6d7b49b-799c-41f5-a5c4-f51fb7acebf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:31 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a1366fca-f7ab-4b5e-b0aa-9fba9326b36c tempest-ProjectReaderTests-2110561421 None] Lock "cinder-quobyte-68156800-b063-4874-956c-f7fbe52e98a6" released by "_delete_snapshot" :: held 1.524s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:31 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a1366fca-f7ab-4b5e-b0aa-9fba9326b36c tempest-ProjectReaderTests-2110561421 None] Lock "cinder-quobyte-47a6a7c5-da22-4960-b5d3-5bef729aae13" released by "delete_snapshot" :: held 1.554s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:31 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-b63157b1-64b2-4b5a-961e-38d348b4d60f tempest-ProjectMemberTests-1654965068 None] Volume volume-620eaa70-27ca-4d60-bf63-99517b8b1cad (620eaa70-27ca-4d60-bf63-99517b8b1cad): created successfully Sep 10 16:59:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b63157b1-64b2-4b5a-961e-38d348b4d60f tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6d7b49b-799c-41f5-a5c4-f51fb7acebf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:31 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-b63157b1-64b2-4b5a-961e-38d348b4d60f tempest-ProjectMemberTests-1654965068 None] Flow 'volume_create_manager' (acc50a05-4447-44f7-ab3b-ba0f105d7f25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:59:31 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-b63157b1-64b2-4b5a-961e-38d348b4d60f tempest-ProjectMemberTests-1654965068 None] Created volume successfully. Sep 10 16:59:31 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-a1366fca-f7ab-4b5e-b0aa-9fba9326b36c tempest-ProjectReaderTests-2110561421 None] Created reservations ['2b8aa999-9147-4493-8dc9-eb8504efe040', 'c1716154-368f-4bbf-ab4c-a958fe58ff11', '0906ea3a-358d-49f7-a57d-b70603e45a2b', '32f53e7b-530d-4b52-bb17-7d1e51a17577'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:59:31 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-a1366fca-f7ab-4b5e-b0aa-9fba9326b36c tempest-ProjectReaderTests-2110561421 None] Delete snapshot completed successfully. Sep 10 16:59:31 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-a1366fca-f7ab-4b5e-b0aa-9fba9326b36c tempest-ProjectReaderTests-2110561421 None] Lock "cinder-68156800-b063-4874-956c-f7fbe52e98a6-delete_snapshot" released by "delete_snapshot" :: held 1.723s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:32 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9e5e281e-9880-4e0f-aff5-22a65bf0f428 tempest-ProjectReaderTests-2110561421 None] Acquiring lock "cinder-47a6a7c5-da22-4960-b5d3-5bef729aae13-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:32 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9e5e281e-9880-4e0f-aff5-22a65bf0f428 tempest-ProjectReaderTests-2110561421 None] Lock "cinder-47a6a7c5-da22-4960-b5d3-5bef729aae13-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:32 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9e5e281e-9880-4e0f-aff5-22a65bf0f428 tempest-ProjectReaderTests-2110561421 None] Acquiring lock "cinder-quobyte-47a6a7c5-da22-4960-b5d3-5bef729aae13" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:32 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9e5e281e-9880-4e0f-aff5-22a65bf0f428 tempest-ProjectReaderTests-2110561421 None] Lock "cinder-quobyte-47a6a7c5-da22-4960-b5d3-5bef729aae13" acquired by "delete_volume" :: waited 0.014s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:32 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecfa6dd-e31c-4454-9fd5-9d08c3d0a0ef]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9e5e281e-9880-4e0f-aff5-22a65bf0f428 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:32 devstack sudo[109352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13 Sep 10 16:59:32 devstack sudo[109352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:32 devstack sudo[109352]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9e5e281e-9880-4e0f-aff5-22a65bf0f428 tempest-ProjectReaderTests-2110561421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13" returned: 0 in 0.357s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9e5e281e-9880-4e0f-aff5-22a65bf0f428 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:32 devstack sudo[109357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13 Sep 10 16:59:32 devstack sudo[109357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:32 devstack sudo[109357]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9e5e281e-9880-4e0f-aff5-22a65bf0f428 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-47a6a7c5-da22-4960-b5d3-5bef729aae13" returned: 0 in 0.272s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:32 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9e5e281e-9880-4e0f-aff5-22a65bf0f428 tempest-ProjectReaderTests-2110561421 None] Lock "cinder-quobyte-47a6a7c5-da22-4960-b5d3-5bef729aae13" released by "delete_volume" :: held 0.698s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f8c61f1f-aab0-42a2-8c6d-0926a09d1bb6 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f8c61f1f-aab0-42a2-8c6d-0926a09d1bb6 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-f8c61f1f-aab0-42a2-8c6d-0926a09d1bb6 tempest-ProjectMemberTests-1654965068 None] Creating offline snapshot e1059c5c-e5b9-483a-9ece-3f59a0a0c19e of volume 620eaa70-27ca-4d60-bf63-99517b8b1cad {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:59:32 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8803da9-31e9-4e90-902b-906705959a9f]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f8c61f1f-aab0-42a2-8c6d-0926a09d1bb6 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:32 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-9e5e281e-9880-4e0f-aff5-22a65bf0f428 tempest-ProjectReaderTests-2110561421 None] Created reservations ['ef99c5dc-2a86-422d-9255-d5be96260258', 'c0a91c4e-8ddc-436d-9253-43b020b57063', '28ee7365-dac4-4f86-8adb-c054f5d39b9f', 'a5d509a9-d3ff-4da3-bb08-ecf032d9ff87'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:59:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9e5e281e-9880-4e0f-aff5-22a65bf0f428 tempest-ProjectReaderTests-2110561421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9e5e281e-9880-4e0f-aff5-22a65bf0f428 tempest-ProjectReaderTests-2110561421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:32 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9e5e281e-9880-4e0f-aff5-22a65bf0f428 tempest-ProjectReaderTests-2110561421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:59:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9e5e281e-9880-4e0f-aff5-22a65bf0f428 tempest-ProjectReaderTests-2110561421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:59:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9e5e281e-9880-4e0f-aff5-22a65bf0f428 tempest-ProjectReaderTests-2110561421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9e5e281e-9880-4e0f-aff5-22a65bf0f428 tempest-ProjectReaderTests-2110561421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:33 devstack sudo[109360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad Sep 10 16:59:33 devstack sudo[109360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:33 devstack sudo[109361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:59:33 devstack sudo[109361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:33 devstack sudo[109361]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9e5e281e-9880-4e0f-aff5-22a65bf0f428 tempest-ProjectReaderTests-2110561421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.260s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:33 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-9e5e281e-9880-4e0f-aff5-22a65bf0f428 tempest-ProjectReaderTests-2110561421 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:59:33 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-9e5e281e-9880-4e0f-aff5-22a65bf0f428 tempest-ProjectReaderTests-2110561421 None] Deleted volume successfully. Sep 10 16:59:33 devstack sudo[109360]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f8c61f1f-aab0-42a2-8c6d-0926a09d1bb6 tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad" returned: 0 in 0.370s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f8c61f1f-aab0-42a2-8c6d-0926a09d1bb6 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad.e1059c5c-e5b9-483a-9ece-3f59a0a0c19e 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:33 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9e5e281e-9880-4e0f-aff5-22a65bf0f428 tempest-ProjectReaderTests-2110561421 None] Lock "cinder-47a6a7c5-da22-4960-b5d3-5bef729aae13-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:33 devstack sudo[109368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad.e1059c5c-e5b9-483a-9ece-3f59a0a0c19e 1G Sep 10 16:59:33 devstack sudo[109368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:33 devstack sudo[109368]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f8c61f1f-aab0-42a2-8c6d-0926a09d1bb6 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad.e1059c5c-e5b9-483a-9ece-3f59a0a0c19e 1G" returned: 0 in 0.411s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f8c61f1f-aab0-42a2-8c6d-0926a09d1bb6 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-620eaa70-27ca-4d60-bf63-99517b8b1cad -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad.e1059c5c-e5b9-483a-9ece-3f59a0a0c19e {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:33 devstack sudo[109373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-620eaa70-27ca-4d60-bf63-99517b8b1cad -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad.e1059c5c-e5b9-483a-9ece-3f59a0a0c19e Sep 10 16:59:33 devstack sudo[109373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:33 devstack sudo[109373]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f8c61f1f-aab0-42a2-8c6d-0926a09d1bb6 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-620eaa70-27ca-4d60-bf63-99517b8b1cad -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad.e1059c5c-e5b9-483a-9ece-3f59a0a0c19e" returned: 0 in 0.298s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:33 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-f8c61f1f-aab0-42a2-8c6d-0926a09d1bb6 tempest-ProjectMemberTests-1654965068 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad.e1059c5c-e5b9-483a-9ece-3f59a0a0c19e is being set with open permissions: ugo+rw Sep 10 16:59:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f8c61f1f-aab0-42a2-8c6d-0926a09d1bb6 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad.e1059c5c-e5b9-483a-9ece-3f59a0a0c19e {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:34 devstack sudo[109378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad.e1059c5c-e5b9-483a-9ece-3f59a0a0c19e Sep 10 16:59:34 devstack sudo[109378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:34 devstack sudo[109378]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f8c61f1f-aab0-42a2-8c6d-0926a09d1bb6 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad.e1059c5c-e5b9-483a-9ece-3f59a0a0c19e" returned: 0 in 0.246s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f8c61f1f-aab0-42a2-8c6d-0926a09d1bb6 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:34 devstack sudo[109381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad.info Sep 10 16:59:34 devstack sudo[109381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:34 devstack sudo[109381]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f8c61f1f-aab0-42a2-8c6d-0926a09d1bb6 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad.info" returned: 0 in 0.261s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:34 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-f8c61f1f-aab0-42a2-8c6d-0926a09d1bb6 tempest-ProjectMemberTests-1654965068 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad.info is being set with open permissions: ugo+rw Sep 10 16:59:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f8c61f1f-aab0-42a2-8c6d-0926a09d1bb6 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:34 devstack sudo[109384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad.info Sep 10 16:59:34 devstack sudo[109384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:34 devstack sudo[109384]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f8c61f1f-aab0-42a2-8c6d-0926a09d1bb6 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad.info" returned: 0 in 0.262s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f8c61f1f-aab0-42a2-8c6d-0926a09d1bb6 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.939s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:34 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-f8c61f1f-aab0-42a2-8c6d-0926a09d1bb6 tempest-ProjectMemberTests-1654965068 None] Create snapshot completed successfully Sep 10 16:59:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5439ac99-1709-4ef4-9a77-f004830f9a38 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-e1059c5c-e5b9-483a-9ece-3f59a0a0c19e-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5439ac99-1709-4ef4-9a77-f004830f9a38 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-e1059c5c-e5b9-483a-9ece-3f59a0a0c19e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5439ac99-1709-4ef4-9a77-f004830f9a38 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-quobyte-620eaa70-27ca-4d60-bf63-99517b8b1cad" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5439ac99-1709-4ef4-9a77-f004830f9a38 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-620eaa70-27ca-4d60-bf63-99517b8b1cad" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5439ac99-1709-4ef4-9a77-f004830f9a38 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-quobyte-e1059c5c-e5b9-483a-9ece-3f59a0a0c19e" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:35 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5439ac99-1709-4ef4-9a77-f004830f9a38 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-e1059c5c-e5b9-483a-9ece-3f59a0a0c19e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:35 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-5439ac99-1709-4ef4-9a77-f004830f9a38 tempest-ProjectMemberTests-1654965068 None] Deleting offline snapshot e1059c5c-e5b9-483a-9ece-3f59a0a0c19e of volume 620eaa70-27ca-4d60-bf63-99517b8b1cad {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:59:35 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-5439ac99-1709-4ef4-9a77-f004830f9a38 tempest-ProjectMemberTests-1654965068 None] snapshot_file for this snap is: volume-620eaa70-27ca-4d60-bf63-99517b8b1cad.e1059c5c-e5b9-483a-9ece-3f59a0a0c19e {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:59:35 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03cad12-a10b-4065-97c0-f4f9be8235a9]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5439ac99-1709-4ef4-9a77-f004830f9a38 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad.e1059c5c-e5b9-483a-9ece-3f59a0a0c19e {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:35 devstack sudo[109387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad.e1059c5c-e5b9-483a-9ece-3f59a0a0c19e Sep 10 16:59:35 devstack sudo[109387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:35 devstack sudo[109387]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5439ac99-1709-4ef4-9a77-f004830f9a38 tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad.e1059c5c-e5b9-483a-9ece-3f59a0a0c19e" returned: 0 in 0.364s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:35 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-5439ac99-1709-4ef4-9a77-f004830f9a38 tempest-ProjectMemberTests-1654965068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-620eaa70-27ca-4d60-bf63-99517b8b1cad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:59:35 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[07aae671-1dd7-4d3a-bfd7-8bf8ffd01ccb]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5439ac99-1709-4ef4-9a77-f004830f9a38 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:35 devstack sudo[109393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad Sep 10 16:59:35 devstack sudo[109393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:35 devstack sudo[109393]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5439ac99-1709-4ef4-9a77-f004830f9a38 tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad" returned: 0 in 0.377s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:35 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5439ac99-1709-4ef4-9a77-f004830f9a38 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad.e1059c5c-e5b9-483a-9ece-3f59a0a0c19e {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:35 devstack sudo[109398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad.e1059c5c-e5b9-483a-9ece-3f59a0a0c19e Sep 10 16:59:35 devstack sudo[109398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:36 devstack sudo[109398]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5439ac99-1709-4ef4-9a77-f004830f9a38 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad.e1059c5c-e5b9-483a-9ece-3f59a0a0c19e" returned: 0 in 0.346s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5439ac99-1709-4ef4-9a77-f004830f9a38 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad.e1059c5c-e5b9-483a-9ece-3f59a0a0c19e {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:36 devstack sudo[109403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad.e1059c5c-e5b9-483a-9ece-3f59a0a0c19e Sep 10 16:59:36 devstack sudo[109403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:36 devstack sudo[109403]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:36 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-5439ac99-1709-4ef4-9a77-f004830f9a38 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad.e1059c5c-e5b9-483a-9ece-3f59a0a0c19e" returned: 0 in 0.246s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5439ac99-1709-4ef4-9a77-f004830f9a38 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-e1059c5c-e5b9-483a-9ece-3f59a0a0c19e" released by "_delete_snapshot" :: held 1.442s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5439ac99-1709-4ef4-9a77-f004830f9a38 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-620eaa70-27ca-4d60-bf63-99517b8b1cad" released by "delete_snapshot" :: held 1.465s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:36 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-5439ac99-1709-4ef4-9a77-f004830f9a38 tempest-ProjectMemberTests-1654965068 None] Created reservations ['08ce3981-30d4-41e3-95c5-fc2d47bf9637', '83ff4709-23df-474e-ae8e-5ed2b26830c6', 'c651106b-0557-41ec-aab1-0c6c5e5741c2', 'debaf483-c0ee-421e-ae44-af7b7b39df9f'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:59:36 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-5439ac99-1709-4ef4-9a77-f004830f9a38 tempest-ProjectMemberTests-1654965068 None] Delete snapshot completed successfully. Sep 10 16:59:36 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-5439ac99-1709-4ef4-9a77-f004830f9a38 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-e1059c5c-e5b9-483a-9ece-3f59a0a0c19e-delete_snapshot" released by "delete_snapshot" :: held 1.613s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:37 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-cca45931-62f3-4f46-8156-e12face352a6 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-620eaa70-27ca-4d60-bf63-99517b8b1cad-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:37 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-cca45931-62f3-4f46-8156-e12face352a6 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-620eaa70-27ca-4d60-bf63-99517b8b1cad-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:37 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-cca45931-62f3-4f46-8156-e12face352a6 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-quobyte-620eaa70-27ca-4d60-bf63-99517b8b1cad" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:37 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-cca45931-62f3-4f46-8156-e12face352a6 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-620eaa70-27ca-4d60-bf63-99517b8b1cad" acquired by "delete_volume" :: waited 0.015s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:37 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f15ed4c-19c2-4e95-bfe8-b693295ee0ba]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cca45931-62f3-4f46-8156-e12face352a6 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:37 devstack sudo[109406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad Sep 10 16:59:37 devstack sudo[109406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:37 devstack sudo[109406]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cca45931-62f3-4f46-8156-e12face352a6 tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad" returned: 0 in 0.373s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cca45931-62f3-4f46-8156-e12face352a6 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:37 devstack sudo[109411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad Sep 10 16:59:37 devstack sudo[109411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:37 devstack sudo[109411]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:37 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cca45931-62f3-4f46-8156-e12face352a6 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-620eaa70-27ca-4d60-bf63-99517b8b1cad" returned: 0 in 0.247s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:37 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-cca45931-62f3-4f46-8156-e12face352a6 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-620eaa70-27ca-4d60-bf63-99517b8b1cad" released by "delete_volume" :: held 0.673s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:37 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-cca45931-62f3-4f46-8156-e12face352a6 tempest-ProjectMemberTests-1654965068 None] Created reservations ['c959b4e3-7961-46ce-90d5-4f0b0083967d', 'fae7d3e6-94b8-4ef4-ac94-af7fdf0e8516', '4bd98d54-c5ff-44b0-8dab-c43d93ffc7ed', '50b66687-c582-4406-b4bc-391fb4a35512'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:59:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-cca45931-62f3-4f46-8156-e12face352a6 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-cca45931-62f3-4f46-8156-e12face352a6 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:38 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-cca45931-62f3-4f46-8156-e12face352a6 tempest-ProjectMemberTests-1654965068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:59:38 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-cca45931-62f3-4f46-8156-e12face352a6 tempest-ProjectMemberTests-1654965068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:59:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-cca45931-62f3-4f46-8156-e12face352a6 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cca45931-62f3-4f46-8156-e12face352a6 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:38 devstack sudo[109414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:59:38 devstack sudo[109414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:38 devstack sudo[109414]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:38 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-cca45931-62f3-4f46-8156-e12face352a6 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.273s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:38 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-cca45931-62f3-4f46-8156-e12face352a6 tempest-ProjectMemberTests-1654965068 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:59:38 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-cca45931-62f3-4f46-8156-e12face352a6 tempest-ProjectMemberTests-1654965068 None] Deleted volume successfully. Sep 10 16:59:38 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-cca45931-62f3-4f46-8156-e12face352a6 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-620eaa70-27ca-4d60-bf63-99517b8b1cad-delete_volume" released by "delete_volume" :: held 1.147s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:39 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3ca3265-87d5-4fce-94c1-6d7369e976cf tempest-ProjectMemberTests-1654965068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:59:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e3ca3265-87d5-4fce-94c1-6d7369e976cf tempest-ProjectMemberTests-1654965068 None] Flow 'volume_create_manager' (b3b24bf4-89d1-4867-87ba-04b6b9d490a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:59:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e3ca3265-87d5-4fce-94c1-6d7369e976cf tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68da03be-1134-4c8a-aa17-d2ee74980684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e3ca3265-87d5-4fce-94c1-6d7369e976cf tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68da03be-1134-4c8a-aa17-d2ee74980684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1464619833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25284a43-74b2-4c1e-88be-f67da71b28d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fdc4b0dbad645d8bc3672158e8e45da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:59:39Z,use_quota=True,user_id='4d7a8be540c54a1e9a03d51feae99641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e3ca3265-87d5-4fce-94c1-6d7369e976cf tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f8f7bf-92af-43f2-8fbb-9d3525eebd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e3ca3265-87d5-4fce-94c1-6d7369e976cf tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f8f7bf-92af-43f2-8fbb-9d3525eebd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e3ca3265-87d5-4fce-94c1-6d7369e976cf tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e38777d-5c99-4f89-b066-865b6977e073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e3ca3265-87d5-4fce-94c1-6d7369e976cf tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e38777d-5c99-4f89-b066-865b6977e073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25284a43-74b2-4c1e-88be-f67da71b28d0', 'volume_name': 'volume-25284a43-74b2-4c1e-88be-f67da71b28d0', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e3ca3265-87d5-4fce-94c1-6d7369e976cf tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bfb5a33-0b66-4736-81ee-16116f2e8678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e3ca3265-87d5-4fce-94c1-6d7369e976cf tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bfb5a33-0b66-4736-81ee-16116f2e8678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e3ca3265-87d5-4fce-94c1-6d7369e976cf tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d76195-5045-4048-8b6e-4d467c834fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:39 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-e3ca3265-87d5-4fce-94c1-6d7369e976cf tempest-ProjectMemberTests-1654965068 None] Volume 25284a43-74b2-4c1e-88be-f67da71b28d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25284a43-74b2-4c1e-88be-f67da71b28d0', 'volume_size': 1} Sep 10 16:59:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e3ca3265-87d5-4fce-94c1-6d7369e976cf tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e3ca3265-87d5-4fce-94c1-6d7369e976cf tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:39 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-e3ca3265-87d5-4fce-94c1-6d7369e976cf tempest-ProjectMemberTests-1654965068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1464619833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25284a43-74b2-4c1e-88be-f67da71b28d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fdc4b0dbad645d8bc3672158e8e45da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:59:39Z,use_quota=True,user_id='4d7a8be540c54a1e9a03d51feae99641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:59:39 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-e3ca3265-87d5-4fce-94c1-6d7369e976cf tempest-ProjectMemberTests-1654965068 None] Creating volume 25284a43-74b2-4c1e-88be-f67da71b28d0 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:59:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e3ca3265-87d5-4fce-94c1-6d7369e976cf tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e3ca3265-87d5-4fce-94c1-6d7369e976cf tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:39 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-e3ca3265-87d5-4fce-94c1-6d7369e976cf tempest-ProjectMemberTests-1654965068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:59:39 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-e3ca3265-87d5-4fce-94c1-6d7369e976cf tempest-ProjectMemberTests-1654965068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:59:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e3ca3265-87d5-4fce-94c1-6d7369e976cf tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:39 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-e3ca3265-87d5-4fce-94c1-6d7369e976cf tempest-ProjectMemberTests-1654965068 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:59:39 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-e3ca3265-87d5-4fce-94c1-6d7369e976cf tempest-ProjectMemberTests-1654965068 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:59:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e3ca3265-87d5-4fce-94c1-6d7369e976cf tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:39 devstack sudo[109417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0 1073741824 Sep 10 16:59:39 devstack sudo[109417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:39 devstack sudo[109417]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e3ca3265-87d5-4fce-94c1-6d7369e976cf tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0 1073741824" returned: 0 in 0.415s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e3ca3265-87d5-4fce-94c1-6d7369e976cf tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:39 devstack sudo[109422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0 Sep 10 16:59:39 devstack sudo[109422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:39 devstack sudo[109422]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-e3ca3265-87d5-4fce-94c1-6d7369e976cf tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0" returned: 0 in 0.267s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:39 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-e3ca3265-87d5-4fce-94c1-6d7369e976cf tempest-ProjectMemberTests-1654965068 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:59:39 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-e3ca3265-87d5-4fce-94c1-6d7369e976cf tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e3ca3265-87d5-4fce-94c1-6d7369e976cf tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d76195-5045-4048-8b6e-4d467c834fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25284a43-74b2-4c1e-88be-f67da71b28d0', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e3ca3265-87d5-4fce-94c1-6d7369e976cf tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (567f667d-bfc2-4cab-96ed-1bb3a4131bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:39 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-e3ca3265-87d5-4fce-94c1-6d7369e976cf tempest-ProjectMemberTests-1654965068 None] Volume volume-25284a43-74b2-4c1e-88be-f67da71b28d0 (25284a43-74b2-4c1e-88be-f67da71b28d0): created successfully Sep 10 16:59:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e3ca3265-87d5-4fce-94c1-6d7369e976cf tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (567f667d-bfc2-4cab-96ed-1bb3a4131bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:39 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-e3ca3265-87d5-4fce-94c1-6d7369e976cf tempest-ProjectMemberTests-1654965068 None] Flow 'volume_create_manager' (b3b24bf4-89d1-4867-87ba-04b6b9d490a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:59:39 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-e3ca3265-87d5-4fce-94c1-6d7369e976cf tempest-ProjectMemberTests-1654965068 None] Created volume successfully. Sep 10 16:59:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-72a13b40-f57a-44ca-b536-1d845b979dc9 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:40 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-72a13b40-f57a-44ca-b536-1d845b979dc9 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:41 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-72a13b40-f57a-44ca-b536-1d845b979dc9 tempest-ProjectMemberTests-1654965068 None] Creating offline snapshot e1eeb4af-b772-454a-ae53-6006d8cacc2f of volume 25284a43-74b2-4c1e-88be-f67da71b28d0 {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:59:41 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b07c938-7c61-4127-be88-269d8c5da721]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-72a13b40-f57a-44ca-b536-1d845b979dc9 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:41 devstack sudo[109426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0 Sep 10 16:59:41 devstack sudo[109426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:41 devstack sudo[109426]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-72a13b40-f57a-44ca-b536-1d845b979dc9 tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0" returned: 0 in 0.351s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-72a13b40-f57a-44ca-b536-1d845b979dc9 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0.e1eeb4af-b772-454a-ae53-6006d8cacc2f 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:41 devstack sudo[109431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0.e1eeb4af-b772-454a-ae53-6006d8cacc2f 1G Sep 10 16:59:41 devstack sudo[109431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:41 devstack sudo[109431]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-72a13b40-f57a-44ca-b536-1d845b979dc9 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0.e1eeb4af-b772-454a-ae53-6006d8cacc2f 1G" returned: 0 in 0.424s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:41 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-72a13b40-f57a-44ca-b536-1d845b979dc9 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25284a43-74b2-4c1e-88be-f67da71b28d0 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0.e1eeb4af-b772-454a-ae53-6006d8cacc2f {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:41 devstack sudo[109437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25284a43-74b2-4c1e-88be-f67da71b28d0 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0.e1eeb4af-b772-454a-ae53-6006d8cacc2f Sep 10 16:59:41 devstack sudo[109437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:42 devstack sudo[109437]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-72a13b40-f57a-44ca-b536-1d845b979dc9 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25284a43-74b2-4c1e-88be-f67da71b28d0 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0.e1eeb4af-b772-454a-ae53-6006d8cacc2f" returned: 0 in 0.297s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:42 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-72a13b40-f57a-44ca-b536-1d845b979dc9 tempest-ProjectMemberTests-1654965068 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0.e1eeb4af-b772-454a-ae53-6006d8cacc2f is being set with open permissions: ugo+rw Sep 10 16:59:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-72a13b40-f57a-44ca-b536-1d845b979dc9 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0.e1eeb4af-b772-454a-ae53-6006d8cacc2f {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:42 devstack sudo[109443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0.e1eeb4af-b772-454a-ae53-6006d8cacc2f Sep 10 16:59:42 devstack sudo[109443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:42 devstack sudo[109443]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-72a13b40-f57a-44ca-b536-1d845b979dc9 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0.e1eeb4af-b772-454a-ae53-6006d8cacc2f" returned: 0 in 0.265s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:42 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=221,cinder:INSERT=66,cinder:UPDATE=287,cinder:DELETE=17 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:59:42 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=201,cinder:INSERT=83,cinder:UPDATE=275,cinder:DELETE=30 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 16:59:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-72a13b40-f57a-44ca-b536-1d845b979dc9 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:42 devstack sudo[109446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0.info Sep 10 16:59:42 devstack sudo[109446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:42 devstack sudo[109446]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-72a13b40-f57a-44ca-b536-1d845b979dc9 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0.info" returned: 0 in 0.270s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:42 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-72a13b40-f57a-44ca-b536-1d845b979dc9 tempest-ProjectMemberTests-1654965068 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0.info is being set with open permissions: ugo+rw Sep 10 16:59:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-72a13b40-f57a-44ca-b536-1d845b979dc9 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:42 devstack sudo[109449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0.info Sep 10 16:59:42 devstack sudo[109449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:42 devstack sudo[109449]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-72a13b40-f57a-44ca-b536-1d845b979dc9 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0.info" returned: 0 in 0.245s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:42 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-72a13b40-f57a-44ca-b536-1d845b979dc9 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.941s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:42 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-72a13b40-f57a-44ca-b536-1d845b979dc9 tempest-ProjectMemberTests-1654965068 None] Create snapshot completed successfully Sep 10 16:59:43 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f7ce3ad0-21a7-4fe3-90f2-56c8b2d314eb tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-e1eeb4af-b772-454a-ae53-6006d8cacc2f-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:43 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f7ce3ad0-21a7-4fe3-90f2-56c8b2d314eb tempest-ProjectMemberTests-1654965068 None] Lock "cinder-e1eeb4af-b772-454a-ae53-6006d8cacc2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:43 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f7ce3ad0-21a7-4fe3-90f2-56c8b2d314eb tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-quobyte-25284a43-74b2-4c1e-88be-f67da71b28d0" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:43 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f7ce3ad0-21a7-4fe3-90f2-56c8b2d314eb tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-25284a43-74b2-4c1e-88be-f67da71b28d0" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:43 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f7ce3ad0-21a7-4fe3-90f2-56c8b2d314eb tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-quobyte-e1eeb4af-b772-454a-ae53-6006d8cacc2f" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:43 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f7ce3ad0-21a7-4fe3-90f2-56c8b2d314eb tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-e1eeb4af-b772-454a-ae53-6006d8cacc2f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:43 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-f7ce3ad0-21a7-4fe3-90f2-56c8b2d314eb tempest-ProjectMemberTests-1654965068 None] Deleting offline snapshot e1eeb4af-b772-454a-ae53-6006d8cacc2f of volume 25284a43-74b2-4c1e-88be-f67da71b28d0 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:59:43 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-f7ce3ad0-21a7-4fe3-90f2-56c8b2d314eb tempest-ProjectMemberTests-1654965068 None] snapshot_file for this snap is: volume-25284a43-74b2-4c1e-88be-f67da71b28d0.e1eeb4af-b772-454a-ae53-6006d8cacc2f {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:59:43 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c8291a-da10-4313-81ae-afd5ae7c9130]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f7ce3ad0-21a7-4fe3-90f2-56c8b2d314eb tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0.e1eeb4af-b772-454a-ae53-6006d8cacc2f {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:43 devstack sudo[109453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0.e1eeb4af-b772-454a-ae53-6006d8cacc2f Sep 10 16:59:43 devstack sudo[109453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:43 devstack sudo[109453]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f7ce3ad0-21a7-4fe3-90f2-56c8b2d314eb tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0.e1eeb4af-b772-454a-ae53-6006d8cacc2f" returned: 0 in 0.392s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:43 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-f7ce3ad0-21a7-4fe3-90f2-56c8b2d314eb tempest-ProjectMemberTests-1654965068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25284a43-74b2-4c1e-88be-f67da71b28d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:59:43 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d968c3-7287-49d9-811d-9897426ec80b]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:43 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f7ce3ad0-21a7-4fe3-90f2-56c8b2d314eb tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:43 devstack sudo[109458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0 Sep 10 16:59:43 devstack sudo[109458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:44 devstack sudo[109458]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f7ce3ad0-21a7-4fe3-90f2-56c8b2d314eb tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0" returned: 0 in 0.367s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f7ce3ad0-21a7-4fe3-90f2-56c8b2d314eb tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0.e1eeb4af-b772-454a-ae53-6006d8cacc2f {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:44 devstack sudo[109463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0.e1eeb4af-b772-454a-ae53-6006d8cacc2f Sep 10 16:59:44 devstack sudo[109463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:44 devstack sudo[109463]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f7ce3ad0-21a7-4fe3-90f2-56c8b2d314eb tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0.e1eeb4af-b772-454a-ae53-6006d8cacc2f" returned: 0 in 0.366s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f7ce3ad0-21a7-4fe3-90f2-56c8b2d314eb tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0.e1eeb4af-b772-454a-ae53-6006d8cacc2f {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:44 devstack sudo[109469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0.e1eeb4af-b772-454a-ae53-6006d8cacc2f Sep 10 16:59:44 devstack sudo[109469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:44 devstack sudo[109469]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:44 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f7ce3ad0-21a7-4fe3-90f2-56c8b2d314eb tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0.e1eeb4af-b772-454a-ae53-6006d8cacc2f" returned: 0 in 0.257s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:44 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f7ce3ad0-21a7-4fe3-90f2-56c8b2d314eb tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-e1eeb4af-b772-454a-ae53-6006d8cacc2f" released by "_delete_snapshot" :: held 1.482s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:44 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f7ce3ad0-21a7-4fe3-90f2-56c8b2d314eb tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-25284a43-74b2-4c1e-88be-f67da71b28d0" released by "delete_snapshot" :: held 1.508s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:44 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-f7ce3ad0-21a7-4fe3-90f2-56c8b2d314eb tempest-ProjectMemberTests-1654965068 None] Created reservations ['4e83dd08-8de1-4c11-bdbc-e438ef84a6cb', '8e2e3c51-ae86-4b7b-8e99-501ed5322ffb', '19a542af-3863-491d-af41-5561243c8999', '16dd8333-1c3f-4c94-9bb1-103be64d83f5'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:59:44 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-f7ce3ad0-21a7-4fe3-90f2-56c8b2d314eb tempest-ProjectMemberTests-1654965068 None] Delete snapshot completed successfully. Sep 10 16:59:44 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f7ce3ad0-21a7-4fe3-90f2-56c8b2d314eb tempest-ProjectMemberTests-1654965068 None] Lock "cinder-e1eeb4af-b772-454a-ae53-6006d8cacc2f-delete_snapshot" released by "delete_snapshot" :: held 1.659s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:45 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f0115b1a-8683-4be3-a673-9398f73608eb tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-25284a43-74b2-4c1e-88be-f67da71b28d0-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:45 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f0115b1a-8683-4be3-a673-9398f73608eb tempest-ProjectMemberTests-1654965068 None] Lock "cinder-25284a43-74b2-4c1e-88be-f67da71b28d0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:45 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f0115b1a-8683-4be3-a673-9398f73608eb tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-quobyte-25284a43-74b2-4c1e-88be-f67da71b28d0" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:45 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f0115b1a-8683-4be3-a673-9398f73608eb tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-25284a43-74b2-4c1e-88be-f67da71b28d0" acquired by "delete_volume" :: waited 0.019s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:45 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[897b6a3c-1d37-46bb-8839-bb18456287c4]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f0115b1a-8683-4be3-a673-9398f73608eb tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:45 devstack sudo[109472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0 Sep 10 16:59:45 devstack sudo[109472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:45 devstack sudo[109472]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f0115b1a-8683-4be3-a673-9398f73608eb tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0" returned: 0 in 0.366s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:45 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f0115b1a-8683-4be3-a673-9398f73608eb tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:45 devstack sudo[109477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0 Sep 10 16:59:45 devstack sudo[109477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:46 devstack sudo[109477]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f0115b1a-8683-4be3-a673-9398f73608eb tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-25284a43-74b2-4c1e-88be-f67da71b28d0" returned: 0 in 0.245s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:46 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f0115b1a-8683-4be3-a673-9398f73608eb tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-25284a43-74b2-4c1e-88be-f67da71b28d0" released by "delete_volume" :: held 0.671s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:46 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-f0115b1a-8683-4be3-a673-9398f73608eb tempest-ProjectMemberTests-1654965068 None] Created reservations ['70b9ab76-971e-477e-be8c-8a3017a7d3a2', '00336e72-ba1a-453b-8f0f-d53cdbd0eac4', 'ce01fcd8-3ebe-4bf6-b7c5-a95c4b50790d', '301c882d-1462-4f2c-bf39-114c1c93f723'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:59:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f0115b1a-8683-4be3-a673-9398f73608eb tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f0115b1a-8683-4be3-a673-9398f73608eb tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:46 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f0115b1a-8683-4be3-a673-9398f73608eb tempest-ProjectMemberTests-1654965068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:59:46 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-f0115b1a-8683-4be3-a673-9398f73608eb tempest-ProjectMemberTests-1654965068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:59:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-f0115b1a-8683-4be3-a673-9398f73608eb tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f0115b1a-8683-4be3-a673-9398f73608eb tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:46 devstack sudo[109480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:59:46 devstack sudo[109480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:46 devstack sudo[109480]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:46 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-f0115b1a-8683-4be3-a673-9398f73608eb tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.256s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:46 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-f0115b1a-8683-4be3-a673-9398f73608eb tempest-ProjectMemberTests-1654965068 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:59:46 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-f0115b1a-8683-4be3-a673-9398f73608eb tempest-ProjectMemberTests-1654965068 None] Deleted volume successfully. Sep 10 16:59:46 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-f0115b1a-8683-4be3-a673-9398f73608eb tempest-ProjectMemberTests-1654965068 None] Lock "cinder-25284a43-74b2-4c1e-88be-f67da71b28d0-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:46 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f2dc312-5a0a-4773-9ee6-c22546f103a7 tempest-ProjectMemberTests-1654965068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 16:59:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7f2dc312-5a0a-4773-9ee6-c22546f103a7 tempest-ProjectMemberTests-1654965068 None] Flow 'volume_create_manager' (b2473cd9-3b63-4617-b930-26928cf7b12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:59:46 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7f2dc312-5a0a-4773-9ee6-c22546f103a7 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3bc15cc-9941-42fc-9b95-ca7bb2fd3045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:47 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7f2dc312-5a0a-4773-9ee6-c22546f103a7 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3bc15cc-9941-42fc-9b95-ca7bb2fd3045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-187955924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbe73355-0626-4851-b7f1-d10401844609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fdc4b0dbad645d8bc3672158e8e45da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:59:47Z,use_quota=True,user_id='4d7a8be540c54a1e9a03d51feae99641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:47 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7f2dc312-5a0a-4773-9ee6-c22546f103a7 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d21e0de-7fa7-4a8b-aa07-1a449d0d3e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:47 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7f2dc312-5a0a-4773-9ee6-c22546f103a7 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d21e0de-7fa7-4a8b-aa07-1a449d0d3e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:47 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7f2dc312-5a0a-4773-9ee6-c22546f103a7 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c6f0d79-8cc9-4d7d-8861-5a77530d54da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:47 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7f2dc312-5a0a-4773-9ee6-c22546f103a7 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c6f0d79-8cc9-4d7d-8861-5a77530d54da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbe73355-0626-4851-b7f1-d10401844609', 'volume_name': 'volume-dbe73355-0626-4851-b7f1-d10401844609', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:47 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7f2dc312-5a0a-4773-9ee6-c22546f103a7 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f36369a-5757-4b46-8cf0-3e138c274df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:47 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7f2dc312-5a0a-4773-9ee6-c22546f103a7 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f36369a-5757-4b46-8cf0-3e138c274df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:47 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7f2dc312-5a0a-4773-9ee6-c22546f103a7 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2435d7a5-d335-44f5-be15-43386e4a20ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:47 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-7f2dc312-5a0a-4773-9ee6-c22546f103a7 tempest-ProjectMemberTests-1654965068 None] Volume dbe73355-0626-4851-b7f1-d10401844609: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbe73355-0626-4851-b7f1-d10401844609', 'volume_size': 1} Sep 10 16:59:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7f2dc312-5a0a-4773-9ee6-c22546f103a7 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7f2dc312-5a0a-4773-9ee6-c22546f103a7 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:47 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7f2dc312-5a0a-4773-9ee6-c22546f103a7 tempest-ProjectMemberTests-1654965068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T14:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-187955924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbe73355-0626-4851-b7f1-d10401844609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fdc4b0dbad645d8bc3672158e8e45da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T14:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T14:59:47Z,use_quota=True,user_id='4d7a8be540c54a1e9a03d51feae99641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 16:59:47 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-7f2dc312-5a0a-4773-9ee6-c22546f103a7 tempest-ProjectMemberTests-1654965068 None] Creating volume dbe73355-0626-4851-b7f1-d10401844609 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 16:59:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7f2dc312-5a0a-4773-9ee6-c22546f103a7 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7f2dc312-5a0a-4773-9ee6-c22546f103a7 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:47 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7f2dc312-5a0a-4773-9ee6-c22546f103a7 tempest-ProjectMemberTests-1654965068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:59:47 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7f2dc312-5a0a-4773-9ee6-c22546f103a7 tempest-ProjectMemberTests-1654965068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:59:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7f2dc312-5a0a-4773-9ee6-c22546f103a7 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:47 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7f2dc312-5a0a-4773-9ee6-c22546f103a7 tempest-ProjectMemberTests-1654965068 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 16:59:47 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-7f2dc312-5a0a-4773-9ee6-c22546f103a7 tempest-ProjectMemberTests-1654965068 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 16:59:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7f2dc312-5a0a-4773-9ee6-c22546f103a7 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:47 devstack sudo[109483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609 1073741824 Sep 10 16:59:47 devstack sudo[109483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:47 devstack sudo[109483]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7f2dc312-5a0a-4773-9ee6-c22546f103a7 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609 1073741824" returned: 0 in 0.447s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7f2dc312-5a0a-4773-9ee6-c22546f103a7 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:47 devstack sudo[109489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609 Sep 10 16:59:47 devstack sudo[109489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:47 devstack sudo[109489]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-7f2dc312-5a0a-4773-9ee6-c22546f103a7 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609" returned: 0 in 0.246s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:47 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-7f2dc312-5a0a-4773-9ee6-c22546f103a7 tempest-ProjectMemberTests-1654965068 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 16:59:47 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-7f2dc312-5a0a-4773-9ee6-c22546f103a7 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:47 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7f2dc312-5a0a-4773-9ee6-c22546f103a7 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2435d7a5-d335-44f5-be15-43386e4a20ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbe73355-0626-4851-b7f1-d10401844609', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:47 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7f2dc312-5a0a-4773-9ee6-c22546f103a7 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971e4a3b-4751-4292-8a1f-d28473ab1749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 16:59:47 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-7f2dc312-5a0a-4773-9ee6-c22546f103a7 tempest-ProjectMemberTests-1654965068 None] Volume volume-dbe73355-0626-4851-b7f1-d10401844609 (dbe73355-0626-4851-b7f1-d10401844609): created successfully Sep 10 16:59:47 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7f2dc312-5a0a-4773-9ee6-c22546f103a7 tempest-ProjectMemberTests-1654965068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971e4a3b-4751-4292-8a1f-d28473ab1749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 16:59:47 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-7f2dc312-5a0a-4773-9ee6-c22546f103a7 tempest-ProjectMemberTests-1654965068 None] Flow 'volume_create_manager' (b2473cd9-3b63-4617-b930-26928cf7b12e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 16:59:47 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-7f2dc312-5a0a-4773-9ee6-c22546f103a7 tempest-ProjectMemberTests-1654965068 None] Created volume successfully. Sep 10 16:59:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4ddfb1c6-0f5b-41f7-9649-36f42c14dd13 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4ddfb1c6-0f5b-41f7-9649-36f42c14dd13 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:48 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-4ddfb1c6-0f5b-41f7-9649-36f42c14dd13 tempest-ProjectMemberTests-1654965068 None] Creating offline snapshot 899b652c-2137-434b-a7cd-ab2f37375de5 of volume dbe73355-0626-4851-b7f1-d10401844609 {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 16:59:48 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1b97ac-c6cb-47e0-b13f-f1f988200e5f]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4ddfb1c6-0f5b-41f7-9649-36f42c14dd13 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:48 devstack sudo[109492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609 Sep 10 16:59:48 devstack sudo[109492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:48 devstack sudo[109492]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4ddfb1c6-0f5b-41f7-9649-36f42c14dd13 tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609" returned: 0 in 0.363s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4ddfb1c6-0f5b-41f7-9649-36f42c14dd13 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609.899b652c-2137-434b-a7cd-ab2f37375de5 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:48 devstack sudo[109497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609.899b652c-2137-434b-a7cd-ab2f37375de5 1G Sep 10 16:59:48 devstack sudo[109497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:48 devstack sudo[109497]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4ddfb1c6-0f5b-41f7-9649-36f42c14dd13 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609.899b652c-2137-434b-a7cd-ab2f37375de5 1G" returned: 0 in 0.414s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:48 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4ddfb1c6-0f5b-41f7-9649-36f42c14dd13 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbe73355-0626-4851-b7f1-d10401844609 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609.899b652c-2137-434b-a7cd-ab2f37375de5 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:48 devstack sudo[109504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbe73355-0626-4851-b7f1-d10401844609 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609.899b652c-2137-434b-a7cd-ab2f37375de5 Sep 10 16:59:48 devstack sudo[109504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:49 devstack sudo[109504]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4ddfb1c6-0f5b-41f7-9649-36f42c14dd13 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbe73355-0626-4851-b7f1-d10401844609 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609.899b652c-2137-434b-a7cd-ab2f37375de5" returned: 0 in 0.292s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:49 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-4ddfb1c6-0f5b-41f7-9649-36f42c14dd13 tempest-ProjectMemberTests-1654965068 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609.899b652c-2137-434b-a7cd-ab2f37375de5 is being set with open permissions: ugo+rw Sep 10 16:59:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4ddfb1c6-0f5b-41f7-9649-36f42c14dd13 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609.899b652c-2137-434b-a7cd-ab2f37375de5 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:49 devstack sudo[109509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609.899b652c-2137-434b-a7cd-ab2f37375de5 Sep 10 16:59:49 devstack sudo[109509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:49 devstack sudo[109509]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4ddfb1c6-0f5b-41f7-9649-36f42c14dd13 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609.899b652c-2137-434b-a7cd-ab2f37375de5" returned: 0 in 0.246s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4ddfb1c6-0f5b-41f7-9649-36f42c14dd13 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:49 devstack sudo[109512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609.info Sep 10 16:59:49 devstack sudo[109512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:59:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:59:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:59:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:49 devstack sudo[109514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:59:49 devstack sudo[109514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:49 devstack sudo[109512]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4ddfb1c6-0f5b-41f7-9649-36f42c14dd13 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609.info" returned: 0 in 0.292s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:49 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-4ddfb1c6-0f5b-41f7-9649-36f42c14dd13 tempest-ProjectMemberTests-1654965068 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609.info is being set with open permissions: ugo+rw Sep 10 16:59:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4ddfb1c6-0f5b-41f7-9649-36f42c14dd13 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:49 devstack sudo[109514]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.271s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:49 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:59:49 devstack sudo[109518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609.info Sep 10 16:59:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager._thread_info {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 16:59:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread count: 29 {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 16:59:49 devstack sudo[109518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread info: [<_MainThread(MainThread, started 125792070905984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 16:59:50 devstack sudo[109518]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4ddfb1c6-0f5b-41f7-9649-36f42c14dd13 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609.info" returned: 0 in 0.271s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4ddfb1c6-0f5b-41f7-9649-36f42c14dd13 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.959s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:50 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-4ddfb1c6-0f5b-41f7-9649-36f42c14dd13 tempest-ProjectMemberTests-1654965068 None] Create snapshot completed successfully Sep 10 16:59:50 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-0bb56b35-0fdc-4cf1-91c2-5315d4185409 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-899b652c-2137-434b-a7cd-ab2f37375de5-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:50 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-0bb56b35-0fdc-4cf1-91c2-5315d4185409 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-899b652c-2137-434b-a7cd-ab2f37375de5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:50 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-0bb56b35-0fdc-4cf1-91c2-5315d4185409 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-quobyte-dbe73355-0626-4851-b7f1-d10401844609" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:50 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-0bb56b35-0fdc-4cf1-91c2-5315d4185409 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-dbe73355-0626-4851-b7f1-d10401844609" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:50 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-0bb56b35-0fdc-4cf1-91c2-5315d4185409 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-quobyte-899b652c-2137-434b-a7cd-ab2f37375de5" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:50 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-0bb56b35-0fdc-4cf1-91c2-5315d4185409 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-899b652c-2137-434b-a7cd-ab2f37375de5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:50 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-0bb56b35-0fdc-4cf1-91c2-5315d4185409 tempest-ProjectMemberTests-1654965068 None] Deleting offline snapshot 899b652c-2137-434b-a7cd-ab2f37375de5 of volume dbe73355-0626-4851-b7f1-d10401844609 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 16:59:50 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-0bb56b35-0fdc-4cf1-91c2-5315d4185409 tempest-ProjectMemberTests-1654965068 None] snapshot_file for this snap is: volume-dbe73355-0626-4851-b7f1-d10401844609.899b652c-2137-434b-a7cd-ab2f37375de5 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 16:59:50 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e30972-0af5-4a9c-8b02-cccc0ca08d28]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0bb56b35-0fdc-4cf1-91c2-5315d4185409 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609.899b652c-2137-434b-a7cd-ab2f37375de5 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:50 devstack sudo[109521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609.899b652c-2137-434b-a7cd-ab2f37375de5 Sep 10 16:59:50 devstack sudo[109521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:50 devstack sudo[109521]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0bb56b35-0fdc-4cf1-91c2-5315d4185409 tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609.899b652c-2137-434b-a7cd-ab2f37375de5" returned: 0 in 0.349s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:50 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-0bb56b35-0fdc-4cf1-91c2-5315d4185409 tempest-ProjectMemberTests-1654965068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbe73355-0626-4851-b7f1-d10401844609(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 16:59:50 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3e7f22-f26a-4a0f-a873-6e1f200ec51b]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:50 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0bb56b35-0fdc-4cf1-91c2-5315d4185409 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:51 devstack sudo[109527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609 Sep 10 16:59:51 devstack sudo[109527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:51 devstack sudo[109527]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0bb56b35-0fdc-4cf1-91c2-5315d4185409 tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609" returned: 0 in 0.354s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0bb56b35-0fdc-4cf1-91c2-5315d4185409 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609.899b652c-2137-434b-a7cd-ab2f37375de5 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:51 devstack sudo[109532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609.899b652c-2137-434b-a7cd-ab2f37375de5 Sep 10 16:59:51 devstack sudo[109532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:51 devstack sudo[109532]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0bb56b35-0fdc-4cf1-91c2-5315d4185409 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609.899b652c-2137-434b-a7cd-ab2f37375de5" returned: 0 in 0.322s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0bb56b35-0fdc-4cf1-91c2-5315d4185409 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609.899b652c-2137-434b-a7cd-ab2f37375de5 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:51 devstack sudo[109537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609.899b652c-2137-434b-a7cd-ab2f37375de5 Sep 10 16:59:51 devstack sudo[109537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:51 devstack sudo[109537]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:51 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-0bb56b35-0fdc-4cf1-91c2-5315d4185409 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609.899b652c-2137-434b-a7cd-ab2f37375de5" returned: 0 in 0.248s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:51 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-0bb56b35-0fdc-4cf1-91c2-5315d4185409 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-899b652c-2137-434b-a7cd-ab2f37375de5" released by "_delete_snapshot" :: held 1.365s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:51 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-0bb56b35-0fdc-4cf1-91c2-5315d4185409 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-dbe73355-0626-4851-b7f1-d10401844609" released by "delete_snapshot" :: held 1.390s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:51 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-0bb56b35-0fdc-4cf1-91c2-5315d4185409 tempest-ProjectMemberTests-1654965068 None] Created reservations ['c462a505-43bb-4cb9-b67d-a5bba27f6158', '03e0d757-831f-4c60-9424-15a8f2e3305b', '809bf451-2b3f-47a2-b9ed-79bc9f7ca2a4', '33269d6d-70ed-4570-a9f8-20d12004a8df'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:59:51 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-0bb56b35-0fdc-4cf1-91c2-5315d4185409 tempest-ProjectMemberTests-1654965068 None] Delete snapshot completed successfully. Sep 10 16:59:51 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-0bb56b35-0fdc-4cf1-91c2-5315d4185409 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-899b652c-2137-434b-a7cd-ab2f37375de5-delete_snapshot" released by "delete_snapshot" :: held 1.532s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:52 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bae6017c-8208-4886-80ee-57091f199634 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-dbe73355-0626-4851-b7f1-d10401844609-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:52 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bae6017c-8208-4886-80ee-57091f199634 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-dbe73355-0626-4851-b7f1-d10401844609-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:52 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bae6017c-8208-4886-80ee-57091f199634 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "cinder-quobyte-dbe73355-0626-4851-b7f1-d10401844609" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 16:59:52 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bae6017c-8208-4886-80ee-57091f199634 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-dbe73355-0626-4851-b7f1-d10401844609" acquired by "delete_volume" :: waited 0.018s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 16:59:52 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa68ba0-03de-4633-a3ec-2d744df044ba]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 16:59:52 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bae6017c-8208-4886-80ee-57091f199634 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:52 devstack sudo[109540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609 Sep 10 16:59:52 devstack sudo[109540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:53 devstack sudo[109540]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bae6017c-8208-4886-80ee-57091f199634 tempest-ProjectMemberTests-1654965068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609" returned: 0 in 0.363s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bae6017c-8208-4886-80ee-57091f199634 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:53 devstack sudo[109545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609 Sep 10 16:59:53 devstack sudo[109545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:53 devstack sudo[109545]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bae6017c-8208-4886-80ee-57091f199634 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-dbe73355-0626-4851-b7f1-d10401844609" returned: 0 in 0.239s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:53 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bae6017c-8208-4886-80ee-57091f199634 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-quobyte-dbe73355-0626-4851-b7f1-d10401844609" released by "delete_volume" :: held 0.654s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 16:59:53 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-bae6017c-8208-4886-80ee-57091f199634 tempest-ProjectMemberTests-1654965068 None] Created reservations ['a73df693-d4af-4041-b468-3361eb27a33d', '642286b3-2a14-4af2-a1d2-cee0b5c77552', '39039535-ef7d-4bee-b772-a1c70c012f5c', '45c80c3b-f4e5-4790-8e54-20cf0a8b7012'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:59:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-bae6017c-8208-4886-80ee-57091f199634 tempest-ProjectMemberTests-1654965068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 16:59:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-bae6017c-8208-4886-80ee-57091f199634 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 16:59:53 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-bae6017c-8208-4886-80ee-57091f199634 tempest-ProjectMemberTests-1654965068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 16:59:53 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-bae6017c-8208-4886-80ee-57091f199634 tempest-ProjectMemberTests-1654965068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 16:59:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-bae6017c-8208-4886-80ee-57091f199634 tempest-ProjectMemberTests-1654965068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 16:59:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bae6017c-8208-4886-80ee-57091f199634 tempest-ProjectMemberTests-1654965068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 16:59:53 devstack sudo[109548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 16:59:53 devstack sudo[109548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:59:53 devstack sudo[109548]: pam_unix(sudo:session): session closed for user root Sep 10 16:59:53 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-bae6017c-8208-4886-80ee-57091f199634 tempest-ProjectMemberTests-1654965068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.239s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 16:59:53 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-bae6017c-8208-4886-80ee-57091f199634 tempest-ProjectMemberTests-1654965068 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 16:59:53 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-bae6017c-8208-4886-80ee-57091f199634 tempest-ProjectMemberTests-1654965068 None] Deleted volume successfully. Sep 10 16:59:53 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-bae6017c-8208-4886-80ee-57091f199634 tempest-ProjectMemberTests-1654965068 None] Lock "cinder-dbe73355-0626-4851-b7f1-d10401844609-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 17:00:03 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=20,cinder:UPDATE=32,cinder:INSERT=9,cinder:DELETE=1 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 17:00:03 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=30,cinder:INSERT=10,cinder:UPDATE=33,cinder:DELETE=4 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 17:00:20 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef91201c-7746-4f06-adb9-7167d576166c tempest-SnapshotDependencyTests-405315099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 17:00:20 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ef91201c-7746-4f06-adb9-7167d576166c tempest-SnapshotDependencyTests-405315099 None] Flow 'volume_create_manager' (ba0c7802-09f1-4da7-be29-b306f8d6db72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 17:00:20 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ef91201c-7746-4f06-adb9-7167d576166c tempest-SnapshotDependencyTests-405315099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b70a343f-4997-44dc-a9df-3beaafb740e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 17:00:20 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ef91201c-7746-4f06-adb9-7167d576166c tempest-SnapshotDependencyTests-405315099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b70a343f-4997-44dc-a9df-3beaafb740e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T15:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1512311278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df1594e9-5105-451e-9842-0fb09ce06497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc93fdffbdac407f9159ba4b6742caa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T15:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T15:00:21Z,use_quota=True,user_id='8d740afba69145b7bce58832da025be3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 17:00:20 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ef91201c-7746-4f06-adb9-7167d576166c tempest-SnapshotDependencyTests-405315099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e27dff-ec05-43de-85f0-49f37a05b7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 17:00:20 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ef91201c-7746-4f06-adb9-7167d576166c tempest-SnapshotDependencyTests-405315099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e27dff-ec05-43de-85f0-49f37a05b7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 17:00:20 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ef91201c-7746-4f06-adb9-7167d576166c tempest-SnapshotDependencyTests-405315099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb6bcac-a2f7-46cc-af5f-ee98be10ec31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 17:00:20 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ef91201c-7746-4f06-adb9-7167d576166c tempest-SnapshotDependencyTests-405315099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb6bcac-a2f7-46cc-af5f-ee98be10ec31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df1594e9-5105-451e-9842-0fb09ce06497', 'volume_name': 'volume-df1594e9-5105-451e-9842-0fb09ce06497', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 17:00:20 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ef91201c-7746-4f06-adb9-7167d576166c tempest-SnapshotDependencyTests-405315099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d399e30c-4827-4995-b751-4939df076035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 17:00:20 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ef91201c-7746-4f06-adb9-7167d576166c tempest-SnapshotDependencyTests-405315099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d399e30c-4827-4995-b751-4939df076035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 17:00:20 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ef91201c-7746-4f06-adb9-7167d576166c tempest-SnapshotDependencyTests-405315099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc0f91f6-3ff2-462c-9f58-59d45bd08f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 17:00:20 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-ef91201c-7746-4f06-adb9-7167d576166c tempest-SnapshotDependencyTests-405315099 None] Volume df1594e9-5105-451e-9842-0fb09ce06497: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df1594e9-5105-451e-9842-0fb09ce06497', 'volume_size': 1} Sep 10 17:00:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ef91201c-7746-4f06-adb9-7167d576166c tempest-SnapshotDependencyTests-405315099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 17:00:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ef91201c-7746-4f06-adb9-7167d576166c tempest-SnapshotDependencyTests-405315099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 17:00:20 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ef91201c-7746-4f06-adb9-7167d576166c tempest-SnapshotDependencyTests-405315099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T15:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1512311278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df1594e9-5105-451e-9842-0fb09ce06497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc93fdffbdac407f9159ba4b6742caa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T15:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T15:00:21Z,use_quota=True,user_id='8d740afba69145b7bce58832da025be3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)}" {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 17:00:20 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-ef91201c-7746-4f06-adb9-7167d576166c tempest-SnapshotDependencyTests-405315099 None] Creating volume df1594e9-5105-451e-9842-0fb09ce06497 {{(pid=88189) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 17:00:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ef91201c-7746-4f06-adb9-7167d576166c tempest-SnapshotDependencyTests-405315099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 17:00:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ef91201c-7746-4f06-adb9-7167d576166c tempest-SnapshotDependencyTests-405315099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 17:00:20 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ef91201c-7746-4f06-adb9-7167d576166c tempest-SnapshotDependencyTests-405315099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 17:00:20 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ef91201c-7746-4f06-adb9-7167d576166c tempest-SnapshotDependencyTests-405315099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 17:00:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ef91201c-7746-4f06-adb9-7167d576166c tempest-SnapshotDependencyTests-405315099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 17:00:20 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ef91201c-7746-4f06-adb9-7167d576166c tempest-SnapshotDependencyTests-405315099 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 17:00:20 devstack cinder-volume[88189]: INFO cinder.volume.drivers.remotefs [None req-ef91201c-7746-4f06-adb9-7167d576166c tempest-SnapshotDependencyTests-405315099 None] casted to osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 Sep 10 17:00:20 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ef91201c-7746-4f06-adb9-7167d576166c tempest-SnapshotDependencyTests-405315099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497 1073741824 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 17:00:20 devstack sudo[109597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497 1073741824 Sep 10 17:00:20 devstack sudo[109597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:00:21 devstack sudo[109597]: pam_unix(sudo:session): session closed for user root Sep 10 17:00:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ef91201c-7746-4f06-adb9-7167d576166c tempest-SnapshotDependencyTests-405315099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497 1073741824" returned: 0 in 0.440s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 17:00:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ef91201c-7746-4f06-adb9-7167d576166c tempest-SnapshotDependencyTests-405315099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 17:00:21 devstack sudo[109607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497 Sep 10 17:00:21 devstack sudo[109607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:00:21 devstack sudo[109607]: pam_unix(sudo:session): session closed for user root Sep 10 17:00:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-ef91201c-7746-4f06-adb9-7167d576166c tempest-SnapshotDependencyTests-405315099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497" returned: 0 in 0.236s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 17:00:21 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-ef91201c-7746-4f06-adb9-7167d576166c tempest-SnapshotDependencyTests-405315099 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'} {{(pid=88189) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 17:00:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-ef91201c-7746-4f06-adb9-7167d576166c tempest-SnapshotDependencyTests-405315099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 17:00:21 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ef91201c-7746-4f06-adb9-7167d576166c tempest-SnapshotDependencyTests-405315099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc0f91f6-3ff2-462c-9f58-59d45bd08f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df1594e9-5105-451e-9842-0fb09ce06497', 'volume_size': 1}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 17:00:21 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ef91201c-7746-4f06-adb9-7167d576166c tempest-SnapshotDependencyTests-405315099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e69191a6-18bb-4a67-969d-5c9cf14fb73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 17:00:21 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-ef91201c-7746-4f06-adb9-7167d576166c tempest-SnapshotDependencyTests-405315099 None] Volume volume-df1594e9-5105-451e-9842-0fb09ce06497 (df1594e9-5105-451e-9842-0fb09ce06497): created successfully Sep 10 17:00:21 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ef91201c-7746-4f06-adb9-7167d576166c tempest-SnapshotDependencyTests-405315099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e69191a6-18bb-4a67-969d-5c9cf14fb73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 17:00:21 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-ef91201c-7746-4f06-adb9-7167d576166c tempest-SnapshotDependencyTests-405315099 None] Flow 'volume_create_manager' (ba0c7802-09f1-4da7-be29-b306f8d6db72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 17:00:21 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-ef91201c-7746-4f06-adb9-7167d576166c tempest-SnapshotDependencyTests-405315099 None] Created volume successfully. Sep 10 17:00:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-78bce543-00c0-4d99-b8b4-14dcaf8951c7 tempest-SnapshotDependencyTests-405315099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 17:00:21 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-78bce543-00c0-4d99-b8b4-14dcaf8951c7 tempest-SnapshotDependencyTests-405315099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 17:00:22 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-78bce543-00c0-4d99-b8b4-14dcaf8951c7 tempest-SnapshotDependencyTests-405315099 None] Creating offline snapshot c8cce606-87f4-4422-a58a-7bc4e759d71f of volume df1594e9-5105-451e-9842-0fb09ce06497 {{(pid=88189) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 17:00:22 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[beaea97b-80c5-46fe-a261-6a451cf4096d]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 17:00:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-78bce543-00c0-4d99-b8b4-14dcaf8951c7 tempest-SnapshotDependencyTests-405315099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 17:00:22 devstack sudo[109610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497 Sep 10 17:00:22 devstack sudo[109610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:00:22 devstack sudo[109610]: pam_unix(sudo:session): session closed for user root Sep 10 17:00:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-78bce543-00c0-4d99-b8b4-14dcaf8951c7 tempest-SnapshotDependencyTests-405315099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497" returned: 0 in 0.365s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 17:00:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-78bce543-00c0-4d99-b8b4-14dcaf8951c7 tempest-SnapshotDependencyTests-405315099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497.c8cce606-87f4-4422-a58a-7bc4e759d71f 1G {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 17:00:22 devstack sudo[109615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497.c8cce606-87f4-4422-a58a-7bc4e759d71f 1G Sep 10 17:00:22 devstack sudo[109615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:00:22 devstack sudo[109615]: pam_unix(sudo:session): session closed for user root Sep 10 17:00:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-78bce543-00c0-4d99-b8b4-14dcaf8951c7 tempest-SnapshotDependencyTests-405315099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497.c8cce606-87f4-4422-a58a-7bc4e759d71f 1G" returned: 0 in 0.386s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 17:00:22 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-78bce543-00c0-4d99-b8b4-14dcaf8951c7 tempest-SnapshotDependencyTests-405315099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df1594e9-5105-451e-9842-0fb09ce06497 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497.c8cce606-87f4-4422-a58a-7bc4e759d71f {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 17:00:22 devstack sudo[109620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df1594e9-5105-451e-9842-0fb09ce06497 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497.c8cce606-87f4-4422-a58a-7bc4e759d71f Sep 10 17:00:22 devstack sudo[109620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:00:23 devstack sudo[109620]: pam_unix(sudo:session): session closed for user root Sep 10 17:00:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-78bce543-00c0-4d99-b8b4-14dcaf8951c7 tempest-SnapshotDependencyTests-405315099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df1594e9-5105-451e-9842-0fb09ce06497 -F qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497.c8cce606-87f4-4422-a58a-7bc4e759d71f" returned: 0 in 0.279s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 17:00:23 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-78bce543-00c0-4d99-b8b4-14dcaf8951c7 tempest-SnapshotDependencyTests-405315099 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497.c8cce606-87f4-4422-a58a-7bc4e759d71f is being set with open permissions: ugo+rw Sep 10 17:00:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-78bce543-00c0-4d99-b8b4-14dcaf8951c7 tempest-SnapshotDependencyTests-405315099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497.c8cce606-87f4-4422-a58a-7bc4e759d71f {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 17:00:23 devstack sudo[109626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497.c8cce606-87f4-4422-a58a-7bc4e759d71f Sep 10 17:00:23 devstack sudo[109626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:00:23 devstack sudo[109626]: pam_unix(sudo:session): session closed for user root Sep 10 17:00:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-78bce543-00c0-4d99-b8b4-14dcaf8951c7 tempest-SnapshotDependencyTests-405315099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497.c8cce606-87f4-4422-a58a-7bc4e759d71f" returned: 0 in 0.246s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 17:00:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-78bce543-00c0-4d99-b8b4-14dcaf8951c7 tempest-SnapshotDependencyTests-405315099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 17:00:23 devstack sudo[109629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497.info Sep 10 17:00:23 devstack sudo[109629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:00:23 devstack sudo[109629]: pam_unix(sudo:session): session closed for user root Sep 10 17:00:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-78bce543-00c0-4d99-b8b4-14dcaf8951c7 tempest-SnapshotDependencyTests-405315099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497.info" returned: 0 in 0.242s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 17:00:23 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-78bce543-00c0-4d99-b8b4-14dcaf8951c7 tempest-SnapshotDependencyTests-405315099 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497.info is being set with open permissions: ugo+rw Sep 10 17:00:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-78bce543-00c0-4d99-b8b4-14dcaf8951c7 tempest-SnapshotDependencyTests-405315099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497.info {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 17:00:23 devstack sudo[109632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497.info Sep 10 17:00:23 devstack sudo[109632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:00:23 devstack sudo[109632]: pam_unix(sudo:session): session closed for user root Sep 10 17:00:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-78bce543-00c0-4d99-b8b4-14dcaf8951c7 tempest-SnapshotDependencyTests-405315099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497.info" returned: 0 in 0.243s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 17:00:23 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-78bce543-00c0-4d99-b8b4-14dcaf8951c7 tempest-SnapshotDependencyTests-405315099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.840s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 17:00:23 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-78bce543-00c0-4d99-b8b4-14dcaf8951c7 tempest-SnapshotDependencyTests-405315099 None] Create snapshot completed successfully Sep 10 17:00:24 devstack cinder-volume[88189]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88189) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 17:00:24 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Flow 'volume_create_manager' (80416c86-e967-4fe7-8f2f-532e182004f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 17:00:24 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c26bd7-16cf-4de1-90f2-8f8626914eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 17:00:24 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c26bd7-16cf-4de1-90f2-8f8626914eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T15:00:24Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bce86c2d-6b61-4028-b9ed-be0fc67688a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc93fdffbdac407f9159ba4b6742caa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T15:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c8cce606-87f4-4422-a58a-7bc4e759d71f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T15:00:25Z,use_quota=True,user_id='8d740afba69145b7bce58832da025be3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1726700b-9b6a-4082-aa41-a7b5ad85fd12),volume_type_id=1726700b-9b6a-4082-aa41-a7b5ad85fd12)' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 17:00:24 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a441f4d6-b9c0-49ec-a2d0-3af010d46cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 17:00:24 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a441f4d6-b9c0-49ec-a2d0-3af010d46cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 17:00:24 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce0af414-2fcd-4253-a0e8-4b2fe17bf5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 17:00:24 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce0af414-2fcd-4253-a0e8-4b2fe17bf5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bce86c2d-6b61-4028-b9ed-be0fc67688a2', 'volume_name': 'volume-bce86c2d-6b61-4028-b9ed-be0fc67688a2', 'volume_size': 1, 'snapshot_id': 'c8cce606-87f4-4422-a58a-7bc4e759d71f'}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 17:00:24 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e3a49c-18d5-439f-9367-9d700e808e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 17:00:24 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e3a49c-18d5-439f-9367-9d700e808e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 17:00:24 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bbc6d2e-72e2-4401-aa17-afe3d40faab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 17:00:24 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Volume bce86c2d-6b61-4028-b9ed-be0fc67688a2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bce86c2d-6b61-4028-b9ed-be0fc67688a2', 'volume_size': 1, 'snapshot_id': 'c8cce606-87f4-4422-a58a-7bc4e759d71f'} Sep 10 17:00:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 17:00:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 17:00:24 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Acquiring lock "cinder-quobyte-c8cce606-87f4-4422-a58a-7bc4e759d71f-bce86c2d-6b61-4028-b9ed-be0fc67688a2" by "_create_volume_from_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 17:00:24 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Lock "cinder-quobyte-c8cce606-87f4-4422-a58a-7bc4e759d71f-bce86c2d-6b61-4028-b9ed-be0fc67688a2" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 17:00:24 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Creating volume bce86c2d-6b61-4028-b9ed-be0fc67688a2 from snapshot c8cce606-87f4-4422-a58a-7bc4e759d71f {{(pid=88189) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 10 17:00:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 17:00:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 17:00:24 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 17:00:24 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 17:00:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 17:00:24 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Selected osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8 as target Quobyte volume. {{(pid=88189) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 17:00:24 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Acquiring lock "cinder-quobyte-bce86c2d-6b61-4028-b9ed-be0fc67688a2" by "_copy_volume_from_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 17:00:24 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Lock "cinder-quobyte-bce86c2d-6b61-4028-b9ed-be0fc67688a2" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 17:00:24 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] snapshot: c8cce606-87f4-4422-a58a-7bc4e759d71f, volume: bce86c2d-6b61-4028-b9ed-be0fc67688a2, {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 17:00:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 17:00:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 17:00:24 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 17:00:24 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 17:00:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 17:00:24 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2acd04e-c8a7-434d-b0c1-454ea7397d3a]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 17:00:24 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497.c8cce606-87f4-4422-a58a-7bc4e759d71f {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 17:00:24 devstack sudo[109635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497.c8cce606-87f4-4422-a58a-7bc4e759d71f Sep 10 17:00:24 devstack sudo[109635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:00:25 devstack sudo[109635]: pam_unix(sudo:session): session closed for user root Sep 10 17:00:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497.c8cce606-87f4-4422-a58a-7bc4e759d71f" returned: 0 in 0.341s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 17:00:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df1594e9-5105-451e-9842-0fb09ce06497(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 17:00:25 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a484560d-a0ae-4f2f-9172-b8bf2146c828]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 17:00:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 17:00:25 devstack sudo[109640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497 Sep 10 17:00:25 devstack sudo[109640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:00:25 devstack sudo[109640]: pam_unix(sudo:session): session closed for user root Sep 10 17:00:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497" returned: 0 in 0.352s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 17:00:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] will copy from snapshot at /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497 {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 17:00:25 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Creating direct copy from snapshot {{(pid=88189) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 17:00:25 devstack cinder-volume[88189]: DEBUG cinder.utils [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Path /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bce86c2d-6b61-4028-b9ed-be0fc67688a2 not found in is_blk_device check {{(pid=88189) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 17:00:25 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bce86c2d-6b61-4028-b9ed-be0fc67688a2 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 17:00:25 devstack sudo[109645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bce86c2d-6b61-4028-b9ed-be0fc67688a2 Sep 10 17:00:25 devstack sudo[109645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:00:29 devstack sudo[109645]: pam_unix(sudo:session): session closed for user root Sep 10 17:00:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bce86c2d-6b61-4028-b9ed-be0fc67688a2" returned: 0 in 4.061s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 17:00:29 devstack cinder-volume[88189]: DEBUG cinder.image.image_utils [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Image conversion details: src /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497, size 1024.00 MB, duration 4.06 sec, destination /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bce86c2d-6b61-4028-b9ed-be0fc67688a2 {{(pid=88189) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 17:00:29 devstack cinder-volume[88189]: INFO cinder.image.image_utils [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Converted 1024.00 MB image at 252.09 MB/s Sep 10 17:00:29 devstack cinder-volume[88189]: WARNING cinder.volume.drivers.remotefs [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bce86c2d-6b61-4028-b9ed-be0fc67688a2 is being set with open permissions: ugo+rw Sep 10 17:00:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bce86c2d-6b61-4028-b9ed-be0fc67688a2 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 17:00:29 devstack sudo[109664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bce86c2d-6b61-4028-b9ed-be0fc67688a2 Sep 10 17:00:29 devstack sudo[109664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:00:29 devstack sudo[109664]: pam_unix(sudo:session): session closed for user root Sep 10 17:00:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bce86c2d-6b61-4028-b9ed-be0fc67688a2" returned: 0 in 0.250s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 17:00:29 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Lock "cinder-quobyte-bce86c2d-6b61-4028-b9ed-be0fc67688a2" released by "_copy_volume_from_snapshot" :: held 5.081s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 17:00:29 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Lock "cinder-quobyte-c8cce606-87f4-4422-a58a-7bc4e759d71f-bce86c2d-6b61-4028-b9ed-be0fc67688a2" released by "_create_volume_from_snapshot" :: held 5.142s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 17:00:29 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.156s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 17:00:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bbc6d2e-72e2-4401-aa17-afe3d40faab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bce86c2d-6b61-4028-b9ed-be0fc67688a2', 'volume_size': 1, 'snapshot_id': 'c8cce606-87f4-4422-a58a-7bc4e759d71f'}' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 17:00:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60d0e95f-d830-4faa-852b-7fe26709e57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 17:00:29 devstack cinder-volume[88189]: INFO cinder.volume.flows.manager.create_volume [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Volume volume-bce86c2d-6b61-4028-b9ed-be0fc67688a2 (bce86c2d-6b61-4028-b9ed-be0fc67688a2): created successfully Sep 10 17:00:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60d0e95f-d830-4faa-852b-7fe26709e57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88189) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 17:00:29 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Flow 'volume_create_manager' (80416c86-e967-4fe7-8f2f-532e182004f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88189) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 17:00:29 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-9eaa51d6-94d7-40aa-b107-5c9257ed0051 tempest-SnapshotDependencyTests-405315099 None] Created volume successfully. Sep 10 17:00:30 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9027aa87-ff1d-4b5a-a3e2-841c1aea8f73 tempest-SnapshotDependencyTests-405315099 None] Acquiring lock "cinder-c8cce606-87f4-4422-a58a-7bc4e759d71f-delete_snapshot" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 17:00:30 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9027aa87-ff1d-4b5a-a3e2-841c1aea8f73 tempest-SnapshotDependencyTests-405315099 None] Lock "cinder-c8cce606-87f4-4422-a58a-7bc4e759d71f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 17:00:30 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9027aa87-ff1d-4b5a-a3e2-841c1aea8f73 tempest-SnapshotDependencyTests-405315099 None] Acquiring lock "cinder-quobyte-df1594e9-5105-451e-9842-0fb09ce06497" by "delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 17:00:30 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9027aa87-ff1d-4b5a-a3e2-841c1aea8f73 tempest-SnapshotDependencyTests-405315099 None] Lock "cinder-quobyte-df1594e9-5105-451e-9842-0fb09ce06497" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 17:00:30 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9027aa87-ff1d-4b5a-a3e2-841c1aea8f73 tempest-SnapshotDependencyTests-405315099 None] Acquiring lock "cinder-quobyte-c8cce606-87f4-4422-a58a-7bc4e759d71f" by "_delete_snapshot" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 17:00:30 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9027aa87-ff1d-4b5a-a3e2-841c1aea8f73 tempest-SnapshotDependencyTests-405315099 None] Lock "cinder-quobyte-c8cce606-87f4-4422-a58a-7bc4e759d71f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 17:00:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-9027aa87-ff1d-4b5a-a3e2-841c1aea8f73 tempest-SnapshotDependencyTests-405315099 None] Deleting offline snapshot c8cce606-87f4-4422-a58a-7bc4e759d71f of volume df1594e9-5105-451e-9842-0fb09ce06497 {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 17:00:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-9027aa87-ff1d-4b5a-a3e2-841c1aea8f73 tempest-SnapshotDependencyTests-405315099 None] snapshot_file for this snap is: volume-df1594e9-5105-451e-9842-0fb09ce06497.c8cce606-87f4-4422-a58a-7bc4e759d71f {{(pid=88189) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 17:00:30 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a43bec-7e32-47a5-8132-2af2b34b3e2f]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 17:00:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9027aa87-ff1d-4b5a-a3e2-841c1aea8f73 tempest-SnapshotDependencyTests-405315099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497.c8cce606-87f4-4422-a58a-7bc4e759d71f {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 17:00:30 devstack sudo[109667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497.c8cce606-87f4-4422-a58a-7bc4e759d71f Sep 10 17:00:30 devstack sudo[109667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:00:30 devstack sudo[109667]: pam_unix(sudo:session): session closed for user root Sep 10 17:00:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9027aa87-ff1d-4b5a-a3e2-841c1aea8f73 tempest-SnapshotDependencyTests-405315099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497.c8cce606-87f4-4422-a58a-7bc4e759d71f" returned: 0 in 0.343s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 17:00:30 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.remotefs [None req-9027aa87-ff1d-4b5a-a3e2-841c1aea8f73 tempest-SnapshotDependencyTests-405315099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df1594e9-5105-451e-9842-0fb09ce06497(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88189) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 17:00:30 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ef5670-a083-4f59-9881-78f88329fe44]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 17:00:30 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9027aa87-ff1d-4b5a-a3e2-841c1aea8f73 tempest-SnapshotDependencyTests-405315099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 17:00:30 devstack sudo[109672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497 Sep 10 17:00:30 devstack sudo[109672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:00:31 devstack sudo[109672]: pam_unix(sudo:session): session closed for user root Sep 10 17:00:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9027aa87-ff1d-4b5a-a3e2-841c1aea8f73 tempest-SnapshotDependencyTests-405315099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497" returned: 0 in 0.519s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 17:00:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9027aa87-ff1d-4b5a-a3e2-841c1aea8f73 tempest-SnapshotDependencyTests-405315099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497.c8cce606-87f4-4422-a58a-7bc4e759d71f {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 17:00:31 devstack sudo[109678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497.c8cce606-87f4-4422-a58a-7bc4e759d71f Sep 10 17:00:31 devstack sudo[109678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:00:31 devstack sudo[109678]: pam_unix(sudo:session): session closed for user root Sep 10 17:00:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9027aa87-ff1d-4b5a-a3e2-841c1aea8f73 tempest-SnapshotDependencyTests-405315099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497.c8cce606-87f4-4422-a58a-7bc4e759d71f" returned: 0 in 0.320s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 17:00:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9027aa87-ff1d-4b5a-a3e2-841c1aea8f73 tempest-SnapshotDependencyTests-405315099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497.c8cce606-87f4-4422-a58a-7bc4e759d71f {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 17:00:31 devstack sudo[109683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497.c8cce606-87f4-4422-a58a-7bc4e759d71f Sep 10 17:00:31 devstack sudo[109683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:00:31 devstack sudo[109683]: pam_unix(sudo:session): session closed for user root Sep 10 17:00:31 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-9027aa87-ff1d-4b5a-a3e2-841c1aea8f73 tempest-SnapshotDependencyTests-405315099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497.c8cce606-87f4-4422-a58a-7bc4e759d71f" returned: 0 in 0.243s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 17:00:31 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9027aa87-ff1d-4b5a-a3e2-841c1aea8f73 tempest-SnapshotDependencyTests-405315099 None] Lock "cinder-quobyte-c8cce606-87f4-4422-a58a-7bc4e759d71f" released by "_delete_snapshot" :: held 1.512s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 17:00:31 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9027aa87-ff1d-4b5a-a3e2-841c1aea8f73 tempest-SnapshotDependencyTests-405315099 None] Lock "cinder-quobyte-df1594e9-5105-451e-9842-0fb09ce06497" released by "delete_snapshot" :: held 1.535s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 17:00:31 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-9027aa87-ff1d-4b5a-a3e2-841c1aea8f73 tempest-SnapshotDependencyTests-405315099 None] Created reservations ['460005a5-93b3-45f6-bfc9-70d36a7673fc', 'd3afe885-bfbb-4e63-af9b-e0ba43c72a9e', 'f03ad4e7-f7d6-4763-b9b5-d827091753e6', '0f8973fd-fa02-4fb7-90d8-0dd9d8355e4e'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:00:31 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-9027aa87-ff1d-4b5a-a3e2-841c1aea8f73 tempest-SnapshotDependencyTests-405315099 None] Delete snapshot completed successfully. Sep 10 17:00:31 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-9027aa87-ff1d-4b5a-a3e2-841c1aea8f73 tempest-SnapshotDependencyTests-405315099 None] Lock "cinder-c8cce606-87f4-4422-a58a-7bc4e759d71f-delete_snapshot" released by "delete_snapshot" :: held 1.663s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 17:00:32 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c195d31a-9396-41a6-b258-ab400dabbc7d tempest-SnapshotDependencyTests-405315099 None] Acquiring lock "cinder-df1594e9-5105-451e-9842-0fb09ce06497-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 17:00:32 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c195d31a-9396-41a6-b258-ab400dabbc7d tempest-SnapshotDependencyTests-405315099 None] Lock "cinder-df1594e9-5105-451e-9842-0fb09ce06497-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 17:00:32 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c195d31a-9396-41a6-b258-ab400dabbc7d tempest-SnapshotDependencyTests-405315099 None] Acquiring lock "cinder-quobyte-df1594e9-5105-451e-9842-0fb09ce06497" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 17:00:32 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c195d31a-9396-41a6-b258-ab400dabbc7d tempest-SnapshotDependencyTests-405315099 None] Lock "cinder-quobyte-df1594e9-5105-451e-9842-0fb09ce06497" acquired by "delete_volume" :: waited 0.016s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 17:00:32 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a91fe9e-0711-4020-b21b-cc4fcbf0f4ec]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 17:00:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c195d31a-9396-41a6-b258-ab400dabbc7d tempest-SnapshotDependencyTests-405315099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 17:00:32 devstack sudo[109686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497 Sep 10 17:00:32 devstack sudo[109686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:00:32 devstack sudo[109686]: pam_unix(sudo:session): session closed for user root Sep 10 17:00:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c195d31a-9396-41a6-b258-ab400dabbc7d tempest-SnapshotDependencyTests-405315099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497" returned: 0 in 0.343s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 17:00:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c195d31a-9396-41a6-b258-ab400dabbc7d tempest-SnapshotDependencyTests-405315099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 17:00:32 devstack sudo[109691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497 Sep 10 17:00:32 devstack sudo[109691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:00:32 devstack sudo[109691]: pam_unix(sudo:session): session closed for user root Sep 10 17:00:32 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c195d31a-9396-41a6-b258-ab400dabbc7d tempest-SnapshotDependencyTests-405315099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-df1594e9-5105-451e-9842-0fb09ce06497" returned: 0 in 0.236s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 17:00:32 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c195d31a-9396-41a6-b258-ab400dabbc7d tempest-SnapshotDependencyTests-405315099 None] Lock "cinder-quobyte-df1594e9-5105-451e-9842-0fb09ce06497" released by "delete_volume" :: held 0.632s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 17:00:33 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-c195d31a-9396-41a6-b258-ab400dabbc7d tempest-SnapshotDependencyTests-405315099 None] Created reservations ['8ba28318-1b17-4b87-932f-24f41363fa5d', '45e6f29b-9c99-4f30-8eb2-c4adebf3f510', '93299d65-8ae7-4306-96a2-eab939f42ead', 'ca762139-9536-4398-ae78-891265118bad'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:00:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c195d31a-9396-41a6-b258-ab400dabbc7d tempest-SnapshotDependencyTests-405315099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 17:00:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c195d31a-9396-41a6-b258-ab400dabbc7d tempest-SnapshotDependencyTests-405315099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 17:00:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c195d31a-9396-41a6-b258-ab400dabbc7d tempest-SnapshotDependencyTests-405315099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 17:00:33 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-c195d31a-9396-41a6-b258-ab400dabbc7d tempest-SnapshotDependencyTests-405315099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 17:00:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-c195d31a-9396-41a6-b258-ab400dabbc7d tempest-SnapshotDependencyTests-405315099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 17:00:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c195d31a-9396-41a6-b258-ab400dabbc7d tempest-SnapshotDependencyTests-405315099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 17:00:33 devstack sudo[109694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 17:00:33 devstack sudo[109694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:00:33 devstack sudo[109694]: pam_unix(sudo:session): session closed for user root Sep 10 17:00:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-c195d31a-9396-41a6-b258-ab400dabbc7d tempest-SnapshotDependencyTests-405315099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.235s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 17:00:33 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-c195d31a-9396-41a6-b258-ab400dabbc7d tempest-SnapshotDependencyTests-405315099 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 17:00:33 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-c195d31a-9396-41a6-b258-ab400dabbc7d tempest-SnapshotDependencyTests-405315099 None] Deleted volume successfully. Sep 10 17:00:33 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-c195d31a-9396-41a6-b258-ab400dabbc7d tempest-SnapshotDependencyTests-405315099 None] Lock "cinder-df1594e9-5105-451e-9842-0fb09ce06497-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 17:00:33 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4f3a8bc9-b46c-48ac-938a-ff33568fa59d tempest-SnapshotDependencyTests-405315099 None] Acquiring lock "cinder-bce86c2d-6b61-4028-b9ed-be0fc67688a2-delete_volume" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 17:00:33 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4f3a8bc9-b46c-48ac-938a-ff33568fa59d tempest-SnapshotDependencyTests-405315099 None] Lock "cinder-bce86c2d-6b61-4028-b9ed-be0fc67688a2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 17:00:33 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4f3a8bc9-b46c-48ac-938a-ff33568fa59d tempest-SnapshotDependencyTests-405315099 None] Acquiring lock "cinder-quobyte-bce86c2d-6b61-4028-b9ed-be0fc67688a2" by "delete_volume" {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 17:00:33 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4f3a8bc9-b46c-48ac-938a-ff33568fa59d tempest-SnapshotDependencyTests-405315099 None] Lock "cinder-quobyte-bce86c2d-6b61-4028-b9ed-be0fc67688a2" acquired by "delete_volume" :: waited 0.016s {{(pid=88189) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 17:00:33 devstack cinder-volume[88189]: DEBUG oslo.privsep.daemon [-] privsep: reply[345fe7e6-511d-4ba0-8311-a814b6241492]: (4, 'qcow2') {{(pid=89855) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 17:00:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4f3a8bc9-b46c-48ac-938a-ff33568fa59d tempest-SnapshotDependencyTests-405315099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bce86c2d-6b61-4028-b9ed-be0fc67688a2 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 17:00:33 devstack sudo[109697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bce86c2d-6b61-4028-b9ed-be0fc67688a2 Sep 10 17:00:33 devstack sudo[109697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:00:33 devstack sudo[109697]: pam_unix(sudo:session): session closed for user root Sep 10 17:00:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4f3a8bc9-b46c-48ac-938a-ff33568fa59d tempest-SnapshotDependencyTests-405315099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bce86c2d-6b61-4028-b9ed-be0fc67688a2" returned: 0 in 0.344s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 17:00:33 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4f3a8bc9-b46c-48ac-938a-ff33568fa59d tempest-SnapshotDependencyTests-405315099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bce86c2d-6b61-4028-b9ed-be0fc67688a2 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 17:00:33 devstack sudo[109702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bce86c2d-6b61-4028-b9ed-be0fc67688a2 Sep 10 17:00:33 devstack sudo[109702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:00:34 devstack sudo[109702]: pam_unix(sudo:session): session closed for user root Sep 10 17:00:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4f3a8bc9-b46c-48ac-938a-ff33568fa59d tempest-SnapshotDependencyTests-405315099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7/volume-bce86c2d-6b61-4028-b9ed-be0fc67688a2" returned: 0 in 0.233s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 17:00:34 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4f3a8bc9-b46c-48ac-938a-ff33568fa59d tempest-SnapshotDependencyTests-405315099 None] Lock "cinder-quobyte-bce86c2d-6b61-4028-b9ed-be0fc67688a2" released by "delete_volume" :: held 0.615s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 17:00:34 devstack cinder-volume[88189]: DEBUG cinder.quota [None req-4f3a8bc9-b46c-48ac-938a-ff33568fa59d tempest-SnapshotDependencyTests-405315099 None] Created reservations ['1067ab2d-1a19-4e00-ac6c-74dc8873dab4', '40ddc58b-56dc-4f8a-a585-70ca20823c67', '185f14a0-59f3-4a37-b98a-7ab59fa89bb5', '654599d7-63f1-4004-b8d2-63f2673c346f'] {{(pid=88189) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 17:00:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4f3a8bc9-b46c-48ac-938a-ff33568fa59d tempest-SnapshotDependencyTests-405315099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 17:00:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4f3a8bc9-b46c-48ac-938a-ff33568fa59d tempest-SnapshotDependencyTests-405315099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 17:00:34 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-4f3a8bc9-b46c-48ac-938a-ff33568fa59d tempest-SnapshotDependencyTests-405315099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 17:00:34 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-4f3a8bc9-b46c-48ac-938a-ff33568fa59d tempest-SnapshotDependencyTests-405315099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 17:00:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-4f3a8bc9-b46c-48ac-938a-ff33568fa59d tempest-SnapshotDependencyTests-405315099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 17:00:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4f3a8bc9-b46c-48ac-938a-ff33568fa59d tempest-SnapshotDependencyTests-405315099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 17:00:34 devstack sudo[109705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 17:00:34 devstack sudo[109705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:00:34 devstack sudo[109705]: pam_unix(sudo:session): session closed for user root Sep 10 17:00:34 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-4f3a8bc9-b46c-48ac-938a-ff33568fa59d tempest-SnapshotDependencyTests-405315099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.238s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 17:00:34 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-4f3a8bc9-b46c-48ac-938a-ff33568fa59d tempest-SnapshotDependencyTests-405315099 None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 17:00:34 devstack cinder-volume[88189]: INFO cinder.volume.manager [None req-4f3a8bc9-b46c-48ac-938a-ff33568fa59d tempest-SnapshotDependencyTests-405315099 None] Deleted volume successfully. Sep 10 17:00:34 devstack cinder-volume[88189]: DEBUG cinder.coordination [None req-4f3a8bc9-b46c-48ac-938a-ff33568fa59d tempest-SnapshotDependencyTests-405315099 None] Lock "cinder-bce86c2d-6b61-4028-b9ed-be0fc67688a2-delete_volume" released by "delete_volume" :: held 1.038s {{(pid=88189) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 17:00:44 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:UPDATE=28,cinder:SELECT=24,cinder:DELETE=2,cinder:INSERT=7 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 17:00:44 devstack cinder-volume[88189]: DEBUG dbcounter [-] [88189] Writing DB stats cinder:SELECT=25,cinder:INSERT=8,cinder:UPDATE=30,cinder:DELETE=3 {{(pid=88189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 17:00:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 17:00:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 17:00:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 17:00:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8': None} {{(pid=88189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 17:00:49 devstack cinder-volume[88189]: DEBUG cinder.volume.drivers.quobyte [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1554932-4174-42be-964d-c76ac6c4fda8'] {{(pid=88189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 17:00:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.lockutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 17:00:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 17:00:49 devstack sudo[109718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7 Sep 10 17:00:49 devstack sudo[109718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 17:00:49 devstack sudo[109718]: pam_unix(sudo:session): session closed for user root Sep 10 17:00:49 devstack cinder-volume[88189]: DEBUG oslo_concurrency.processutils [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/821fa3ebfa7441e7ef5db3fe51e6d8c7" returned: 0 in 0.248s {{(pid=88189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 17:00:49 devstack cinder-volume[88189]: DEBUG cinder.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Notifying Schedulers of capabilities ... {{(pid=88189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 17:00:49 devstack cinder-volume[88189]: DEBUG oslo_service.periodic_task [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] Running periodic task VolumeManager._thread_info {{(pid=88189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 17:00:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread count: 29 {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 17:00:49 devstack cinder-volume[88189]: DEBUG cinder.volume.manager [None req-23cf01c0-e961-4184-8d32-b0562b7a7183 None None] thread info: [<_MainThread(MainThread, started 125792070905984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}